-- Logs begin at Tue 2022-07-26 01:47:35 UTC, end at Tue 2022-07-26 03:02:55 UTC. -- Jul 26 02:30:47.506411 dv-cinder-850840-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 26 02:30:47.515316 dv-cinder-850840-2-smb devstack@keystone.service[86816]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 26 02:30:47.518012 dv-cinder-850840-2-smb devstack@keystone.service[86816]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 02:30:47 2022] *** Jul 26 02:30:47.519827 dv-cinder-850840-2-smb devstack@keystone.service[86816]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 02:30:47.519996 dv-cinder-850840-2-smb devstack@keystone.service[86816]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 02:30:47.520154 dv-cinder-850840-2-smb devstack@keystone.service[86816]: nodename: dv-cinder-850840-2-smb Jul 26 02:30:47.520313 dv-cinder-850840-2-smb devstack@keystone.service[86816]: machine: x86_64 Jul 26 02:30:47.520467 dv-cinder-850840-2-smb devstack@keystone.service[86816]: clock source: unix Jul 26 02:30:47.520614 dv-cinder-850840-2-smb devstack@keystone.service[86816]: pcre jit disabled Jul 26 02:30:47.520762 dv-cinder-850840-2-smb devstack@keystone.service[86816]: detected number of CPU cores: 4 Jul 26 02:30:47.520905 dv-cinder-850840-2-smb devstack@keystone.service[86816]: current working directory: / Jul 26 02:30:47.521052 dv-cinder-850840-2-smb devstack@keystone.service[86816]: detected binary path: /usr/bin/uwsgi-core Jul 26 02:30:47.521207 dv-cinder-850840-2-smb devstack@keystone.service[86816]: your processes number limit is 47680 Jul 26 02:30:47.521409 dv-cinder-850840-2-smb devstack@keystone.service[86816]: your memory page size is 4096 bytes Jul 26 02:30:47.521563 dv-cinder-850840-2-smb devstack@keystone.service[86816]: detected max file descriptor number: 2048 Jul 26 02:30:47.521714 dv-cinder-850840-2-smb devstack@keystone.service[86816]: lock engine: pthread robust mutexes Jul 26 02:30:47.522028 dv-cinder-850840-2-smb devstack@keystone.service[86816]: thunder lock: enabled Jul 26 02:30:47.522371 dv-cinder-850840-2-smb devstack@keystone.service[86816]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 26 02:30:47.522601 dv-cinder-850840-2-smb devstack@keystone.service[86816]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 02:30:47.561177 dv-cinder-850840-2-smb devstack@keystone.service[86816]: Python main interpreter initialized at 0x5642633589c0 Jul 26 02:30:47.561177 dv-cinder-850840-2-smb devstack@keystone.service[86816]: python threads support enabled Jul 26 02:30:47.561177 dv-cinder-850840-2-smb devstack@keystone.service[86816]: your server socket listen backlog is limited to 100 connections Jul 26 02:30:47.561177 dv-cinder-850840-2-smb devstack@keystone.service[86816]: your mercy for graceful operations on workers is 90 seconds Jul 26 02:30:47.561584 dv-cinder-850840-2-smb devstack@keystone.service[86816]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 02:30:47.561672 dv-cinder-850840-2-smb devstack@keystone.service[86816]: *** Operational MODE: preforking *** Jul 26 02:30:47.561937 dv-cinder-850840-2-smb devstack@keystone.service[86816]: *** uWSGI is running in multiple interpreter mode *** Jul 26 02:30:47.561937 dv-cinder-850840-2-smb devstack@keystone.service[86816]: spawned uWSGI master process (pid: 86816) Jul 26 02:30:47.562196 dv-cinder-850840-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 26 02:30:47.564482 dv-cinder-850840-2-smb devstack@keystone.service[86816]: spawned uWSGI worker 1 (pid: 86829, cores: 1) Jul 26 02:30:47.564482 dv-cinder-850840-2-smb devstack@keystone.service[86816]: spawned uWSGI worker 2 (pid: 86830, cores: 1) Jul 26 02:30:47.564482 dv-cinder-850840-2-smb devstack@keystone.service[86816]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 02:30:53.047517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 02:30:53.047517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: from cryptography.utils import int_from_bytes Jul 26 02:30:53.048326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 02:30:53.048326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: from cryptography.utils import int_from_bytes Jul 26 02:30:53.048760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 02:30:53.048760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: from cryptography.utils import int_from_bytes Jul 26 02:30:53.048879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 02:30:53.048879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: from cryptography.utils import int_from_bytes Jul 26 02:30:53.097353 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 02:30:53.097550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 02:30:53.097629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 02:30:53.097708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 02:30:53.097769 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] command line args: [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 02:30:53.097834 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] command line args: [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 02:30:53.097980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 02:30:53.098065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 02:30:53.098130 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ================================================================================ {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 02:30:53.098192 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ================================================================================ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 02:30:53.098389 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] admin_token = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.098486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] admin_token = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.098667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] config_dir = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.098751 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] config_dir = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.098858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.098940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.099057 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] config_source = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.099201 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] config_source = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.099284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] debug = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.099357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] debug = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.099433 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.099674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.099768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.099832 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.099943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.100021 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.100182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.100254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.100427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.100498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.100656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.100725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.100819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] log_config_append = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.100894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] log_config_append = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.101005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.101075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.101160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] log_dir = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.101229 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] log_dir = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.101370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] log_file = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.101452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] log_file = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.101599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.101668 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.101844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.101927 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.102087 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.102169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.102357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.102468 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.102548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.102621 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.102692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.102762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.102898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.102994 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.103112 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.103201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.103360 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.103446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.103577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.103662 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.103811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.103904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.104057 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.104192 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.104259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.104319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.104501 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.104619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.104771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.104855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.105272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.105378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.105462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] publish_errors = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.105530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] publish_errors = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.106058 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.106159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.106285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.106361 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.106468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.106542 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.106697 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.106817 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.106966 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.107089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.107171 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] standard_threads = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.107295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] standard_threads = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.107375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.107445 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.107602 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.107689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.107761 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.107841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.107912 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] use_journal = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.107986 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] use_journal = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.108088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] use_json = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.108179 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] use_json = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.108307 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] use_stderr = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.108405 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] use_stderr = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.108469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] use_syslog = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.108538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] use_syslog = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.108670 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.108759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 02:30:53.108903 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.108989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.109137 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.109212 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.109414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.109494 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.109648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.109739 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.109894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.109971 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.110126 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.110210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.110369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.110457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.110599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.110681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.110842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.110918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.111084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.111185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.111333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.111413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.111559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.111640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.111800 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.111888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.112028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.112110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.112273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.112355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.112516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.112679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.112753 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.112821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.112983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.113109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.113230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.113351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.113492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.113575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.113724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.113806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.113974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.114063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.114227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.114303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.114475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.114550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.114720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.114805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.114948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.115025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.115173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.115248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.115399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.115482 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.115627 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.115709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.115869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.115944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.116110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.116200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.116335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.116411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.116558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.116633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.116800 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.116877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.117046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.117121 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.117274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.117400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.117541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.117625 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.117768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.117844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.117997 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.118072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.118221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.118295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.118437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.118515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.118662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.118744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.118887 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.118965 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.119112 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.119193 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.119342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.119417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.119584 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.119662 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.119808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.119882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.120036 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.120111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.120261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.120338 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.120488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.120572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.120718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.120798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.121094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.121221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.121351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.121464 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.121561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.121692 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.121807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.121909 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.122003 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.122115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.122187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.122299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.122383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.122456 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.122569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.122643 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.122760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.122849 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.122944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.123031 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.123176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.123265 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.123402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.123489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.123656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.123738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.123967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.124056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.124173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.124285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.124383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.124461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.124614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.124696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.124876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.124956 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.125115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.125200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.125390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.125474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.125640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.125757 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.125877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.125963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.126105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.126181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.126338 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.126417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.126582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.126708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.126817 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.126894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.127051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.127133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.127288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.127376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.127522 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.127600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.127752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.127829 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.127981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.128073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.128209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.128286 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.128439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.128515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.128693 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.128779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.128928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.129014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.129162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.129238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.129421 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.129583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.129659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.129728 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.129879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.129956 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.130109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.130195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.130339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.130430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.130564 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.130641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.130791 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.130874 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.131016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.131102 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.131245 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.131322 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.131470 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.131548 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.131706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.131791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.131942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.132051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.132186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.132266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.132417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.132506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.132669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.132746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.132924 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.133001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.133160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.133238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.133412 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.external = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.133492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.external = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.133639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.133715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.133932 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.134050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.134165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.134243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.134390 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.password = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.134467 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.password = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.134618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] auth.token = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.134695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] auth.token = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.134851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.134931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.135081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.135159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.135322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.135399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.135549 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.135627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.135793 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.135871 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.136033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.136149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.136260 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.136339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.136491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.136575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.136734 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.136811 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.136984 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.137069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.137227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.137330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.137729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.137816 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.137891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.137964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.138030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.138089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.138239 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.138379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.138517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.138653 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.138778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.138904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.139030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.139156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.139292 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.139417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.139542 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.139673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.139798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.139922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.140056 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.140181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.140306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.140440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.140565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.140688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.140824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.140955 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.141080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.141204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.141348 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.141428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.141512 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.141586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.141657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.141727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.141798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.141868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.141946 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.142019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.142179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.142264 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.142430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.142514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.142665 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.142749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.142916 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.142998 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.143150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.143232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.143384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.143459 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.143628 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.143711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.143860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.143957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.144091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.144175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.144337 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.144421 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.144563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.144655 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.144798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.144881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.145045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.145128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.145305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.145404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.145541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.145634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.145799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.145944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.146027 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.146117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.146230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.146325 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.146493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.146619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.146698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.146784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.146980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.147106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.147184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.147256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.147481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.147620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.147703 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.147776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.147934 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.148060 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.148138 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.148225 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.148380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.148507 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.148598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.148672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.148823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.148963 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.149048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.149121 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.149248 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.149347 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.149514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.149610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.149741 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.149820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.149984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.150062 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.150227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.150314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.150456 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.150541 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.150697 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.150776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.150939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.151025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.151164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.151243 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.151396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.151475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.151622 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.151710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.151855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.151933 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.152085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.152162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.152321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.152407 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.152553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.152631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.152784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.152861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.153028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.153115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.153274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.153413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.153522 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.153600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.153748 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.153839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.153991 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.154069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.154236 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.154313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.154468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.154553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.154699 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.154776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.154928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.155005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.155180 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.155260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.155453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.155536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.155715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.155793 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.155943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.156021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.156187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.156272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.156429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.156507 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.156671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.156750 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.156905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.156982 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.157128 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.157205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.157382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.157465 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.157615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.157693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.157846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.157923 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.158072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.158152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.158314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.158392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.158556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.158633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.158796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.158875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.159142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.159221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.159389 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.159466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.159619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.159698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.159864 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.159942 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.160100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.160178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.160336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.160414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.160570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.160646 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.160799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.160885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.161039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.161119 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.161295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.161376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.161536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.161614 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.161787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.161867 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.162011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.162088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.162250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.162327 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.162482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.162561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.162714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.162792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.162950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.163027 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.163193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.163274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.163430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.163514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.163657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.163735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.163893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.163971 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.164126 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.164203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.164373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.164453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.164617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.164696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.164848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.164926 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.165095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.165172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.165361 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.165445 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.165595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.165672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.165838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.165916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.166071 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.166147 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.166290 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.166368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.166518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] role.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.166596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] role.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.166766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] role.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.166844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] role.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.166991 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.167067 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.167234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.167311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.167480 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.167560 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.167724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.167802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.167965 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.168052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.168208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.168286 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.168450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.168537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.168691 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.168782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.168937 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.169014 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.169162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.169239 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.169432 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.169523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.169673 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.169750 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.169916 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.169993 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.170158 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.170244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.170554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.170632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.170829 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.170968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.171072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.171164 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.171319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.171398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.171566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.171644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.171811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.171898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.172040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.172118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.172288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.172366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.172537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.172622 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.172772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.172850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.173001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.173078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.173229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.173374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.173482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.173560 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.173730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.173808 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.173981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.174061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.174222 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.174299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.174453 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.174530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.174683 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.174762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.174907 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.174984 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.175138 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] token.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.175222 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] token.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.175368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.175447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.175613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.175690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.175843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.175921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.176093 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.176171 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.176335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.176413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.176570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.176647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.176808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.176888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.177046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.177123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.177310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.177394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.177540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.177620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.177773 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.177849 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.178002 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.178084 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.178243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.178323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.178488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.178569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.178711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.178788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.178947 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.179027 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.179232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.179309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.179487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.connection = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.179573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.179727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.179815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.179970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.180058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.180200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.180278 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.180435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.180512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.180663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.180748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.180892 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.180969 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.181122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.181200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.181374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.181469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.181615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.181693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.181844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.181921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.182082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.182169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.182314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.182391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.182556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.182633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.182785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.182871 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.183024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.183101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.183250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.183329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.183485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.183570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.183714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.183792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 02:30:53.183881 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 02:30:53.183960 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 02:30:53.212909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.213082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.213151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.213211 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.213368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.213495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.221748 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.221924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.251797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.252036 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.252157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.252364 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.304423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.304576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.354226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.354394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.354491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.354571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.419014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.419221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.419317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.419482 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.419609 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.419678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.419761 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.419866 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.419954 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.420113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.420241 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.420321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.443320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.443564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.443681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.443752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.443874 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.443965 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.444133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.444284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.444356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.444432 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.444528 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.444614 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.444762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.444973 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.455660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.455789 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.468421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.468582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.468666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.468746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.468807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.468867 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.469048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.469189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.469259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.469365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.469442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.469503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.469691 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86829) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.469844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86830) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 02:30:53.487474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.487624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.487693 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 02:30:53.487768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 02:30:53.487969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.488094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.488161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 02:30:53.488223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 02:30:53.488411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.488550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.488620 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.488695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.488891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.489016 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.489117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.489218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.498843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.498970 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.499120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.499244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.499398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.499545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.499618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.499694 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.506556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.506683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.511242 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.511373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.511522 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.511648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.511804 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.511918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.512061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.512187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.512337 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.512464 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.512547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.512693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.512819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.512934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.513061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.513233 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.513397 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.513484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.513668 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.513792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.513861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.514021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.536694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.537128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.538203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.538450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.538609 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.538920 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.543057 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.543329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.543603 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.543841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.544111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.544387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.550316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.550595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.551121 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.551400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.554852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.555068 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.555349 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.555621 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.555758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.555858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.555946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.556160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.556285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.556380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.556483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.556695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.556818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.556971 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.557242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.557532 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.572570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.572840 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.573509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.573786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.576752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.577783 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.580088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.580375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.580957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.581250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.584753 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.585664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.587947 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.588846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.591122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.591415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.591691 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.591977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.592101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.592230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.592324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.592535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.592663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.592910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.593186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.593491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.608848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.609126 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.609409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.609675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.609908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.610195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.610461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.610733 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.616537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.617718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.618131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.618394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.619281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.619555 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.621192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.621496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.621783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.622066 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.622347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.622476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.622687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.622983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.623260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.623548 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.633797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.634071 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.634346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.634623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.634888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.635115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.635242 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.635396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.635523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.635673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.635949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.636227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.636470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.636746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.651010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.652451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.653961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.655499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.656953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.658511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.659553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.661057 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.661183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.661336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.661658 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.662595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.662881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.663155 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.668117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.669712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.669839 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.671374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.672737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.673017 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.673314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.673584 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.674340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.674625 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.674906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.675196 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.681613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.681891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.682161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.683294 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.683582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.683857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.689007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86829) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.689277 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.689575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.689844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.690112 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.690384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.690648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.690793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86830) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 02:30:53.690941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.691062 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.691268 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.691395 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.691515 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.691607 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.691813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.691954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.692092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.692173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.692321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.692448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.692530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86829) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.692620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.693000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.693263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.693564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.693828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.694110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.694369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86830) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 02:30:53.725935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642633589c0 pid: 86829 (default app) Jul 26 02:30:53.727928 dv-cinder-850840-2-smb devstack@keystone.service[86830]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642633589c0 pid: 86830 (default app) Jul 26 02:30:53.729236 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7223e-7492-48cb-a5d8-ca0308e242b9 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:30:53.729549 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7223e-7492-48cb-a5d8-ca0308e242b9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:30:53.729823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7223e-7492-48cb-a5d8-ca0308e242b9 None None] PATH_INFO: `/v3` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:30:53.734576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Tue Jul 26 02:30:53 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:01.330258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df789bf-23a9-4685-a928-526636b3309e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:01.330868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df789bf-23a9-4685-a928-526636b3309e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:01.330868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df789bf-23a9-4685-a928-526636b3309e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:01.335327 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:01.342387 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59649fec-1f31-4958-80b4-ac59282c7dc5 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:01.343114 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59649fec-1f31-4958-80b4-ac59282c7dc5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:01.343419 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59649fec-1f31-4958-80b4-ac59282c7dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:01.426450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: INFO dbcounter [None req-59649fec-1f31-4958-80b4-ac59282c7dc5 None None] Registered counter for database keystone Jul 26 02:31:01.451067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG oslo_db.sqlalchemy.engines [None req-59649fec-1f31-4958-80b4-ac59282c7dc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 02:31:01.462710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writer thread running {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 02:31:01.668000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG passlib.handlers.bcrypt [None req-59649fec-1f31-4958-80b4-ac59282c7dc5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86829) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 02:31:01.668414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG passlib.handlers.bcrypt [None req-59649fec-1f31-4958-80b4-ac59282c7dc5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86829) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 02:31:01.723687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-59649fec-1f31-4958-80b4-ac59282c7dc5 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:01.725326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-59649fec-1f31-4958-80b4-ac59282c7dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:01.854603 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 26 02:31:02.002836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df789bf-23a9-4685-a928-526636b3309e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:02.077757 dv-cinder-850840-2-smb devstack@keystone.service[86830]: INFO dbcounter [None req-0df789bf-23a9-4685-a928-526636b3309e None None] Registered counter for database keystone Jul 26 02:31:02.099161 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG oslo_db.sqlalchemy.engines [None req-0df789bf-23a9-4685-a928-526636b3309e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 02:31:02.111484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writer thread running {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 02:31:02.232495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df789bf-23a9-4685-a928-526636b3309e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:02.238089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2972d0-dbc4-475c-a135-42c88c5e1a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:02.238718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2972d0-dbc4-475c-a135-42c88c5e1a7b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:02.238995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2972d0-dbc4-475c-a135-42c88c5e1a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:02.239263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2972d0-dbc4-475c-a135-42c88c5e1a7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:02.248310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2972d0-dbc4-475c-a135-42c88c5e1a7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:02.299416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7b2972d0-dbc4-475c-a135-42c88c5e1a7b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 02:31:02.299687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2972d0-dbc4-475c-a135-42c88c5e1a7b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:02.310104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Tue Jul 26 02:31:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:31:02.317329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59649fec-1f31-4958-80b4-ac59282c7dc5 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:02.342161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59649fec-1f31-4958-80b4-ac59282c7dc5 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:02.348860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3ed86-3bee-4590-b2b5-6490e5afe34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:02.350007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ed86-3bee-4590-b2b5-6490e5afe34f admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:02.350290 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ed86-3bee-4590-b2b5-6490e5afe34f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:02.350578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3ed86-3bee-4590-b2b5-6490e5afe34f admin admin] PATH_INFO: `/v3/projects/dcd69a7399884288be80cb2c7e9c442d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:02.352126 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3ed86-3bee-4590-b2b5-6490e5afe34f admin admin] RBAC: Authorizing `identity:get_project(project_id=dcd69a7399884288be80cb2c7e9c442d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:02.403014 dv-cinder-850840-2-smb devstack@keystone.service[86829]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e0b3ed86-3bee-4590-b2b5-6490e5afe34f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 02:31:02.403362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3ed86-3bee-4590-b2b5-6490e5afe34f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:02.408139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Tue Jul 26 02:31:02 2022] GET /identity/v3/projects/dcd69a7399884288be80cb2c7e9c442d => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:04.405115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc2516-c7f8-4026-99c9-1f96099f3561 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:04.405773 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc2516-c7f8-4026-99c9-1f96099f3561 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:04.405773 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc2516-c7f8-4026-99c9-1f96099f3561 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:04.409922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:04.416644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cbd20-6036-44f5-a1c7-037aabf306bb None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:04.417314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cbd20-6036-44f5-a1c7-037aabf306bb None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:04.417606 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cbd20-6036-44f5-a1c7-037aabf306bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:04.446288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-263cbd20-6036-44f5-a1c7-037aabf306bb None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:04.447829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-263cbd20-6036-44f5-a1c7-037aabf306bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:04.456813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 02:31:04.479239 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc2516-c7f8-4026-99c9-1f96099f3561 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:04.501749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc2516-c7f8-4026-99c9-1f96099f3561 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:04.507870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cba0c6-c02e-4eb1-b2ad-de37be4a6c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:04.508487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba0c6-c02e-4eb1-b2ad-de37be4a6c45 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:04.508763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba0c6-c02e-4eb1-b2ad-de37be4a6c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:04.509038 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba0c6-c02e-4eb1-b2ad-de37be4a6c45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:04.517314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cba0c6-c02e-4eb1-b2ad-de37be4a6c45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:04.519105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cba0c6-c02e-4eb1-b2ad-de37be4a6c45 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:04.527996 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Tue Jul 26 02:31:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 02:31:04.535337 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cbd20-6036-44f5-a1c7-037aabf306bb None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:04.550039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cbd20-6036-44f5-a1c7-037aabf306bb None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:04.558804 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316326b-981f-40d1-af5a-dcfec888acaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:04.559698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316326b-981f-40d1-af5a-dcfec888acaf admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:04.560010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316326b-981f-40d1-af5a-dcfec888acaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:04.560330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316326b-981f-40d1-af5a-dcfec888acaf admin admin] PATH_INFO: `/v3/users/5c2fa740cfd643e6a29f9d9686eada23` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:04.562443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316326b-981f-40d1-af5a-dcfec888acaf admin admin] RBAC: Authorizing `identity:get_user(user_id=5c2fa740cfd643e6a29f9d9686eada23)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:04.564291 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316326b-981f-40d1-af5a-dcfec888acaf admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:04.565879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Tue Jul 26 02:31:04 2022] GET /identity/v3/users/5c2fa740cfd643e6a29f9d9686eada23 => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:06.637124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee01b1-b0b9-4992-8b3e-f00a71e73472 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:06.637633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee01b1-b0b9-4992-8b3e-f00a71e73472 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:06.637718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee01b1-b0b9-4992-8b3e-f00a71e73472 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:06.639065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:06.641969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eb9a2-582b-4635-b193-31625bd66835 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:06.642406 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eb9a2-582b-4635-b193-31625bd66835 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:06.642604 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eb9a2-582b-4635-b193-31625bd66835 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:06.644077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:06.644243 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14215be4-17e5-4913-9e6d-a8005eaf70d3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:06.644740 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14215be4-17e5-4913-9e6d-a8005eaf70d3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:06.645018 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14215be4-17e5-4913-9e6d-a8005eaf70d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:06.648987 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7077-933c-4eca-9941-5a975f594d25 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:06.649341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7077-933c-4eca-9941-5a975f594d25 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:06.649691 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b7077-933c-4eca-9941-5a975f594d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:06.673557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6d2b7077-933c-4eca-9941-5a975f594d25 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:06.674745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6d2b7077-933c-4eca-9941-5a975f594d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:06.694387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG passlib.handlers.bcrypt [None req-14215be4-17e5-4913-9e6d-a8005eaf70d3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86830) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 02:31:06.694800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG passlib.handlers.bcrypt [None req-14215be4-17e5-4913-9e6d-a8005eaf70d3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86830) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 02:31:06.739977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-14215be4-17e5-4913-9e6d-a8005eaf70d3 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:06.741626 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-14215be4-17e5-4913-9e6d-a8005eaf70d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:06.758275 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 7/12] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:06.779655 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b7077-933c-4eca-9941-5a975f594d25 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:06.804965 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:06.843407 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 6/13] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:06.866096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14215be4-17e5-4913-9e6d-a8005eaf70d3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:06.884514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b7077-933c-4eca-9941-5a975f594d25 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:06.919749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7d5e2-9aa3-4663-bb31-4ec20cdf61d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:06.920484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d5e2-9aa3-4663-bb31-4ec20cdf61d8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:06.920775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d5e2-9aa3-4663-bb31-4ec20cdf61d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:06.921209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d5e2-9aa3-4663-bb31-4ec20cdf61d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:06.966034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14215be4-17e5-4913-9e6d-a8005eaf70d3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:06.968360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:06.993752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7d5e2-9aa3-4663-bb31-4ec20cdf61d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:06.995260 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7d5e2-9aa3-4663-bb31-4ec20cdf61d8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:07.003738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35c3c1-df83-4844-8252-b2447bd991e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:07.004886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35c3c1-df83-4844-8252-b2447bd991e0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:07.005170 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35c3c1-df83-4844-8252-b2447bd991e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:07.005475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35c3c1-df83-4844-8252-b2447bd991e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:07.017411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35c3c1-df83-4844-8252-b2447bd991e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:07.018199 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ee35c3c1-df83-4844-8252-b2447bd991e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:07.026175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:07.027058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:07.027892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:07.027892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:07.027892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:07.027892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:07.027892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:07.027892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:07.027892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:07.027892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:07.027892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:07.027892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:07.027892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:07.027892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:07.027892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:31:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:31:07.033478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35c3c1-df83-4844-8252-b2447bd991e0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:07.092365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 8/15] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 02:31:07.098377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7d5e2-9aa3-4663-bb31-4ec20cdf61d8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:07.131657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35c3c1-df83-4844-8252-b2447bd991e0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:07.163811 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c1bb-a3e1-4a8e-8e8f-75b4b4837e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:07.164372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c1bb-a3e1-4a8e-8e8f-75b4b4837e85 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:07.164652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c1bb-a3e1-4a8e-8e8f-75b4b4837e85 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:07.164921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c1bb-a3e1-4a8e-8e8f-75b4b4837e85 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:07.165672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59c1bb-a3e1-4a8e-8e8f-75b4b4837e85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:07.165973 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59c1bb-a3e1-4a8e-8e8f-75b4b4837e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:07.167426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59c1bb-a3e1-4a8e-8e8f-75b4b4837e85 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:07.178988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 8/16] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:07.184677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c1bb-a3e1-4a8e-8e8f-75b4b4837e85 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:07.198554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7d5e2-9aa3-4663-bb31-4ec20cdf61d8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:07.213813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:07.220761 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:07.233759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3a75c-d850-4126-8994-010142928d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:07.234408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3a75c-d850-4126-8994-010142928d91 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:07.234698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3a75c-d850-4126-8994-010142928d91 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:07.234970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3a75c-d850-4126-8994-010142928d91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:07.245435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3a75c-d850-4126-8994-010142928d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:07.246933 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3a75c-d850-4126-8994-010142928d91 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-c2f3a75c-d850-4126-8994-010142928d91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:31:07.265735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:07.266558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:07.267347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:31:07.267347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:31:07.267347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:31:07.267347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:07.267347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:31:07.272863 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3a75c-d850-4126-8994-010142928d91 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:07.290225 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c1bb-a3e1-4a8e-8e8f-75b4b4837e85 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:07.325528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ce42c-bab7-4767-9729-6b4b87afddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:07.326197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ce42c-bab7-4767-9729-6b4b87afddde None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:07.326476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ce42c-bab7-4767-9729-6b4b87afddde None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:07.326746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ce42c-bab7-4767-9729-6b4b87afddde None admin] PATH_INFO: `/v3/users/5c2fa740cfd643e6a29f9d9686eada23` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:07.328395 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ce42c-bab7-4767-9729-6b4b87afddde None admin] RBAC: Authorizing `identity:get_user(user_id=5c2fa740cfd643e6a29f9d9686eada23)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:07.329922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0ce42c-bab7-4767-9729-6b4b87afddde None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:07.331609 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:07 2022] GET /identity/v3/users/5c2fa740cfd643e6a29f9d9686eada23 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:07.337499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ce42c-bab7-4767-9729-6b4b87afddde None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:07.436854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:07.444607 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ce42c-bab7-4767-9729-6b4b87afddde None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:07.477205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7270c-cb24-4c29-91a4-076317c243ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:07.477875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7270c-cb24-4c29-91a4-076317c243ec None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:07.478157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7270c-cb24-4c29-91a4-076317c243ec None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:07.478430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce7270c-cb24-4c29-91a4-076317c243ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:07.479592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7270c-cb24-4c29-91a4-076317c243ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:07.481496 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce7270c-cb24-4c29-91a4-076317c243ec None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:07.482649 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3a75c-d850-4126-8994-010142928d91 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:07.483085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:07.488908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7270c-cb24-4c29-91a4-076317c243ec None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:07.517356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28d8ff-e38d-48cf-bf11-d51016923c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:07.518000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28d8ff-e38d-48cf-bf11-d51016923c25 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:07.518282 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28d8ff-e38d-48cf-bf11-d51016923c25 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:07.518565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28d8ff-e38d-48cf-bf11-d51016923c25 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:07.519271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28d8ff-e38d-48cf-bf11-d51016923c25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:07.519553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28d8ff-e38d-48cf-bf11-d51016923c25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:07.520968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28d8ff-e38d-48cf-bf11-d51016923c25 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:07.538022 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:07.590635 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce7270c-cb24-4c29-91a4-076317c243ec None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:07.629835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab63b5-e3b2-495a-9e9f-68518267d5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:07.630760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab63b5-e3b2-495a-9e9f-68518267d5e7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:07.631197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab63b5-e3b2-495a-9e9f-68518267d5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:07.631640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab63b5-e3b2-495a-9e9f-68518267d5e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:07.632608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab63b5-e3b2-495a-9e9f-68518267d5e7 None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.domain.id=default, user.id=5c2fa740cfd643e6a29f9d9686eada23) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:07.632917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab63b5-e3b2-495a-9e9f-68518267d5e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:07.634457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab63b5-e3b2-495a-9e9f-68518267d5e7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:07.643917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 11/21] 10.222.0.39 () {56 vars in 1322 bytes} [Tue Jul 26 02:31:07 2022] GET /identity/v3/role_assignments?user.id=5c2fa740cfd643e6a29f9d9686eada23&scope.domain.id=default&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:09.884416 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d404b8d-7149-4b3d-b7b2-418ec268b4d0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:09.884907 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d404b8d-7149-4b3d-b7b2-418ec268b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:09.884907 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d404b8d-7149-4b3d-b7b2-418ec268b4d0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:09.886280 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:09.903314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154a3c2-309d-4183-a1fc-ecf3bd16c165 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:09.903925 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154a3c2-309d-4183-a1fc-ecf3bd16c165 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:09.904240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154a3c2-309d-4183-a1fc-ecf3bd16c165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:09.927509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b154a3c2-309d-4183-a1fc-ecf3bd16c165 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:09.929033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6307-4b44-4730-8b36-3c0df3af189a None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:09.929333 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6307-4b44-4730-8b36-3c0df3af189a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:09.929612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6307-4b44-4730-8b36-3c0df3af189a None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:09.931328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 12/23] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:31:09.932776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b154a3c2-309d-4183-a1fc-ecf3bd16c165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:09.936517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc58d1-01ca-4a2d-9334-271516c38bb8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:09.937042 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc58d1-01ca-4a2d-9334-271516c38bb8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:09.937549 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc58d1-01ca-4a2d-9334-271516c38bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:09.961426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-30bc58d1-01ca-4a2d-9334-271516c38bb8 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:09.963696 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-30bc58d1-01ca-4a2d-9334-271516c38bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:09.971369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:10.044728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:10.074900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 12/24] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:10.076208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182229b-a73c-443a-a7ea-f78bde750ea1 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:10.076497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182229b-a73c-443a-a7ea-f78bde750ea1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:10.076775 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182229b-a73c-443a-a7ea-f78bde750ea1 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:10.078328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 13/25] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:10.087191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbdd23-42a7-426a-a0a8-c5a1a8398692 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:10.089188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbdd23-42a7-426a-a0a8-c5a1a8398692 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:10.089497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcbdd23-42a7-426a-a0a8-c5a1a8398692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:10.122819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7dcbdd23-42a7-426a-a0a8-c5a1a8398692 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:10.123443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 13/26] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:10.124053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7dcbdd23-42a7-426a-a0a8-c5a1a8398692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:10.124174 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc58d1-01ca-4a2d-9334-271516c38bb8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:10.230460 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 14/27] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:10.231281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbdd23-42a7-426a-a0a8-c5a1a8398692 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:10.314593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc58d1-01ca-4a2d-9334-271516c38bb8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:10.378563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792038c1-8550-4eb1-a974-0cedbdb494b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:10.379216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792038c1-8550-4eb1-a974-0cedbdb494b9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:10.379493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792038c1-8550-4eb1-a974-0cedbdb494b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:10.379762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792038c1-8550-4eb1-a974-0cedbdb494b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:10.386224 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:10.400500 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792038c1-8550-4eb1-a974-0cedbdb494b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:10.402029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792038c1-8550-4eb1-a974-0cedbdb494b9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:10.415535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcbdd23-42a7-426a-a0a8-c5a1a8398692 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-792038c1-8550-4eb1-a974-0cedbdb494b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:31:10.433782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:10.434835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:10.435834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:31:10.435834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:31:10.435834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:31:10.435834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:10.435834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 14/28] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:10.436352 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792038c1-8550-4eb1-a974-0cedbdb494b9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:10.461385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ca770-0439-4029-b707-7bc2c9d7db26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:10.462097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ca770-0439-4029-b707-7bc2c9d7db26 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:10.462377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ca770-0439-4029-b707-7bc2c9d7db26 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:10.462651 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ca770-0439-4029-b707-7bc2c9d7db26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:10.481715 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:10.486253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ca770-0439-4029-b707-7bc2c9d7db26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0b0ca770-0439-4029-b707-7bc2c9d7db26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:10.492390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:10.493228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:10.494007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:10.494007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:10.494007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:10.494007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:10.494007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:10.494007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:10.494007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:10.494007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:10.494007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:10.494007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:10.494007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:10.494007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:10.496455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 15/29] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:31:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:10.497625 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ca770-0439-4029-b707-7bc2c9d7db26 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:10.562208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792038c1-8550-4eb1-a974-0cedbdb494b9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:10.600043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b391166-3837-4797-b47d-d75771e9e4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:10.600694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b391166-3837-4797-b47d-d75771e9e4c1 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:10.600977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b391166-3837-4797-b47d-d75771e9e4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:10.601249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b391166-3837-4797-b47d-d75771e9e4c1 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:10.602047 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b391166-3837-4797-b47d-d75771e9e4c1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:10.603510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b391166-3837-4797-b47d-d75771e9e4c1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:10.739334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ca770-0439-4029-b707-7bc2c9d7db26 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:10.748242 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 15/30] 10.222.0.39 () {60 vars in 1131 bytes} [Tue Jul 26 02:31:10 2022] POST /identity/v3/roles => generated 219 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:31:10.755164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b53940-35a6-4b15-91cb-60f95273c802 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:10.755681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b53940-35a6-4b15-91cb-60f95273c802 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:10.756095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b53940-35a6-4b15-91cb-60f95273c802 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:10.765829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 16/31] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:10.767122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b53940-35a6-4b15-91cb-60f95273c802 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:10.779446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0b3b2-6a98-44da-899a-043e7deeec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:10.781026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b3b2-6a98-44da-899a-043e7deeec96 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:10.781542 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b3b2-6a98-44da-899a-043e7deeec96 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:10.781981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b3b2-6a98-44da-899a-043e7deeec96 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:10.782923 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0b3b2-6a98-44da-899a-043e7deeec96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:10.783386 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0b3b2-6a98-44da-899a-043e7deeec96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:10.785096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0b3b2-6a98-44da-899a-043e7deeec96 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:10.813195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 16/32] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:10.819809 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a240f5-2541-43c4-a778-511820d51f03 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:10.820268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a240f5-2541-43c4-a778-511820d51f03 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:10.820688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a240f5-2541-43c4-a778-511820d51f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:10.837309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:10.846098 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e5a240f5-2541-43c4-a778-511820d51f03 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:10.847798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e5a240f5-2541-43c4-a778-511820d51f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:10.931394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 17/33] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:10.932939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a240f5-2541-43c4-a778-511820d51f03 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:10.993146 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:11.029700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b53940-35a6-4b15-91cb-60f95273c802 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:11.067781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a240f5-2541-43c4-a778-511820d51f03 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:11.080465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf08c3-ccf5-4518-93ee-b4b95e4439bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:11.081392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf08c3-ccf5-4518-93ee-b4b95e4439bd None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:11.081843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf08c3-ccf5-4518-93ee-b4b95e4439bd None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:11.082363 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf08c3-ccf5-4518-93ee-b4b95e4439bd None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:11.083282 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf08c3-ccf5-4518-93ee-b4b95e4439bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:11.085037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf08c3-ccf5-4518-93ee-b4b95e4439bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:11.086876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf08c3-ccf5-4518-93ee-b4b95e4439bd None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:11.103227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 17/34] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:11.104489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf08c3-ccf5-4518-93ee-b4b95e4439bd None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:11.110907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688ab26-2acd-4846-8450-3d1cb918854a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:11.111547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ab26-2acd-4846-8450-3d1cb918854a None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:11.111830 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ab26-2acd-4846-8450-3d1cb918854a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:11.112103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688ab26-2acd-4846-8450-3d1cb918854a None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:11.112799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688ab26-2acd-4846-8450-3d1cb918854a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:11.114285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688ab26-2acd-4846-8450-3d1cb918854a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:11.127199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:11.229174 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf08c3-ccf5-4518-93ee-b4b95e4439bd None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:11.268756 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cd775-67c2-4a7d-a2a0-5ee17dbf15f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:11.269489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cd775-67c2-4a7d-a2a0-5ee17dbf15f1 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:11.269862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cd775-67c2-4a7d-a2a0-5ee17dbf15f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:11.270146 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cd775-67c2-4a7d-a2a0-5ee17dbf15f1 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:11.271014 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cd775-67c2-4a7d-a2a0-5ee17dbf15f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:11.272484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cd775-67c2-4a7d-a2a0-5ee17dbf15f1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:11.283091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:11.289393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 18/35] 10.222.0.39 () {60 vars in 1131 bytes} [Tue Jul 26 02:31:11 2022] POST /identity/v3/roles => generated 225 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:31:11.290759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cd775-67c2-4a7d-a2a0-5ee17dbf15f1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:11.295964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 18/36] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:31:10 2022] POST /identity/v3/projects => generated 301 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:31:11.309348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2563b-9c34-403c-b1d5-51fd5eee98fd None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:11.309348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2563b-9c34-403c-b1d5-51fd5eee98fd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:11.309348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2563b-9c34-403c-b1d5-51fd5eee98fd None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:11.314602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 19/37] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:11 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:11.320310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde322d-d512-432d-b494-e49837f4c941 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:11.320618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde322d-d512-432d-b494-e49837f4c941 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:11.321083 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fde322d-d512-432d-b494-e49837f4c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:11.366673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8fde322d-d512-432d-b494-e49837f4c941 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:11.368288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8fde322d-d512-432d-b494-e49837f4c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:11.431972 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cd775-67c2-4a7d-a2a0-5ee17dbf15f1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:11.470966 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a9702-f937-415c-bf60-bdeb197077bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:11.471702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9702-f937-415c-bf60-bdeb197077bc None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:11.471987 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9702-f937-415c-bf60-bdeb197077bc None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:11.472263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9702-f937-415c-bf60-bdeb197077bc None admin] PATH_INFO: `/v3/users/5c2fa740cfd643e6a29f9d9686eada23` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:11.473557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a9702-f937-415c-bf60-bdeb197077bc None admin] RBAC: Authorizing `identity:get_user(user_id=5c2fa740cfd643e6a29f9d9686eada23)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:11.475061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a9702-f937-415c-bf60-bdeb197077bc None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:11.476894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 19/38] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:11 2022] GET /identity/v3/users/5c2fa740cfd643e6a29f9d9686eada23 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:11.477987 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60e08-95b0-4920-9c4b-80bb799456cd None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:11.478271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60e08-95b0-4920-9c4b-80bb799456cd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:11.478545 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc60e08-95b0-4920-9c4b-80bb799456cd None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:11.479799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 20/39] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:11.485823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48c9a7-a2bd-40d7-bec7-a864429a002e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:11.486120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48c9a7-a2bd-40d7-bec7-a864429a002e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:11.486381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48c9a7-a2bd-40d7-bec7-a864429a002e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:11.503240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 20/40] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:11.503927 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde322d-d512-432d-b494-e49837f4c941 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:11.505963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6c48c9a7-a2bd-40d7-bec7-a864429a002e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:11.507593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6c48c9a7-a2bd-40d7-bec7-a864429a002e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:11.577792 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:11.585890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 21/41] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:11.586706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48c9a7-a2bd-40d7-bec7-a864429a002e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:11.628516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fde322d-d512-432d-b494-e49837f4c941 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:11.647597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:11.665486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae299a-d964-40d7-a372-4a6bdd9ba2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:11.666140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae299a-d964-40d7-a372-4a6bdd9ba2f1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:11.666427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae299a-d964-40d7-a372-4a6bdd9ba2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:11.666703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae299a-d964-40d7-a372-4a6bdd9ba2f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:11.667861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae299a-d964-40d7-a372-4a6bdd9ba2f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:11.669486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae299a-d964-40d7-a372-4a6bdd9ba2f1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:11.671255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 21/42] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:11.672052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae299a-d964-40d7-a372-4a6bdd9ba2f1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:11.693346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48c9a7-a2bd-40d7-bec7-a864429a002e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:11.727653 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ca4fd-80b5-46eb-a4bf-7c3fec1642e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:11.728284 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca4fd-80b5-46eb-a4bf-7c3fec1642e5 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:11.728568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca4fd-80b5-46eb-a4bf-7c3fec1642e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:11.728845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ca4fd-80b5-46eb-a4bf-7c3fec1642e5 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:11.729601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ca4fd-80b5-46eb-a4bf-7c3fec1642e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:11.731390 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ca4fd-80b5-46eb-a4bf-7c3fec1642e5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:11.746372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 22/43] 10.222.0.39 () {60 vars in 1131 bytes} [Tue Jul 26 02:31:11 2022] POST /identity/v3/roles => generated 223 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:31:11.746948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ca4fd-80b5-46eb-a4bf-7c3fec1642e5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:11.778987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae299a-d964-40d7-a372-4a6bdd9ba2f1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:11.816485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b9d18-0086-42fc-bec1-90ded4db409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:11.817141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b9d18-0086-42fc-bec1-90ded4db409f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:11.817457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b9d18-0086-42fc-bec1-90ded4db409f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:11.817733 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b9d18-0086-42fc-bec1-90ded4db409f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:11.818983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b9d18-0086-42fc-bec1-90ded4db409f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:11.820465 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b9d18-0086-42fc-bec1-90ded4db409f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:11.822188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 22/44] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:11.828134 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b9d18-0086-42fc-bec1-90ded4db409f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:11.836750 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:11.890946 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ca4fd-80b5-46eb-a4bf-7c3fec1642e5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:11.891879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:11.932594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca3234-fd5b-4f84-b33f-17aa4b83ead5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:11.933474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca3234-fd5b-4f84-b33f-17aa4b83ead5 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:11.933767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca3234-fd5b-4f84-b33f-17aa4b83ead5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:11.934353 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca3234-fd5b-4f84-b33f-17aa4b83ead5 None admin] PATH_INFO: `/v3/domains/default/users/5c2fa740cfd643e6a29f9d9686eada23/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:11.936629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca3234-fd5b-4f84-b33f-17aa4b83ead5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5c2fa740cfd643e6a29f9d9686eada23, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:11.938136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca3234-fd5b-4f84-b33f-17aa4b83ead5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:11.940687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b9d18-0086-42fc-bec1-90ded4db409f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:11.952856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 23/45] 10.222.0.39 () {58 vars in 1361 bytes} [Tue Jul 26 02:31:11 2022] PUT /identity/v3/domains/default/users/5c2fa740cfd643e6a29f9d9686eada23/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:31:11.980740 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4c283-32cc-4291-9567-03db60a74da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:11.981427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4c283-32cc-4291-9567-03db60a74da2 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:11.981718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4c283-32cc-4291-9567-03db60a74da2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:11.982005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4c283-32cc-4291-9567-03db60a74da2 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:11.982713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4c283-32cc-4291-9567-03db60a74da2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:11.984280 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4c283-32cc-4291-9567-03db60a74da2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:12.015607 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:31:11 2022] POST /identity/v3/projects => generated 312 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:31:13.935969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294ba3d-177c-45d2-84c2-0486741d327b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:13.936503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294ba3d-177c-45d2-84c2-0486741d327b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:13.936503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294ba3d-177c-45d2-84c2-0486741d327b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:13.937801 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 24/47] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:13.943257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804643e-97a2-45c4-84ff-6d1ecedeb6bb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:13.943665 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804643e-97a2-45c4-84ff-6d1ecedeb6bb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:13.943819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804643e-97a2-45c4-84ff-6d1ecedeb6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:13.963849 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1804643e-97a2-45c4-84ff-6d1ecedeb6bb None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:13.965042 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1804643e-97a2-45c4-84ff-6d1ecedeb6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:13.996540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debcf9c-4dcf-4c43-9872-28145f36f933 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:13.996828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debcf9c-4dcf-4c43-9872-28145f36f933 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:13.997123 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debcf9c-4dcf-4c43-9872-28145f36f933 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:13.998546 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 25/48] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:14.003375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dcf04-f319-44d8-b46b-e99435ce2e29 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:14.003626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dcf04-f319-44d8-b46b-e99435ce2e29 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:14.003931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dcf04-f319-44d8-b46b-e99435ce2e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:14.022215 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-201dcf04-f319-44d8-b46b-e99435ce2e29 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:14.023407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-201dcf04-f319-44d8-b46b-e99435ce2e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:14.040082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 24/49] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:14.062295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804643e-97a2-45c4-84ff-6d1ecedeb6bb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:14.091443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 26/50] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:14.097366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:14.114081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dcf04-f319-44d8-b46b-e99435ce2e29 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:14.158694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:14.164904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804643e-97a2-45c4-84ff-6d1ecedeb6bb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:14.200418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eddc8-b9c8-4db3-8af3-779ec9e0caa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:14.201002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eddc8-b9c8-4db3-8af3-779ec9e0caa2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:14.201318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eddc8-b9c8-4db3-8af3-779ec9e0caa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:14.201587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eddc8-b9c8-4db3-8af3-779ec9e0caa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:14.211213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dcf04-f319-44d8-b46b-e99435ce2e29 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:14.211509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401eddc8-b9c8-4db3-8af3-779ec9e0caa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-401eddc8-b9c8-4db3-8af3-779ec9e0caa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:14.216535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:14.217535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:14.218297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:14.218297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:14.218297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:14.218297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:14.218297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:14.218297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:14.218297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:14.218297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:14.218297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:14.218297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:14.218297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:14.218297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:14.218297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 25/51] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:14.223657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eddc8-b9c8-4db3-8af3-779ec9e0caa2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:14.246841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ee63d-7703-4a5f-bb86-545e8023828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:14.247477 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ee63d-7703-4a5f-bb86-545e8023828d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:14.247756 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ee63d-7703-4a5f-bb86-545e8023828d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:14.248022 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ee63d-7703-4a5f-bb86-545e8023828d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:14.249250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ee63d-7703-4a5f-bb86-545e8023828d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:14.250738 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ee63d-7703-4a5f-bb86-545e8023828d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:14.252458 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 27/52] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:14.257945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ee63d-7703-4a5f-bb86-545e8023828d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:14.319079 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:14.325310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eddc8-b9c8-4db3-8af3-779ec9e0caa2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:14.357576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ee63d-7703-4a5f-bb86-545e8023828d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:14.361062 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a41302-bbb5-49e1-b937-26ee14b39143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:14.361717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a41302-bbb5-49e1-b937-26ee14b39143 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:14.362003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a41302-bbb5-49e1-b937-26ee14b39143 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:14.362278 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a41302-bbb5-49e1-b937-26ee14b39143 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:14.363001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a41302-bbb5-49e1-b937-26ee14b39143 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:14.363313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a41302-bbb5-49e1-b937-26ee14b39143 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:14.364708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a41302-bbb5-49e1-b937-26ee14b39143 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:14.372525 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:14.372883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:14.378758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a41302-bbb5-49e1-b937-26ee14b39143 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:14.395019 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aa194-6343-4080-b5c8-737a47d26c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:14.395656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aa194-6343-4080-b5c8-737a47d26c63 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:14.395938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aa194-6343-4080-b5c8-737a47d26c63 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:14.396220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aa194-6343-4080-b5c8-737a47d26c63 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:14.396906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9aa194-6343-4080-b5c8-737a47d26c63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:14.398443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9aa194-6343-4080-b5c8-737a47d26c63 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:14.426460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 28/54] 10.222.0.39 () {60 vars in 1140 bytes} [Tue Jul 26 02:31:14 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:31:14.481928 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a41302-bbb5-49e1-b937-26ee14b39143 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:14.519712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f127f-98de-4168-85c7-6273244e5143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:14.520373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f127f-98de-4168-85c7-6273244e5143 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:14.520658 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f127f-98de-4168-85c7-6273244e5143 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:14.520935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f127f-98de-4168-85c7-6273244e5143 None admin] PATH_INFO: `/v3/users/5c2fa740cfd643e6a29f9d9686eada23` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:14.522217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f127f-98de-4168-85c7-6273244e5143 None admin] RBAC: Authorizing `identity:get_user(user_id=5c2fa740cfd643e6a29f9d9686eada23)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:14.523701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f127f-98de-4168-85c7-6273244e5143 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:14.525415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:14 2022] GET /identity/v3/users/5c2fa740cfd643e6a29f9d9686eada23 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:14.531274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aa194-6343-4080-b5c8-737a47d26c63 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:14.638355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aa194-6343-4080-b5c8-737a47d26c63 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:14.674453 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a1610-3cc3-49f0-800f-a83b91951ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:14.675107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a1610-3cc3-49f0-800f-a83b91951ba0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:14.675398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a1610-3cc3-49f0-800f-a83b91951ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:14.675683 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a1610-3cc3-49f0-800f-a83b91951ba0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:14.676900 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a1610-3cc3-49f0-800f-a83b91951ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:14.678416 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a1610-3cc3-49f0-800f-a83b91951ba0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:14.680252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 29/56] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:14.686080 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f127f-98de-4168-85c7-6273244e5143 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:14.714976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:14.788705 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f127f-98de-4168-85c7-6273244e5143 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:14.823119 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313f477-67e3-4173-a835-3768ed46d27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:14.823737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313f477-67e3-4173-a835-3768ed46d27e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:14.824025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313f477-67e3-4173-a835-3768ed46d27e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:14.824301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313f477-67e3-4173-a835-3768ed46d27e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:14.825096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313f477-67e3-4173-a835-3768ed46d27e None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.domain.id=default, user.id=5c2fa740cfd643e6a29f9d9686eada23) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:14.825443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313f477-67e3-4173-a835-3768ed46d27e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:14.826930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313f477-67e3-4173-a835-3768ed46d27e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:14.833085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1322 bytes} [Tue Jul 26 02:31:14 2022] GET /identity/v3/role_assignments?user.id=5c2fa740cfd643e6a29f9d9686eada23&scope.domain.id=default&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:16.416566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503f54-5faf-41c1-a779-1ca1ab87b4ab None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:16.417435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503f54-5faf-41c1-a779-1ca1ab87b4ab None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:16.417435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503f54-5faf-41c1-a779-1ca1ab87b4ab None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:16.419740 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 30/58] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:16.426156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215bba-89cc-4c30-97f6-4e6b54f16a54 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:16.426801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215bba-89cc-4c30-97f6-4e6b54f16a54 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:16.427077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03215bba-89cc-4c30-97f6-4e6b54f16a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:16.449334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-03215bba-89cc-4c30-97f6-4e6b54f16a54 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:16.450570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-03215bba-89cc-4c30-97f6-4e6b54f16a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:16.527957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 29/59] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:16.552580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24503f54-5faf-41c1-a779-1ca1ab87b4ab None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:16.589906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:16.658521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24503f54-5faf-41c1-a779-1ca1ab87b4ab None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:16.693526 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0322b56-15f2-44f2-8237-25b0a59c7737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:16.694135 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0322b56-15f2-44f2-8237-25b0a59c7737 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:16.694424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0322b56-15f2-44f2-8237-25b0a59c7737 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:16.694692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0322b56-15f2-44f2-8237-25b0a59c7737 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:16.695970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0322b56-15f2-44f2-8237-25b0a59c7737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:16.697582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0322b56-15f2-44f2-8237-25b0a59c7737 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:16.699191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 31/60] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:16.707461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03215bba-89cc-4c30-97f6-4e6b54f16a54 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:16.729161 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:16.812893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03215bba-89cc-4c30-97f6-4e6b54f16a54 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:16.847691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f525a-be3e-4383-905d-88ff737941a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:16.848308 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f525a-be3e-4383-905d-88ff737941a6 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:16.848594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f525a-be3e-4383-905d-88ff737941a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:16.848872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f525a-be3e-4383-905d-88ff737941a6 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:16.849615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f525a-be3e-4383-905d-88ff737941a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:16.851053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f525a-be3e-4383-905d-88ff737941a6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:16.879744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 30/61] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:31:16 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:31:20.013780 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6aada-8f3d-4f26-b561-88ffd09d6fa9 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.014846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6aada-8f3d-4f26-b561-88ffd09d6fa9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.015343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6aada-8f3d-4f26-b561-88ffd09d6fa9 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.017184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 32/62] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:20.022200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d89714-406a-46ed-b131-2ea3e5ea83ca None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.023003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d89714-406a-46ed-b131-2ea3e5ea83ca None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.023491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d89714-406a-46ed-b131-2ea3e5ea83ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.050522 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e6d89714-406a-46ed-b131-2ea3e5ea83ca None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:20.051828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e6d89714-406a-46ed-b131-2ea3e5ea83ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:20.144898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 31/63] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:20.185720 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d89714-406a-46ed-b131-2ea3e5ea83ca None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:20.186577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d7d05-9dd4-4638-9722-899bb458c169 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.187096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d7d05-9dd4-4638-9722-899bb458c169 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.187596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d7d05-9dd4-4638-9722-899bb458c169 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.190418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 33/64] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:20.194968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:20.196428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8da96-686b-4654-ae8e-66ff353e4f5f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.196941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8da96-686b-4654-ae8e-66ff353e4f5f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.197435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8da96-686b-4654-ae8e-66ff353e4f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.229952 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-79e8da96-686b-4654-ae8e-66ff353e4f5f None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:20.231162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-79e8da96-686b-4654-ae8e-66ff353e4f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:20.351893 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 34/65] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:20.353384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba4c17-7aec-46b3-96ca-ea66ac6526c0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.353674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba4c17-7aec-46b3-96ca-ea66ac6526c0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.354335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba4c17-7aec-46b3-96ca-ea66ac6526c0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.355968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 35/66] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:20.364747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d89714-406a-46ed-b131-2ea3e5ea83ca None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:20.370582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed1ab5-730f-4c69-a667-881c50c04c55 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.371032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed1ab5-730f-4c69-a667-881c50c04c55 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.371444 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed1ab5-730f-4c69-a667-881c50c04c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.396981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7aed1ab5-730f-4c69-a667-881c50c04c55 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:20.398618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7aed1ab5-730f-4c69-a667-881c50c04c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:20.410753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee983eb-6ece-433e-86a7-e0979b849bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:20.411522 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee983eb-6ece-433e-86a7-e0979b849bc4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.411705 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee983eb-6ece-433e-86a7-e0979b849bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.411978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee983eb-6ece-433e-86a7-e0979b849bc4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.422819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee983eb-6ece-433e-86a7-e0979b849bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:20.426705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-5ee983eb-6ece-433e-86a7-e0979b849bc4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:20.427772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:20.428785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:20.429894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:20.429894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:20.429894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:20.429894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:20.429894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:20.429894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:20.429894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:20.429894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:20.429894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:20.429894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:20.429894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:20.429894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:20.432703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 32/67] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:31:20.435044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee983eb-6ece-433e-86a7-e0979b849bc4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:20.477625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 36/68] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 26 02:31:20.479475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdec178-cca7-4085-a077-2d0ab40d21fc None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.480132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdec178-cca7-4085-a077-2d0ab40d21fc None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.480408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdec178-cca7-4085-a077-2d0ab40d21fc None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.482274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 37/69] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:20.483184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdec178-cca7-4085-a077-2d0ab40d21fc None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:20.510413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:20.546522 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee983eb-6ece-433e-86a7-e0979b849bc4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:20.579950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8613bd-d3e0-413a-bada-f64d79c93287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:20.580578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8613bd-d3e0-413a-bada-f64d79c93287 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.580859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8613bd-d3e0-413a-bada-f64d79c93287 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.581133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8613bd-d3e0-413a-bada-f64d79c93287 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.591303 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdec178-cca7-4085-a077-2d0ab40d21fc None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:20.591890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8613bd-d3e0-413a-bada-f64d79c93287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-3e8613bd-d3e0-413a-bada-f64d79c93287 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:20.597010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:20.598032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:20.598778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:20.598778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:20.598778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:20.598778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:20.598778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:20.598778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:20.598778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:20.598778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:20.598778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:20.598778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:20.598778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:20.598778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:20.598778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 33/70] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:31:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:20.599397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a21b0-8406-4aa6-89ac-b6322ec83088 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.600345 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a21b0-8406-4aa6-89ac-b6322ec83088 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.600345 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a21b0-8406-4aa6-89ac-b6322ec83088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.618819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a24a21b0-8406-4aa6-89ac-b6322ec83088 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:20.620053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a24a21b0-8406-4aa6-89ac-b6322ec83088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:20.630023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3e2cb-7b03-4a40-8d8e-d3ca03b9e723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:20.630656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e2cb-7b03-4a40-8d8e-d3ca03b9e723 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.630970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e2cb-7b03-4a40-8d8e-d3ca03b9e723 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.631209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e2cb-7b03-4a40-8d8e-d3ca03b9e723 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.631930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3e2cb-7b03-4a40-8d8e-d3ca03b9e723 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:20.632232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3e2cb-7b03-4a40-8d8e-d3ca03b9e723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:20.633695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3e2cb-7b03-4a40-8d8e-d3ca03b9e723 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:20.641899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 38/71] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:20.643221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee434fe-51e5-4f90-b2ed-33725faba1a6 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.643752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee434fe-51e5-4f90-b2ed-33725faba1a6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.643880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee434fe-51e5-4f90-b2ed-33725faba1a6 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.644973 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 39/72] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:20.649116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee434fe-51e5-4f90-b2ed-33725faba1a6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:20.673980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:20.693644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 34/73] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:20.694502 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a21b0-8406-4aa6-89ac-b6322ec83088 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:20.749714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee434fe-51e5-4f90-b2ed-33725faba1a6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:20.758044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:20.781589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad308913-0cdb-45af-a05d-f8ce66c34f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:20.782233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308913-0cdb-45af-a05d-f8ce66c34f63 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.782512 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308913-0cdb-45af-a05d-f8ce66c34f63 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.782793 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad308913-0cdb-45af-a05d-f8ce66c34f63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.794014 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad308913-0cdb-45af-a05d-f8ce66c34f63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-ad308913-0cdb-45af-a05d-f8ce66c34f63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:20.800608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:20.801583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:20.802321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:20.802321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:20.802321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:20.802321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:20.802321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:20.802321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:20.802321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:20.802321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:20.802321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:20.802321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:20.802321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:20.802321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:20.803219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a21b0-8406-4aa6-89ac-b6322ec83088 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:20.803316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 40/74] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:31:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:20.803316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad308913-0cdb-45af-a05d-f8ce66c34f63 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:20.839424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b9f11-d3fa-4259-a247-db01bac4d15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:20.840044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b9f11-d3fa-4259-a247-db01bac4d15c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.840328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b9f11-d3fa-4259-a247-db01bac4d15c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.840599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b9f11-d3fa-4259-a247-db01bac4d15c None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.841330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b9f11-d3fa-4259-a247-db01bac4d15c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:20.841634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b9f11-d3fa-4259-a247-db01bac4d15c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:20.843166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b9f11-d3fa-4259-a247-db01bac4d15c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:20.851547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 35/75] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:31:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:20.852757 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037855-d711-42d6-8c58-4f0a3fa38853 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.853026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037855-d711-42d6-8c58-4f0a3fa38853 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.853312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06037855-d711-42d6-8c58-4f0a3fa38853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.872239 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-06037855-d711-42d6-8c58-4f0a3fa38853 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:20.873142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-06037855-d711-42d6-8c58-4f0a3fa38853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:20.892553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:20.910362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad308913-0cdb-45af-a05d-f8ce66c34f63 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:20.942094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 36/76] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:20.957406 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1f284-d51e-499a-abe0-f03b42910722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:20.957561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06037855-d711-42d6-8c58-4f0a3fa38853 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:20.957637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f284-d51e-499a-abe0-f03b42910722 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:20.957637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f284-d51e-499a-abe0-f03b42910722 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:20.957637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f284-d51e-499a-abe0-f03b42910722 None admin] PATH_INFO: `/v3/users/1eca276b92bb4be3aaab7d47e762f25d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:20.960479 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1f284-d51e-499a-abe0-f03b42910722 None admin] RBAC: Authorizing `identity:get_user(user_id=1eca276b92bb4be3aaab7d47e762f25d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:20.961994 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1f284-d51e-499a-abe0-f03b42910722 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:20.968030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 41/77] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:20 2022] GET /identity/v3/users/1eca276b92bb4be3aaab7d47e762f25d => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:20.968030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1f284-d51e-499a-abe0-f03b42910722 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:20.995732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:21.047141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06037855-d711-42d6-8c58-4f0a3fa38853 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:21.063801 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1f284-d51e-499a-abe0-f03b42910722 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:21.079755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf63bfa-0359-4a6e-a823-5fc12d59e8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:21.080419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf63bfa-0359-4a6e-a823-5fc12d59e8c8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:21.080694 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf63bfa-0359-4a6e-a823-5fc12d59e8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:21.080972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf63bfa-0359-4a6e-a823-5fc12d59e8c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:21.082158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf63bfa-0359-4a6e-a823-5fc12d59e8c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:21.083602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf63bfa-0359-4a6e-a823-5fc12d59e8c8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:21.085198 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 37/78] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:21.090076 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf63bfa-0359-4a6e-a823-5fc12d59e8c8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:21.097976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa7f85-29cf-4f6e-b085-48e1d21f4d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:21.098597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7f85-29cf-4f6e-b085-48e1d21f4d65 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:21.098878 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7f85-29cf-4f6e-b085-48e1d21f4d65 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:21.099154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7f85-29cf-4f6e-b085-48e1d21f4d65 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:21.099880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa7f85-29cf-4f6e-b085-48e1d21f4d65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:21.100185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa7f85-29cf-4f6e-b085-48e1d21f4d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:21.101616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa7f85-29cf-4f6e-b085-48e1d21f4d65 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:21.109977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 42/79] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:21.110746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa7f85-29cf-4f6e-b085-48e1d21f4d65 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:21.115069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:21.186442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf63bfa-0359-4a6e-a823-5fc12d59e8c8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:21.203150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:21.212225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa7f85-29cf-4f6e-b085-48e1d21f4d65 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:21.222139 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39449e06-3b1f-4631-9193-d9d412a39951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:21.222777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39449e06-3b1f-4631-9193-d9d412a39951 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:21.223060 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39449e06-3b1f-4631-9193-d9d412a39951 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:21.223335 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39449e06-3b1f-4631-9193-d9d412a39951 None admin] PATH_INFO: `/v3/users/1eca276b92bb4be3aaab7d47e762f25d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:21.224531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39449e06-3b1f-4631-9193-d9d412a39951 None admin] RBAC: Authorizing `identity:get_user(user_id=1eca276b92bb4be3aaab7d47e762f25d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:21.226055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39449e06-3b1f-4631-9193-d9d412a39951 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:21.227697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 38/80] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:21 2022] GET /identity/v3/users/1eca276b92bb4be3aaab7d47e762f25d => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:21.228460 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39449e06-3b1f-4631-9193-d9d412a39951 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:21.247563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d94825-ccd9-4d6d-a131-6e1c1223da52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:21.248211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94825-ccd9-4d6d-a131-6e1c1223da52 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:21.248756 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94825-ccd9-4d6d-a131-6e1c1223da52 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:21.248862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94825-ccd9-4d6d-a131-6e1c1223da52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:21.259043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d94825-ccd9-4d6d-a131-6e1c1223da52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-34d94825-ccd9-4d6d-a131-6e1c1223da52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:21.264455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:21.265511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 43/81] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:21.266464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d94825-ccd9-4d6d-a131-6e1c1223da52 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:21.323938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:21.331664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39449e06-3b1f-4631-9193-d9d412a39951 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:21.362603 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d94825-ccd9-4d6d-a131-6e1c1223da52 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:21.364451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213154dc-76e1-4081-9cb3-4d1b3ff09e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:21.365073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213154dc-76e1-4081-9cb3-4d1b3ff09e22 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:21.365381 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213154dc-76e1-4081-9cb3-4d1b3ff09e22 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:21.365657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213154dc-76e1-4081-9cb3-4d1b3ff09e22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:21.396618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07141610-53a7-458a-a18c-86c059964104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:21.397225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07141610-53a7-458a-a18c-86c059964104 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:21.397535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07141610-53a7-458a-a18c-86c059964104 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:21.397818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07141610-53a7-458a-a18c-86c059964104 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:21.398670 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07141610-53a7-458a-a18c-86c059964104 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:21.400144 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07141610-53a7-458a-a18c-86c059964104 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:21.415685 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:21.426533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 44/82] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:31:21 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:31:21.427476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07141610-53a7-458a-a18c-86c059964104 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:21.432220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213154dc-76e1-4081-9cb3-4d1b3ff09e22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:21.433778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213154dc-76e1-4081-9cb3-4d1b3ff09e22 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:21.546399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07141610-53a7-458a-a18c-86c059964104 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:21.549559 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 39/83] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:21.555308 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213154dc-76e1-4081-9cb3-4d1b3ff09e22 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:21.569407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:21.587559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f52d71-3da0-4199-b517-cd2151ce2916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:21.588232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f52d71-3da0-4199-b517-cd2151ce2916 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:21.588521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f52d71-3da0-4199-b517-cd2151ce2916 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:21.588802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f52d71-3da0-4199-b517-cd2151ce2916 None admin] PATH_INFO: `/v3/users/5c2fa740cfd643e6a29f9d9686eada23` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:21.590011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f52d71-3da0-4199-b517-cd2151ce2916 None admin] RBAC: Authorizing `identity:get_user(user_id=5c2fa740cfd643e6a29f9d9686eada23)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:21.591736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f52d71-3da0-4199-b517-cd2151ce2916 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:21.593230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 45/84] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:21 2022] GET /identity/v3/users/5c2fa740cfd643e6a29f9d9686eada23 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:21.594412 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f52d71-3da0-4199-b517-cd2151ce2916 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:21.665020 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:21.687423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213154dc-76e1-4081-9cb3-4d1b3ff09e22 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:21.719824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f52d71-3da0-4199-b517-cd2151ce2916 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:21.734971 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981d13b-8f34-44e6-8510-1974454773ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:21.735953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d13b-8f34-44e6-8510-1974454773ab None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:21.736472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d13b-8f34-44e6-8510-1974454773ab None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:21.736764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981d13b-8f34-44e6-8510-1974454773ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:21.765092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdfe53-ab58-40b1-9ccf-96f7c0531c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:21.765795 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdfe53-ab58-40b1-9ccf-96f7c0531c69 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:21.766082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdfe53-ab58-40b1-9ccf-96f7c0531c69 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:21.766354 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdfe53-ab58-40b1-9ccf-96f7c0531c69 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:21.767083 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdfe53-ab58-40b1-9ccf-96f7c0531c69 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:21.767369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdfe53-ab58-40b1-9ccf-96f7c0531c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:21.768802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdfe53-ab58-40b1-9ccf-96f7c0531c69 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:21.777674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 46/85] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:21.778504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdfe53-ab58-40b1-9ccf-96f7c0531c69 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:21.823128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981d13b-8f34-44e6-8510-1974454773ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:21.825837 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981d13b-8f34-44e6-8510-1974454773ab None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:21.832645 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:21.899106 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdfe53-ab58-40b1-9ccf-96f7c0531c69 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:21.919043 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:21.937642 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 40/86] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:21.938632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981d13b-8f34-44e6-8510-1974454773ab None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:21.943410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc295234-3fcf-424a-9d80-10cf059d95ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:21.944246 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc295234-3fcf-424a-9d80-10cf059d95ac None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:21.944672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc295234-3fcf-424a-9d80-10cf059d95ac None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:21.945080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc295234-3fcf-424a-9d80-10cf059d95ac None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:21.946516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc295234-3fcf-424a-9d80-10cf059d95ac None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:21.948612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc295234-3fcf-424a-9d80-10cf059d95ac None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:21.951139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 47/87] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:21 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:21.952785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc295234-3fcf-424a-9d80-10cf059d95ac None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:22.044390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981d13b-8f34-44e6-8510-1974454773ab None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:22.084787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc295234-3fcf-424a-9d80-10cf059d95ac None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:22.085303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6174-2b96-4d16-9352-a8f28a0cca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:22.085998 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6174-2b96-4d16-9352-a8f28a0cca5e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:22.086287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6174-2b96-4d16-9352-a8f28a0cca5e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:22.086564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6174-2b96-4d16-9352-a8f28a0cca5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:22.108216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:22.131003 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbef1de-74bc-448f-bd39-d28323626fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:22.132114 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef1de-74bc-448f-bd39-d28323626fe8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:22.133426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef1de-74bc-448f-bd39-d28323626fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:22.133897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef1de-74bc-448f-bd39-d28323626fe8 None admin] PATH_INFO: `/v3/users/1eca276b92bb4be3aaab7d47e762f25d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:22.135297 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbef1de-74bc-448f-bd39-d28323626fe8 None admin] RBAC: Authorizing `identity:get_user(user_id=1eca276b92bb4be3aaab7d47e762f25d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:22.136904 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbef1de-74bc-448f-bd39-d28323626fe8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:22.140118 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 48/88] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:21 2022] GET /identity/v3/users/1eca276b92bb4be3aaab7d47e762f25d => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:22.141582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbef1de-74bc-448f-bd39-d28323626fe8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:22.152527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:22.177181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c6174-2b96-4d16-9352-a8f28a0cca5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:22.178706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c6174-2b96-4d16-9352-a8f28a0cca5e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:22.281692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbef1de-74bc-448f-bd39-d28323626fe8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:22.293636 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 41/89] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:22.298659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6174-2b96-4d16-9352-a8f28a0cca5e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:22.329706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b429c30-1efb-440b-828f-e2f649456457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:22.331145 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b429c30-1efb-440b-828f-e2f649456457 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:22.331719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b429c30-1efb-440b-828f-e2f649456457 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:22.332274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b429c30-1efb-440b-828f-e2f649456457 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:22.333663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b429c30-1efb-440b-828f-e2f649456457 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:22.336347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b429c30-1efb-440b-828f-e2f649456457 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:22.338253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 49/90] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:22 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:22.339199 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b429c30-1efb-440b-828f-e2f649456457 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:22.385842 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:22.403923 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6174-2b96-4d16-9352-a8f28a0cca5e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:22.410602 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:22.440691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c61528-2dda-4cac-8532-59b19a9692e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:22.441686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c61528-2dda-4cac-8532-59b19a9692e0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:22.442162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c61528-2dda-4cac-8532-59b19a9692e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:22.442673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c61528-2dda-4cac-8532-59b19a9692e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:22.443780 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c61528-2dda-4cac-8532-59b19a9692e0 None admin] RBAC: Adding query filter params (role.id=d93e06f63f2947f98ad9a668b80929dc, scope.project.id=05ea5625e61f40ecad97004ff4e32fa4, user.id=1eca276b92bb4be3aaab7d47e762f25d) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:22.444304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c61528-2dda-4cac-8532-59b19a9692e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:22.446162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c61528-2dda-4cac-8532-59b19a9692e0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:22.452159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 42/91] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:22 2022] GET /identity/v3/role_assignments?user.id=1eca276b92bb4be3aaab7d47e762f25d&scope.project.id=05ea5625e61f40ecad97004ff4e32fa4&role.id=d93e06f63f2947f98ad9a668b80929dc => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:22.458006 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c61528-2dda-4cac-8532-59b19a9692e0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:22.464124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b429c30-1efb-440b-828f-e2f649456457 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:22.502825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31d9c0-4fde-4f0b-8065-1e5505e24dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:22.503474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31d9c0-4fde-4f0b-8065-1e5505e24dc0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:22.503756 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31d9c0-4fde-4f0b-8065-1e5505e24dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:22.504031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31d9c0-4fde-4f0b-8065-1e5505e24dc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:22.585934 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31d9c0-4fde-4f0b-8065-1e5505e24dc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:22.587877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31d9c0-4fde-4f0b-8065-1e5505e24dc0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:22.659521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:22.670781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c61528-2dda-4cac-8532-59b19a9692e0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:22.713304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 50/92] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:22.714383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31d9c0-4fde-4f0b-8065-1e5505e24dc0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:22.748761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2154ff-43f0-4de0-9fb2-161cf06a4616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:22.749950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2154ff-43f0-4de0-9fb2-161cf06a4616 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:22.750428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2154ff-43f0-4de0-9fb2-161cf06a4616 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:22.750986 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2154ff-43f0-4de0-9fb2-161cf06a4616 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:22.757911 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2154ff-43f0-4de0-9fb2-161cf06a4616 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:22.759679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2154ff-43f0-4de0-9fb2-161cf06a4616 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:22.761807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 43/93] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:22 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:22.762766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2154ff-43f0-4de0-9fb2-161cf06a4616 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:22.804743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:22.837678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31d9c0-4fde-4f0b-8065-1e5505e24dc0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:22.881861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf854c74-609d-43c6-b5f4-ba5f625cd804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:22.882936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf854c74-609d-43c6-b5f4-ba5f625cd804 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:22.883426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf854c74-609d-43c6-b5f4-ba5f625cd804 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:22.883939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf854c74-609d-43c6-b5f4-ba5f625cd804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:22.884927 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf854c74-609d-43c6-b5f4-ba5f625cd804 None admin] RBAC: Adding query filter params (role.id=506da913e25f44b1854b24215eb447fc, scope.project.id=05ea5625e61f40ecad97004ff4e32fa4, user.id=1eca276b92bb4be3aaab7d47e762f25d) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:22.885461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf854c74-609d-43c6-b5f4-ba5f625cd804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:22.887209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf854c74-609d-43c6-b5f4-ba5f625cd804 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:22.905498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 51/94] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:22 2022] GET /identity/v3/role_assignments?user.id=1eca276b92bb4be3aaab7d47e762f25d&scope.project.id=05ea5625e61f40ecad97004ff4e32fa4&role.id=506da913e25f44b1854b24215eb447fc => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:22.906586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf854c74-609d-43c6-b5f4-ba5f625cd804 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:22.911276 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2154ff-43f0-4de0-9fb2-161cf06a4616 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:22.945558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:22.954807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4916c6-fc97-432d-8996-12eb5f3508a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:22.955881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4916c6-fc97-432d-8996-12eb5f3508a5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:22.955987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4916c6-fc97-432d-8996-12eb5f3508a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:22.956217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4916c6-fc97-432d-8996-12eb5f3508a5 None admin] PATH_INFO: `/v3/projects/b32434e651e54d4295ca7883fe711b27` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:22.957648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4916c6-fc97-432d-8996-12eb5f3508a5 None admin] RBAC: Authorizing `identity:get_project(project_id=b32434e651e54d4295ca7883fe711b27)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:22.959123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4916c6-fc97-432d-8996-12eb5f3508a5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:22.965321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 44/95] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:22 2022] GET /identity/v3/projects/b32434e651e54d4295ca7883fe711b27 => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:22.966839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4916c6-fc97-432d-8996-12eb5f3508a5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:23.075771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:23.081667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4916c6-fc97-432d-8996-12eb5f3508a5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:23.121923 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475fc51-e72b-45e3-a9a6-bef4b3f41858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:23.122587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475fc51-e72b-45e3-a9a6-bef4b3f41858 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:23.122811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf854c74-609d-43c6-b5f4-ba5f625cd804 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:23.123175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475fc51-e72b-45e3-a9a6-bef4b3f41858 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:23.123175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475fc51-e72b-45e3-a9a6-bef4b3f41858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:23.124020 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475fc51-e72b-45e3-a9a6-bef4b3f41858 None admin] RBAC: Adding query filter params (role.id=d93e06f63f2947f98ad9a668b80929dc, scope.project.id=b32434e651e54d4295ca7883fe711b27, user.id=1eca276b92bb4be3aaab7d47e762f25d) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:23.124333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475fc51-e72b-45e3-a9a6-bef4b3f41858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:23.125980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475fc51-e72b-45e3-a9a6-bef4b3f41858 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:23.132399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 45/96] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:22 2022] GET /identity/v3/role_assignments?user.id=1eca276b92bb4be3aaab7d47e762f25d&scope.project.id=b32434e651e54d4295ca7883fe711b27&role.id=d93e06f63f2947f98ad9a668b80929dc => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:23.198451 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41e4ae-7b53-4fc9-9b2a-83d9c45f8c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:23.199533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41e4ae-7b53-4fc9-9b2a-83d9c45f8c2f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:23.200010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41e4ae-7b53-4fc9-9b2a-83d9c45f8c2f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:23.200525 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41e4ae-7b53-4fc9-9b2a-83d9c45f8c2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:23.201655 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41e4ae-7b53-4fc9-9b2a-83d9c45f8c2f None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=05ea5625e61f40ecad97004ff4e32fa4, user.id=5c2fa740cfd643e6a29f9d9686eada23) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:23.202175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41e4ae-7b53-4fc9-9b2a-83d9c45f8c2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:23.203879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41e4ae-7b53-4fc9-9b2a-83d9c45f8c2f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:23.213761 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 52/97] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:22 2022] GET /identity/v3/role_assignments?user.id=5c2fa740cfd643e6a29f9d9686eada23&scope.project.id=05ea5625e61f40ecad97004ff4e32fa4&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:23.751338 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22401aaf-c720-4abc-89ad-78098d8e1018 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:23.752021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22401aaf-c720-4abc-89ad-78098d8e1018 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:23.752505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22401aaf-c720-4abc-89ad-78098d8e1018 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:23.754115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 46/98] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:23.759455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a13438-500a-4c46-ad39-5352d6d3465d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:23.760008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a13438-500a-4c46-ad39-5352d6d3465d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:23.760496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a13438-500a-4c46-ad39-5352d6d3465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:23.784505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b2a13438-500a-4c46-ad39-5352d6d3465d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:23.786105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b2a13438-500a-4c46-ad39-5352d6d3465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:23.869749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c387c6-c339-4276-a1a4-fca6562dc93a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:23.870414 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c387c6-c339-4276-a1a4-fca6562dc93a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:23.870889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c387c6-c339-4276-a1a4-fca6562dc93a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:23.872483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 47/99] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:23.880321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387f348-6541-4be0-9d93-1975b6305590 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:23.880936 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387f348-6541-4be0-9d93-1975b6305590 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:23.881477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387f348-6541-4be0-9d93-1975b6305590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:23.912854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 53/100] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:23.914124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2387f348-6541-4be0-9d93-1975b6305590 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:23.915531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2387f348-6541-4be0-9d93-1975b6305590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:23.987505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a13438-500a-4c46-ad39-5352d6d3465d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:24.011044 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:24.033802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 48/101] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:24.093839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387f348-6541-4be0-9d93-1975b6305590 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:24.186354 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a13438-500a-4c46-ad39-5352d6d3465d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:24.256643 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:24.278037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896aaa45-9e3a-46ff-857d-23283978cf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:24.279088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896aaa45-9e3a-46ff-857d-23283978cf28 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:24.279514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896aaa45-9e3a-46ff-857d-23283978cf28 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:24.279891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896aaa45-9e3a-46ff-857d-23283978cf28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:24.281387 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896aaa45-9e3a-46ff-857d-23283978cf28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:24.283605 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896aaa45-9e3a-46ff-857d-23283978cf28 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:24.285533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 54/102] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:24.292426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387f348-6541-4be0-9d93-1975b6305590 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:24.296775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896aaa45-9e3a-46ff-857d-23283978cf28 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:24.364366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f98f5a-912c-430a-93c2-46f3eda1b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:24.365730 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f98f5a-912c-430a-93c2-46f3eda1b945 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:24.366186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f98f5a-912c-430a-93c2-46f3eda1b945 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:24.366747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f98f5a-912c-430a-93c2-46f3eda1b945 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:24.395584 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f98f5a-912c-430a-93c2-46f3eda1b945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e8f98f5a-912c-430a-93c2-46f3eda1b945 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:24.401149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:24.402219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:24.403852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:24.403852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:24.403852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:24.403852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:24.403852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:24.403852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:24.403852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:24.403852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:24.403852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:24.403852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:24.403852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:24.403852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:24.410838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 49/103] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:31:24.412418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f98f5a-912c-430a-93c2-46f3eda1b945 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:24.481088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:24.531569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896aaa45-9e3a-46ff-857d-23283978cf28 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:24.575717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f98f5a-912c-430a-93c2-46f3eda1b945 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:24.618006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4490cf-9bab-4cb2-8c0a-38f1dece6d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:24.618651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4490cf-9bab-4cb2-8c0a-38f1dece6d52 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:24.618891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7d795-90e6-41b5-840a-4e8658f5f004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:24.619012 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4490cf-9bab-4cb2-8c0a-38f1dece6d52 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:24.619200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4490cf-9bab-4cb2-8c0a-38f1dece6d52 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:24.619923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4490cf-9bab-4cb2-8c0a-38f1dece6d52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:24.620058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7d795-90e6-41b5-840a-4e8658f5f004 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:24.620462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7d795-90e6-41b5-840a-4e8658f5f004 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:24.620868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7d795-90e6-41b5-840a-4e8658f5f004 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:24.621409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4490cf-9bab-4cb2-8c0a-38f1dece6d52 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:24.621919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7d795-90e6-41b5-840a-4e8658f5f004 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:24.622502 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7d795-90e6-41b5-840a-4e8658f5f004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:24.624078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7d795-90e6-41b5-840a-4e8658f5f004 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:24.629973 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:24.647853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 50/104] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:24.653797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7d795-90e6-41b5-840a-4e8658f5f004 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:24.683394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 55/105] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:31:24 2022] POST /identity/v3/projects => generated 302 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:31:24.795489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7d795-90e6-41b5-840a-4e8658f5f004 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:24.843489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74ec4f-7a74-4a7a-aed2-d545e0001f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:24.844190 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ec4f-7a74-4a7a-aed2-d545e0001f2d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:24.844484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ec4f-7a74-4a7a-aed2-d545e0001f2d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:24.844755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74ec4f-7a74-4a7a-aed2-d545e0001f2d None admin] PATH_INFO: `/v3/users/b4177059d8c24265a03fd296f8a04ea8` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:24.869803 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74ec4f-7a74-4a7a-aed2-d545e0001f2d None admin] RBAC: Authorizing `identity:get_user(user_id=b4177059d8c24265a03fd296f8a04ea8)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:24.871349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74ec4f-7a74-4a7a-aed2-d545e0001f2d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:24.873172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 51/106] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:24 2022] GET /identity/v3/users/b4177059d8c24265a03fd296f8a04ea8 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:24.879167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4490cf-9bab-4cb2-8c0a-38f1dece6d52 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:25.023110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4490cf-9bab-4cb2-8c0a-38f1dece6d52 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:25.064792 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:25.070179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d033ab2-bf82-44e8-a479-680507cccd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:25.070825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d033ab2-bf82-44e8-a479-680507cccd03 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:25.071112 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d033ab2-bf82-44e8-a479-680507cccd03 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:25.071387 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d033ab2-bf82-44e8-a479-680507cccd03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:25.161968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d033ab2-bf82-44e8-a479-680507cccd03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:25.163479 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d033ab2-bf82-44e8-a479-680507cccd03 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:25.286124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 56/107] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:25.291674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74ec4f-7a74-4a7a-aed2-d545e0001f2d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:25.378976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:25.430864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74ec4f-7a74-4a7a-aed2-d545e0001f2d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:25.475390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6a990-09fd-4f72-8941-8087ec9755f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:25.476050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6a990-09fd-4f72-8941-8087ec9755f3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:25.476330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6a990-09fd-4f72-8941-8087ec9755f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:25.476605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6a990-09fd-4f72-8941-8087ec9755f3 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:25.477819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6a990-09fd-4f72-8941-8087ec9755f3 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:25.479289 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6a990-09fd-4f72-8941-8087ec9755f3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:25.481545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 52/108] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:25 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:25.487674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d033ab2-bf82-44e8-a479-680507cccd03 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:25.528717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf625f5e-a4d3-4a05-91bb-a5163fff085e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:25.529021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf625f5e-a4d3-4a05-91bb-a5163fff085e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:25.529478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf625f5e-a4d3-4a05-91bb-a5163fff085e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:25.531766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 53/109] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:31:25.535915 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:25.549666 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144c51-6c86-4716-96b2-dace186eec89 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:25.549958 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144c51-6c86-4716-96b2-dace186eec89 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:25.550248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e144c51-6c86-4716-96b2-dace186eec89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:25.580157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1e144c51-6c86-4716-96b2-dace186eec89 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:25.581400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1e144c51-6c86-4716-96b2-dace186eec89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:25.696113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d033ab2-bf82-44e8-a479-680507cccd03 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:25.733313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 54/110] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:25.768590 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e144c51-6c86-4716-96b2-dace186eec89 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:25.787418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4743a-00dc-4feb-ae1d-554cc54144e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:25.788341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4743a-00dc-4feb-ae1d-554cc54144e5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:25.788341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4743a-00dc-4feb-ae1d-554cc54144e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:25.788590 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4743a-00dc-4feb-ae1d-554cc54144e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:25.789420 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4743a-00dc-4feb-ae1d-554cc54144e5 None admin] RBAC: Adding query filter params (role.id=83230fc7c4994327bedaae3eacb6067e, scope.project.id=05ea5625e61f40ecad97004ff4e32fa4, user.id=b4177059d8c24265a03fd296f8a04ea8) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:25.789736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4743a-00dc-4feb-ae1d-554cc54144e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:25.791547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4743a-00dc-4feb-ae1d-554cc54144e5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:25.807274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 57/111] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:25 2022] GET /identity/v3/role_assignments?user.id=b4177059d8c24265a03fd296f8a04ea8&scope.project.id=05ea5625e61f40ecad97004ff4e32fa4&role.id=83230fc7c4994327bedaae3eacb6067e => generated 259 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:25.873756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:25.928369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e144c51-6c86-4716-96b2-dace186eec89 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:25.973078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d41d0-2d01-4ac0-9cb5-dcce417b0a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:25.974228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d41d0-2d01-4ac0-9cb5-dcce417b0a0b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:25.974701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d41d0-2d01-4ac0-9cb5-dcce417b0a0b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:25.975218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d41d0-2d01-4ac0-9cb5-dcce417b0a0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:25.992599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d41d0-2d01-4ac0-9cb5-dcce417b0a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2f0d41d0-2d01-4ac0-9cb5-dcce417b0a0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:25.997977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:25.998904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:25.999741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:25.999741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:25.999741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:25.999741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:25.999741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:25.999741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:25.999741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:25.999741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:25.999741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:25.999741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:25.999741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:25.999741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:26.006780 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 55/112] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:26.012496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4743a-00dc-4feb-ae1d-554cc54144e5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:26.016219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f89b3-9c13-4395-889e-e11e7f7ebdff None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:26.017027 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f89b3-9c13-4395-889e-e11e7f7ebdff None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:26.017525 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f89b3-9c13-4395-889e-e11e7f7ebdff None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:26.019162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 56/113] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:31:26.024800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071a466-6d93-4d65-855e-614483a939f4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:26.025447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071a466-6d93-4d65-855e-614483a939f4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:26.026467 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071a466-6d93-4d65-855e-614483a939f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:26.054563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1071a466-6d93-4d65-855e-614483a939f4 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:26.056257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1071a466-6d93-4d65-855e-614483a939f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:26.157385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 57/114] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:26.158673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026eaf0-0862-4f98-87ff-e3dfa47a89ce None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:26.158964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026eaf0-0862-4f98-87ff-e3dfa47a89ce None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:26.159244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026eaf0-0862-4f98-87ff-e3dfa47a89ce None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:26.160504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 58/115] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:26.170640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8bfb3-c0e3-473d-884b-2a805807cd0b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:26.171114 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8bfb3-c0e3-473d-884b-2a805807cd0b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:26.171586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8bfb3-c0e3-473d-884b-2a805807cd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:26.176323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:26.183121 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4743a-00dc-4feb-ae1d-554cc54144e5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:26.198377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4fa8bfb3-c0e3-473d-884b-2a805807cd0b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:26.199591 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4fa8bfb3-c0e3-473d-884b-2a805807cd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:26.228575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b6967-c1e6-4ba2-9443-7109fbc9b689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:26.229843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b6967-c1e6-4ba2-9443-7109fbc9b689 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:26.230291 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b6967-c1e6-4ba2-9443-7109fbc9b689 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:26.230701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b6967-c1e6-4ba2-9443-7109fbc9b689 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:26.231576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b6967-c1e6-4ba2-9443-7109fbc9b689 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:26.232018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b6967-c1e6-4ba2-9443-7109fbc9b689 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:26.234414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b6967-c1e6-4ba2-9443-7109fbc9b689 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:26.251309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 58/116] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:26.253255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b6967-c1e6-4ba2-9443-7109fbc9b689 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:26.286897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:26.337247 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 59/117] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:26.342103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8bfb3-c0e3-473d-884b-2a805807cd0b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:26.406784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b6967-c1e6-4ba2-9443-7109fbc9b689 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:26.442375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2618f3-c398-4f73-87bc-0da38c9b9d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:26.442947 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2618f3-c398-4f73-87bc-0da38c9b9d01 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:26.443230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2618f3-c398-4f73-87bc-0da38c9b9d01 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:26.443506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2618f3-c398-4f73-87bc-0da38c9b9d01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:26.459061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2618f3-c398-4f73-87bc-0da38c9b9d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-0c2618f3-c398-4f73-87bc-0da38c9b9d01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:26.464438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:26.465332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:26.466096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:26.466096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:26.466096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:26.466096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:26.466096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:26.466096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:26.466096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:26.466096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:26.466096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:26.466096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:26.466096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:26.466096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:26.466096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 59/118] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:26.466726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2618f3-c398-4f73-87bc-0da38c9b9d01 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:26.486339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:26.496409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8bfb3-c0e3-473d-884b-2a805807cd0b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:26.531075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac92c0f-201b-4656-8e4f-d60818342964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:26.531729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac92c0f-201b-4656-8e4f-d60818342964 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:26.532007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac92c0f-201b-4656-8e4f-d60818342964 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:26.532277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac92c0f-201b-4656-8e4f-d60818342964 None admin] PATH_INFO: `/v3/users/1eca276b92bb4be3aaab7d47e762f25d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:26.533478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac92c0f-201b-4656-8e4f-d60818342964 None admin] RBAC: Authorizing `identity:get_user(user_id=1eca276b92bb4be3aaab7d47e762f25d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:26.534922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac92c0f-201b-4656-8e4f-d60818342964 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:26.536537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 60/119] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:26 2022] GET /identity/v3/users/1eca276b92bb4be3aaab7d47e762f25d => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:26.537693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6773-9f4f-47b8-ae25-47e53090f745 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:26.538029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6773-9f4f-47b8-ae25-47e53090f745 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:26.538302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6773-9f4f-47b8-ae25-47e53090f745 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:26.539557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 61/120] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:26.540242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6773-9f4f-47b8-ae25-47e53090f745 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:26.589117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2618f3-c398-4f73-87bc-0da38c9b9d01 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:26.605514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:26.638080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3cf6f-0e18-42e4-a84c-8fd7518f57b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:26.638772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3cf6f-0e18-42e4-a84c-8fd7518f57b8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:26.639160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3cf6f-0e18-42e4-a84c-8fd7518f57b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:26.639413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3cf6f-0e18-42e4-a84c-8fd7518f57b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:26.651459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3cf6f-0e18-42e4-a84c-8fd7518f57b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b2e3cf6f-0e18-42e4-a84c-8fd7518f57b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:26.656922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:26.657787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:26.658569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:26.658569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:26.658569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:26.658569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:26.658569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:26.658569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:26.658569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:26.658569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:26.658569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:26.658569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:26.658569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:26.658569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:26.658569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 60/121] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:31:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:26.659205 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3cf6f-0e18-42e4-a84c-8fd7518f57b8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:26.685823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6773-9f4f-47b8-ae25-47e53090f745 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:26.727084 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0468da-243c-4744-956a-7f32977fb6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:26.727611 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0468da-243c-4744-956a-7f32977fb6ad None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:26.727890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0468da-243c-4744-956a-7f32977fb6ad None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:26.728163 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0468da-243c-4744-956a-7f32977fb6ad None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:26.728885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0468da-243c-4744-956a-7f32977fb6ad None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:26.729180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0468da-243c-4744-956a-7f32977fb6ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:26.730964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0468da-243c-4744-956a-7f32977fb6ad None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:26.740063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 62/122] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:26.741119 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcc644-d71b-4cbc-bf53-6116ebd8f09d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:26.741409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcc644-d71b-4cbc-bf53-6116ebd8f09d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:26.741685 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcc644-d71b-4cbc-bf53-6116ebd8f09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:26.759995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-30dcc644-d71b-4cbc-bf53-6116ebd8f09d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:26.761176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-30dcc644-d71b-4cbc-bf53-6116ebd8f09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:26.763674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:26.789965 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3cf6f-0e18-42e4-a84c-8fd7518f57b8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:26.825306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908d6bb-3412-4091-b003-923f2f935530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:26.825961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908d6bb-3412-4091-b003-923f2f935530 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:26.826314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908d6bb-3412-4091-b003-923f2f935530 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:26.826591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6908d6bb-3412-4091-b003-923f2f935530 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:26.827779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908d6bb-3412-4091-b003-923f2f935530 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:26.829378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6908d6bb-3412-4091-b003-923f2f935530 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:26.831333 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 61/123] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:26 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:26.831916 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908d6bb-3412-4091-b003-923f2f935530 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:26.851902 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 63/124] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:26.852601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcc644-d71b-4cbc-bf53-6116ebd8f09d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:26.895649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:26.960019 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6908d6bb-3412-4091-b003-923f2f935530 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:26.992046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcc644-d71b-4cbc-bf53-6116ebd8f09d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:26.998984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145829c7-4b58-4828-94e7-e122ac8723d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:26.999619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145829c7-4b58-4828-94e7-e122ac8723d3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:26.999898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145829c7-4b58-4828-94e7-e122ac8723d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:27.000167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145829c7-4b58-4828-94e7-e122ac8723d3 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:27.001370 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145829c7-4b58-4828-94e7-e122ac8723d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:27.001370 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145829c7-4b58-4828-94e7-e122ac8723d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:27.002726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145829c7-4b58-4828-94e7-e122ac8723d3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:27.011144 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 62/125] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:31:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:27.011936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145829c7-4b58-4828-94e7-e122ac8723d3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:27.027682 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:27.046410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4625c9-73ae-4ff7-9b77-9b07073ba383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:27.048198 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4625c9-73ae-4ff7-9b77-9b07073ba383 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:27.048696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4625c9-73ae-4ff7-9b77-9b07073ba383 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:27.049393 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4625c9-73ae-4ff7-9b77-9b07073ba383 None admin] PATH_INFO: `/v3/users/1eca276b92bb4be3aaab7d47e762f25d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:27.051433 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4625c9-73ae-4ff7-9b77-9b07073ba383 None admin] RBAC: Authorizing `identity:get_user(user_id=1eca276b92bb4be3aaab7d47e762f25d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:27.054015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4625c9-73ae-4ff7-9b77-9b07073ba383 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:27.056093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 64/126] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:26 2022] GET /identity/v3/users/1eca276b92bb4be3aaab7d47e762f25d => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:27.057849 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4625c9-73ae-4ff7-9b77-9b07073ba383 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:27.125077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145829c7-4b58-4828-94e7-e122ac8723d3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:27.162640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d87326-8d77-43e9-9cd9-2d7a05ab526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:27.163374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d87326-8d77-43e9-9cd9-2d7a05ab526f None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:27.163652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d87326-8d77-43e9-9cd9-2d7a05ab526f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:27.163946 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d87326-8d77-43e9-9cd9-2d7a05ab526f None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4/users/1eca276b92bb4be3aaab7d47e762f25d/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:27.166083 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d87326-8d77-43e9-9cd9-2d7a05ab526f None admin] RBAC: Authorizing `identity:create_grant(project_id=05ea5625e61f40ecad97004ff4e32fa4, user_id=1eca276b92bb4be3aaab7d47e762f25d, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:27.167573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d87326-8d77-43e9-9cd9-2d7a05ab526f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:27.188419 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 63/127] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:31:27 2022] PUT /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4/users/1eca276b92bb4be3aaab7d47e762f25d/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:31:27.189743 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d87326-8d77-43e9-9cd9-2d7a05ab526f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:27.206842 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4625c9-73ae-4ff7-9b77-9b07073ba383 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:27.212169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:27.253973 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e2e72-8f43-4ea6-9272-831e36935213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:27.254547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e2e72-8f43-4ea6-9272-831e36935213 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:27.254835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e2e72-8f43-4ea6-9272-831e36935213 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:27.255111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e2e72-8f43-4ea6-9272-831e36935213 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:27.268163 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e2e72-8f43-4ea6-9272-831e36935213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f49e2e72-8f43-4ea6-9272-831e36935213 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:27.273557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:27.274504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:27.275356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:27.275356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:27.275356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:27.275356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:27.275356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:27.275356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:27.275356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:27.275356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:27.275356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:27.275356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:27.275356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:27.275356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:27.275356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 65/128] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:31:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:27.276026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e2e72-8f43-4ea6-9272-831e36935213 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:27.288142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:27.343631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d87326-8d77-43e9-9cd9-2d7a05ab526f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:27.383864 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5fcfb-0436-47e4-9d8e-d6c847587a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:27.384582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5fcfb-0436-47e4-9d8e-d6c847587a99 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:27.384871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5fcfb-0436-47e4-9d8e-d6c847587a99 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:27.385151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5fcfb-0436-47e4-9d8e-d6c847587a99 None admin] PATH_INFO: `/v3/users/1eca276b92bb4be3aaab7d47e762f25d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:27.386389 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5fcfb-0436-47e4-9d8e-d6c847587a99 None admin] RBAC: Authorizing `identity:get_user(user_id=1eca276b92bb4be3aaab7d47e762f25d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:27.388026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5fcfb-0436-47e4-9d8e-d6c847587a99 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:27.389817 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 64/129] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:27 2022] GET /identity/v3/users/1eca276b92bb4be3aaab7d47e762f25d => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:27.390650 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5fcfb-0436-47e4-9d8e-d6c847587a99 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:27.405783 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e2e72-8f43-4ea6-9272-831e36935213 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:27.444721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991bf63-4a87-4616-8b31-9f361bfc6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:27.445402 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991bf63-4a87-4616-8b31-9f361bfc6085 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:27.445689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991bf63-4a87-4616-8b31-9f361bfc6085 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:27.445965 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991bf63-4a87-4616-8b31-9f361bfc6085 None admin] PATH_INFO: `/v3/projects/b32434e651e54d4295ca7883fe711b27` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:27.447152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991bf63-4a87-4616-8b31-9f361bfc6085 None admin] RBAC: Authorizing `identity:get_project(project_id=b32434e651e54d4295ca7883fe711b27)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:27.448780 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991bf63-4a87-4616-8b31-9f361bfc6085 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:27.450565 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 66/130] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:27 2022] GET /identity/v3/projects/b32434e651e54d4295ca7883fe711b27 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:27.451469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991bf63-4a87-4616-8b31-9f361bfc6085 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:27.486427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:27.534521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5fcfb-0436-47e4-9d8e-d6c847587a99 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:27.565907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991bf63-4a87-4616-8b31-9f361bfc6085 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:27.580977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2cadc-443f-47fc-aa9b-4abc2d5fdcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:27.582252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2cadc-443f-47fc-aa9b-4abc2d5fdcf0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:27.583228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2cadc-443f-47fc-aa9b-4abc2d5fdcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:27.583715 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2cadc-443f-47fc-aa9b-4abc2d5fdcf0 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:27.584944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2cadc-443f-47fc-aa9b-4abc2d5fdcf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:27.585478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2cadc-443f-47fc-aa9b-4abc2d5fdcf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:27.587749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2cadc-443f-47fc-aa9b-4abc2d5fdcf0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:27.590934 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:27.602580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 65/131] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:27.603913 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2cadc-443f-47fc-aa9b-4abc2d5fdcf0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:27.606538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f0268-270e-442f-971e-d076e3f0d882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:27.607203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0268-270e-442f-971e-d076e3f0d882 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:27.607602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0268-270e-442f-971e-d076e3f0d882 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:27.608017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0268-270e-442f-971e-d076e3f0d882 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:27.609208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f0268-270e-442f-971e-d076e3f0d882 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:27.613484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f0268-270e-442f-971e-d076e3f0d882 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:27.615335 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 67/132] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:27 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:27.616110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f0268-270e-442f-971e-d076e3f0d882 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:27.719288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2cadc-443f-47fc-aa9b-4abc2d5fdcf0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:27.723538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:27.726656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f0268-270e-442f-971e-d076e3f0d882 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:27.759300 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312c071-9be2-4c3a-8534-f39c15469f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:27.760561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312c071-9be2-4c3a-8534-f39c15469f6a None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:27.761126 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312c071-9be2-4c3a-8534-f39c15469f6a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:27.761712 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312c071-9be2-4c3a-8534-f39c15469f6a None admin] PATH_INFO: `/v3/projects/b32434e651e54d4295ca7883fe711b27/users/1eca276b92bb4be3aaab7d47e762f25d/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:27.762763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fdd23-7df8-43ab-afe8-4d874c866616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:27.763610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fdd23-7df8-43ab-afe8-4d874c866616 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:27.763953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fdd23-7df8-43ab-afe8-4d874c866616 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:27.764236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fdd23-7df8-43ab-afe8-4d874c866616 None admin] PATH_INFO: `/v3/users/5c2fa740cfd643e6a29f9d9686eada23` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:27.764973 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312c071-9be2-4c3a-8534-f39c15469f6a None admin] RBAC: Authorizing `identity:create_grant(project_id=b32434e651e54d4295ca7883fe711b27, user_id=1eca276b92bb4be3aaab7d47e762f25d, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:27.765514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fdd23-7df8-43ab-afe8-4d874c866616 None admin] RBAC: Authorizing `identity:get_user(user_id=5c2fa740cfd643e6a29f9d9686eada23)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:27.766942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312c071-9be2-4c3a-8534-f39c15469f6a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:27.767051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fdd23-7df8-43ab-afe8-4d874c866616 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:27.768748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 68/133] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:27 2022] GET /identity/v3/users/5c2fa740cfd643e6a29f9d9686eada23 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:27.769357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fdd23-7df8-43ab-afe8-4d874c866616 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:27.806888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 66/134] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:31:27 2022] PUT /identity/v3/projects/b32434e651e54d4295ca7883fe711b27/users/1eca276b92bb4be3aaab7d47e762f25d/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:31:27.808258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312c071-9be2-4c3a-8534-f39c15469f6a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:27.891530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fdd23-7df8-43ab-afe8-4d874c866616 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:27.918758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:27.957451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c60fc7-3b25-4a4d-88d0-231061bae9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:27.958610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c60fc7-3b25-4a4d-88d0-231061bae9c8 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:27.959123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c60fc7-3b25-4a4d-88d0-231061bae9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:27.959611 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c60fc7-3b25-4a4d-88d0-231061bae9c8 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4/users/1eca276b92bb4be3aaab7d47e762f25d/roles/506da913e25f44b1854b24215eb447fc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:27.963315 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c60fc7-3b25-4a4d-88d0-231061bae9c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=05ea5625e61f40ecad97004ff4e32fa4, user_id=1eca276b92bb4be3aaab7d47e762f25d, role_id=506da913e25f44b1854b24215eb447fc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:27.966161 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c60fc7-3b25-4a4d-88d0-231061bae9c8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:27.990799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 69/135] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:31:27 2022] PUT /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4/users/1eca276b92bb4be3aaab7d47e762f25d/roles/506da913e25f44b1854b24215eb447fc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:31:27.992857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde97f6-4493-4c8e-9166-2638a8b7a588 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:27.993449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde97f6-4493-4c8e-9166-2638a8b7a588 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:27.993962 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde97f6-4493-4c8e-9166-2638a8b7a588 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:27.995795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 70/136] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:28.002082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542be6cc-6f61-4786-84e0-cd7a36e20a27 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:28.003505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542be6cc-6f61-4786-84e0-cd7a36e20a27 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:28.004192 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542be6cc-6f61-4786-84e0-cd7a36e20a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:28.026396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-542be6cc-6f61-4786-84e0-cd7a36e20a27 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:28.028230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-542be6cc-6f61-4786-84e0-cd7a36e20a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:28.043342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312c071-9be2-4c3a-8534-f39c15469f6a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:28.061855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:28.092090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437c702-7713-4c20-9512-ef02fab3932b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:28.092773 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437c702-7713-4c20-9512-ef02fab3932b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:28.093079 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437c702-7713-4c20-9512-ef02fab3932b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:28.093362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437c702-7713-4c20-9512-ef02fab3932b None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:28.094779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437c702-7713-4c20-9512-ef02fab3932b None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:28.096664 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437c702-7713-4c20-9512-ef02fab3932b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:28.098253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 67/137] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:27 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:28.104974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437c702-7713-4c20-9512-ef02fab3932b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:28.123935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 71/138] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:28.152026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d1ad2-2376-4022-8a13-dbd442e21c69 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:28.152586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d1ad2-2376-4022-8a13-dbd442e21c69 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:28.153027 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d1ad2-2376-4022-8a13-dbd442e21c69 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:28.155765 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 72/139] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:28.163018 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667de49-0c8e-4ea0-9848-b8fa43e04b83 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:28.163635 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667de49-0c8e-4ea0-9848-b8fa43e04b83 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:28.164730 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667de49-0c8e-4ea0-9848-b8fa43e04b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:28.187509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b667de49-0c8e-4ea0-9848-b8fa43e04b83 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:28.189471 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b667de49-0c8e-4ea0-9848-b8fa43e04b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:28.262835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437c702-7713-4c20-9512-ef02fab3932b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:28.279756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 73/140] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:28.284488 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667de49-0c8e-4ea0-9848-b8fa43e04b83 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:28.316111 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:28.328741 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1ca7f-ba6a-4257-bfcd-547bdc2f10d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:28.329485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1ca7f-ba6a-4257-bfcd-547bdc2f10d6 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:28.329772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1ca7f-ba6a-4257-bfcd-547bdc2f10d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:28.330050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1ca7f-ba6a-4257-bfcd-547bdc2f10d6 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4/users/5c2fa740cfd643e6a29f9d9686eada23/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:28.332993 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1ca7f-ba6a-4257-bfcd-547bdc2f10d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=05ea5625e61f40ecad97004ff4e32fa4, user_id=5c2fa740cfd643e6a29f9d9686eada23, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:28.334518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1ca7f-ba6a-4257-bfcd-547bdc2f10d6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:28.353883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 68/141] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:31:28 2022] PUT /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4/users/5c2fa740cfd643e6a29f9d9686eada23/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:31:28.355410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1ca7f-ba6a-4257-bfcd-547bdc2f10d6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:28.404776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:28.423716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667de49-0c8e-4ea0-9848-b8fa43e04b83 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:28.472891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1ca7f-ba6a-4257-bfcd-547bdc2f10d6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:28.473115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde7245-6fac-40a7-a4e6-ce7f1fb27fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:28.473763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde7245-6fac-40a7-a4e6-ce7f1fb27fb7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:28.474041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde7245-6fac-40a7-a4e6-ce7f1fb27fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:28.474319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde7245-6fac-40a7-a4e6-ce7f1fb27fb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:28.475524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde7245-6fac-40a7-a4e6-ce7f1fb27fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:28.478209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde7245-6fac-40a7-a4e6-ce7f1fb27fb7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:28.480581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 74/142] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:28.486902 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde7245-6fac-40a7-a4e6-ce7f1fb27fb7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:28.515864 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca81263-d293-4437-9202-6f0e9e705a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:28.516917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca81263-d293-4437-9202-6f0e9e705a18 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:28.517449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca81263-d293-4437-9202-6f0e9e705a18 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:28.517916 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca81263-d293-4437-9202-6f0e9e705a18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:28.530356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca81263-d293-4437-9202-6f0e9e705a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-aca81263-d293-4437-9202-6f0e9e705a18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:28.537194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:28.538537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:28.539274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:28.539274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:28.539274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:28.539274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:28.539274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:28.539274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:28.539274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:28.539274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:28.539274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:28.539274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:28.539274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:28.539274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:28.541719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 69/143] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:28.551305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca81263-d293-4437-9202-6f0e9e705a18 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:28.655892 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:28.670304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde7245-6fac-40a7-a4e6-ce7f1fb27fb7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:28.733920 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405269e5-e27a-4c76-a146-3c8262cf2c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:28.734550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405269e5-e27a-4c76-a146-3c8262cf2c27 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:28.734831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405269e5-e27a-4c76-a146-3c8262cf2c27 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:28.735103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405269e5-e27a-4c76-a146-3c8262cf2c27 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:28.735805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405269e5-e27a-4c76-a146-3c8262cf2c27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:28.737255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405269e5-e27a-4c76-a146-3c8262cf2c27 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:28.761487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca81263-d293-4437-9202-6f0e9e705a18 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:28.774409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 75/144] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:31:28 2022] POST /identity/v3/users => generated 283 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:31:28.814817 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c888d-a0d8-4524-9fd8-e8349a51ac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:28.815467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c888d-a0d8-4524-9fd8-e8349a51ac41 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:28.815754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c888d-a0d8-4524-9fd8-e8349a51ac41 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:28.816030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c888d-a0d8-4524-9fd8-e8349a51ac41 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:28.816780 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c888d-a0d8-4524-9fd8-e8349a51ac41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:28.817091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c888d-a0d8-4524-9fd8-e8349a51ac41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:28.818612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c888d-a0d8-4524-9fd8-e8349a51ac41 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:28.830064 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 70/145] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:28.836355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405269e5-e27a-4c76-a146-3c8262cf2c27 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:28.862288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:28.969239 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405269e5-e27a-4c76-a146-3c8262cf2c27 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:29.010656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f46827-f4a2-4635-be08-de116e106728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:29.011315 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f46827-f4a2-4635-be08-de116e106728 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:29.011598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f46827-f4a2-4635-be08-de116e106728 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:29.011869 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f46827-f4a2-4635-be08-de116e106728 None admin] PATH_INFO: `/v3/users/b4177059d8c24265a03fd296f8a04ea8` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:29.013049 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f46827-f4a2-4635-be08-de116e106728 None admin] RBAC: Authorizing `identity:get_user(user_id=b4177059d8c24265a03fd296f8a04ea8)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:29.014619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f46827-f4a2-4635-be08-de116e106728 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:29.016363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 76/146] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:28 2022] GET /identity/v3/users/b4177059d8c24265a03fd296f8a04ea8 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:29.021941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c888d-a0d8-4524-9fd8-e8349a51ac41 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:29.126615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c888d-a0d8-4524-9fd8-e8349a51ac41 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:29.136284 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:29.162943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e1ce0-7fb6-4d37-8b86-998426b6d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:29.163544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e1ce0-7fb6-4d37-8b86-998426b6d190 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:29.163843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e1ce0-7fb6-4d37-8b86-998426b6d190 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:29.164120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e1ce0-7fb6-4d37-8b86-998426b6d190 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:29.165312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e1ce0-7fb6-4d37-8b86-998426b6d190 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:29.166796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e1ce0-7fb6-4d37-8b86-998426b6d190 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:29.168542 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 71/147] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:29 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:29.174343 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f46827-f4a2-4635-be08-de116e106728 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:29.279690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:29.299687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f46827-f4a2-4635-be08-de116e106728 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:29.336451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4050a-4be3-41ff-ad63-54af63a6fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:29.337158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4050a-4be3-41ff-ad63-54af63a6fea7 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:29.337479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4050a-4be3-41ff-ad63-54af63a6fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:29.337750 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4050a-4be3-41ff-ad63-54af63a6fea7 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4/users/b4177059d8c24265a03fd296f8a04ea8/roles/83230fc7c4994327bedaae3eacb6067e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:29.339805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4050a-4be3-41ff-ad63-54af63a6fea7 None admin] RBAC: Authorizing `identity:create_grant(project_id=05ea5625e61f40ecad97004ff4e32fa4, user_id=b4177059d8c24265a03fd296f8a04ea8, role_id=83230fc7c4994327bedaae3eacb6067e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:29.341385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4050a-4be3-41ff-ad63-54af63a6fea7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:29.365351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 77/148] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:31:29 2022] PUT /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4/users/b4177059d8c24265a03fd296f8a04ea8/roles/83230fc7c4994327bedaae3eacb6067e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:31:30.314342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2409eea-0d4c-48df-b37c-3886d012b9ed None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:30.315425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2409eea-0d4c-48df-b37c-3886d012b9ed None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:30.316172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2409eea-0d4c-48df-b37c-3886d012b9ed None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:30.318836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 72/149] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:30.324370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5307153-2941-4c97-88b2-58a21377236c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:30.325269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5307153-2941-4c97-88b2-58a21377236c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:30.325779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5307153-2941-4c97-88b2-58a21377236c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:30.349311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c5307153-2941-4c97-88b2-58a21377236c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:30.350848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c5307153-2941-4c97-88b2-58a21377236c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:30.435672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 78/150] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:30.470805 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2409eea-0d4c-48df-b37c-3886d012b9ed None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:30.590117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2409eea-0d4c-48df-b37c-3886d012b9ed None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:30.642076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0546f9e-d120-4e48-b4de-edab34c095c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:30.643032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0546f9e-d120-4e48-b4de-edab34c095c9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:30.643504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0546f9e-d120-4e48-b4de-edab34c095c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:30.643990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0546f9e-d120-4e48-b4de-edab34c095c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:30.658605 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0546f9e-d120-4e48-b4de-edab34c095c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b0546f9e-d120-4e48-b4de-edab34c095c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:30.664687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:30.665572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:30.666335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:30.666335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:30.666335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:30.666335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:30.666335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:30.666335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:30.666335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:30.666335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:30.666335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:30.666335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:30.666335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:30.666335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:30.668799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 73/151] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:30.675430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a989320-2eef-4c26-af1e-67dfe8f212d1 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:30.675969 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a989320-2eef-4c26-af1e-67dfe8f212d1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:30.676461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a989320-2eef-4c26-af1e-67dfe8f212d1 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:30.678053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 79/152] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:30.679150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0546f9e-d120-4e48-b4de-edab34c095c9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:30.684148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc573b66-0338-42b8-a3f5-487cf8520fb5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:30.684148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc573b66-0338-42b8-a3f5-487cf8520fb5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:30.684148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc573b66-0338-42b8-a3f5-487cf8520fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:30.721692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:30.750367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fc573b66-0338-42b8-a3f5-487cf8520fb5 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:30.751584 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fc573b66-0338-42b8-a3f5-487cf8520fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:30.791416 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0546f9e-d120-4e48-b4de-edab34c095c9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:30.847567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3ffca-c49e-444a-82ae-db31f255ffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:30.848176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3ffca-c49e-444a-82ae-db31f255ffca None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:30.848510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3ffca-c49e-444a-82ae-db31f255ffca None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:30.848855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3ffca-c49e-444a-82ae-db31f255ffca None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:30.849614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3ffca-c49e-444a-82ae-db31f255ffca None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:30.849917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3ffca-c49e-444a-82ae-db31f255ffca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:30.851314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3ffca-c49e-444a-82ae-db31f255ffca None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:30.864727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 74/153] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:30.875969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3ffca-c49e-444a-82ae-db31f255ffca None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:30.876581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:30.885862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 80/154] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:30.922761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc573b66-0338-42b8-a3f5-487cf8520fb5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:31.010035 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:31.016418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3ffca-c49e-444a-82ae-db31f255ffca None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:31.066018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d3695-fb0f-4f49-b6b0-8881caa180a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:31.066677 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d3695-fb0f-4f49-b6b0-8881caa180a7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:31.066959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d3695-fb0f-4f49-b6b0-8881caa180a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:31.067234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d3695-fb0f-4f49-b6b0-8881caa180a7 None admin] PATH_INFO: `/v3/users/1eca276b92bb4be3aaab7d47e762f25d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:31.068455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d3695-fb0f-4f49-b6b0-8881caa180a7 None admin] RBAC: Authorizing `identity:get_user(user_id=1eca276b92bb4be3aaab7d47e762f25d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:31.070027 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d3695-fb0f-4f49-b6b0-8881caa180a7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:31.071968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 75/155] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:30 2022] GET /identity/v3/users/1eca276b92bb4be3aaab7d47e762f25d => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:31.077510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d3695-fb0f-4f49-b6b0-8881caa180a7 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:31.099642 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc573b66-0338-42b8-a3f5-487cf8520fb5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:31.181472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b05953-47bb-4d32-b00e-dac66890a0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:31.182183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b05953-47bb-4d32-b00e-dac66890a0a9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:31.182469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b05953-47bb-4d32-b00e-dac66890a0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:31.182751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b05953-47bb-4d32-b00e-dac66890a0a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:31.216321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d3695-fb0f-4f49-b6b0-8881caa180a7 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:31.217868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b05953-47bb-4d32-b00e-dac66890a0a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e1b05953-47bb-4d32-b00e-dac66890a0a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:31.222946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:31.223981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:31.224838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:31.224838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:31.224838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:31.224838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:31.224838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:31.224838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:31.224838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:31.224838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:31.224838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:31.224838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:31.224838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:31.224838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:31.224838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 81/156] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:31:31.230466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b05953-47bb-4d32-b00e-dac66890a0a9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:31.270275 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299d1ad-6d9f-4b40-8c1a-521a2e756896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:31.270923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299d1ad-6d9f-4b40-8c1a-521a2e756896 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:31.271206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299d1ad-6d9f-4b40-8c1a-521a2e756896 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:31.271478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299d1ad-6d9f-4b40-8c1a-521a2e756896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:31.314973 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:31.349743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:31.371393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299d1ad-6d9f-4b40-8c1a-521a2e756896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:31.372922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299d1ad-6d9f-4b40-8c1a-521a2e756896 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:31.443481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b05953-47bb-4d32-b00e-dac66890a0a9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:31.538442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 76/157] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 02:31:31.539810 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9371f-c3d6-49cb-89e4-015387764dc0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:31.540102 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9371f-c3d6-49cb-89e4-015387764dc0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:31.540380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9371f-c3d6-49cb-89e4-015387764dc0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:31.541666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 77/158] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:31.543443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad7eeb-035e-43a6-8f09-8e74a0e00b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:31.544153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7eeb-035e-43a6-8f09-8e74a0e00b77 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:31.544439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7eeb-035e-43a6-8f09-8e74a0e00b77 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:31.544767 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7eeb-035e-43a6-8f09-8e74a0e00b77 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:31.545635 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad7eeb-035e-43a6-8f09-8e74a0e00b77 None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:31.545945 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad7eeb-035e-43a6-8f09-8e74a0e00b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:31.547370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad7eeb-035e-43a6-8f09-8e74a0e00b77 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:31.548042 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9371f-c3d6-49cb-89e4-015387764dc0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:31.562964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 82/159] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:31.564238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4850ee-6e6e-49a9-80bf-1be13e466b72 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:31.564526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4850ee-6e6e-49a9-80bf-1be13e466b72 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:31.564804 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4850ee-6e6e-49a9-80bf-1be13e466b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:31.597711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7f4850ee-6e6e-49a9-80bf-1be13e466b72 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:31.598921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7f4850ee-6e6e-49a9-80bf-1be13e466b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:31.684605 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:31.731190 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9371f-c3d6-49cb-89e4-015387764dc0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:31.782706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2285a87-bc07-4309-a42b-7c433571b5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:31.783372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285a87-bc07-4309-a42b-7c433571b5f0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:31.783648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285a87-bc07-4309-a42b-7c433571b5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:31.783918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2285a87-bc07-4309-a42b-7c433571b5f0 None admin] PATH_INFO: `/v3/projects/b32434e651e54d4295ca7883fe711b27` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:31.785446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2285a87-bc07-4309-a42b-7c433571b5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=b32434e651e54d4295ca7883fe711b27)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:31.787048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2285a87-bc07-4309-a42b-7c433571b5f0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:31.789315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 78/160] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:31 2022] GET /identity/v3/projects/b32434e651e54d4295ca7883fe711b27 => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:31.791249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2285a87-bc07-4309-a42b-7c433571b5f0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:31.825131 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 83/161] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:31.825895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4850ee-6e6e-49a9-80bf-1be13e466b72 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:31.935719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2285a87-bc07-4309-a42b-7c433571b5f0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:31.984835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:31.985266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df3af8-488c-4073-8ded-5645bd114f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:31.986283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df3af8-488c-4073-8ded-5645bd114f1f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:31.986283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df3af8-488c-4073-8ded-5645bd114f1f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:31.986561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df3af8-488c-4073-8ded-5645bd114f1f None admin] PATH_INFO: `/v3/users/1eca276b92bb4be3aaab7d47e762f25d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:31.989118 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df3af8-488c-4073-8ded-5645bd114f1f None admin] RBAC: Authorizing `identity:get_user(user_id=1eca276b92bb4be3aaab7d47e762f25d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:31.990632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df3af8-488c-4073-8ded-5645bd114f1f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:31.992287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 79/162] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:31 2022] GET /identity/v3/users/1eca276b92bb4be3aaab7d47e762f25d => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:31.993191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df3af8-488c-4073-8ded-5645bd114f1f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:31.997084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:32.126220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4850ee-6e6e-49a9-80bf-1be13e466b72 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:32.138159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df3af8-488c-4073-8ded-5645bd114f1f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:32.186640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e124f-ac01-4d37-9c91-0ae6c9bad9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:32.187247 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e124f-ac01-4d37-9c91-0ae6c9bad9ad None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:32.187701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e124f-ac01-4d37-9c91-0ae6c9bad9ad None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:32.187978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e124f-ac01-4d37-9c91-0ae6c9bad9ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:32.188795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e124f-ac01-4d37-9c91-0ae6c9bad9ad None admin] RBAC: Adding query filter params (role.id=d93e06f63f2947f98ad9a668b80929dc, scope.project.id=b32434e651e54d4295ca7883fe711b27, user.id=1eca276b92bb4be3aaab7d47e762f25d) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:32.189106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e124f-ac01-4d37-9c91-0ae6c9bad9ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:32.190966 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e124f-ac01-4d37-9c91-0ae6c9bad9ad None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:32.197465 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 84/163] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:31 2022] GET /identity/v3/role_assignments?user.id=1eca276b92bb4be3aaab7d47e762f25d&scope.project.id=b32434e651e54d4295ca7883fe711b27&role.id=d93e06f63f2947f98ad9a668b80929dc => generated 608 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:32.198113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e124f-ac01-4d37-9c91-0ae6c9bad9ad None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:32.199091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269959f-bddb-40a0-ba41-fd69413d509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:32.199747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269959f-bddb-40a0-ba41-fd69413d509f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:32.200031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269959f-bddb-40a0-ba41-fd69413d509f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:32.200300 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269959f-bddb-40a0-ba41-fd69413d509f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:32.216809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b269959f-bddb-40a0-ba41-fd69413d509f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b269959f-bddb-40a0-ba41-fd69413d509f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:32.231694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:32.232689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:32.233494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:32.233494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:32.233494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:32.233494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:32.233494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:32.233494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:32.233494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:32.233494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:32.233494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:32.233494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:32.233494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:32.233494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:32.233494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 80/164] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:31:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:32.242386 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269959f-bddb-40a0-ba41-fd69413d509f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:32.310107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e124f-ac01-4d37-9c91-0ae6c9bad9ad None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:32.327823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:32.349842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:32.352205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b0736-369b-42f9-aa6d-c15fe1ee2ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:32.352864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b0736-369b-42f9-aa6d-c15fe1ee2ae7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:32.353147 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b0736-369b-42f9-aa6d-c15fe1ee2ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:32.353463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b0736-369b-42f9-aa6d-c15fe1ee2ae7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:32.405358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269959f-bddb-40a0-ba41-fd69413d509f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:32.455660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b0736-369b-42f9-aa6d-c15fe1ee2ae7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:32.457053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b0736-369b-42f9-aa6d-c15fe1ee2ae7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:32.474640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2506bb2-1c56-4cfe-81d7-fe49ab2943b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:32.475286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2506bb2-1c56-4cfe-81d7-fe49ab2943b5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:32.475563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2506bb2-1c56-4cfe-81d7-fe49ab2943b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:32.475830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2506bb2-1c56-4cfe-81d7-fe49ab2943b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:32.476557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2506bb2-1c56-4cfe-81d7-fe49ab2943b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:32.476859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2506bb2-1c56-4cfe-81d7-fe49ab2943b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:32.478295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2506bb2-1c56-4cfe-81d7-fe49ab2943b5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:32.493056 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 81/165] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:31:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:32.497303 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441aca4e-2162-47ca-aaad-c4130700f38e None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:32.497600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441aca4e-2162-47ca-aaad-c4130700f38e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:32.497925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441aca4e-2162-47ca-aaad-c4130700f38e None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:32.499333 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 82/166] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:31:32.500131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441aca4e-2162-47ca-aaad-c4130700f38e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:32.616196 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 85/167] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:32.617313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f27f6d-b579-47a2-960a-5424578886f5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:32.625859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f27f6d-b579-47a2-960a-5424578886f5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:32.626187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f27f6d-b579-47a2-960a-5424578886f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:32.660634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a3f27f6d-b579-47a2-960a-5424578886f5 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:32.661869 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a3f27f6d-b579-47a2-960a-5424578886f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:32.678378 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:32.739866 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441aca4e-2162-47ca-aaad-c4130700f38e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:32.772046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 86/168] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:32.772733 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f27f6d-b579-47a2-960a-5424578886f5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:32.789636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:32.817425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28750186-3d42-4003-8b5f-df759edcc60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:32.818085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28750186-3d42-4003-8b5f-df759edcc60b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:32.818364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28750186-3d42-4003-8b5f-df759edcc60b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:32.818631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28750186-3d42-4003-8b5f-df759edcc60b None admin] PATH_INFO: `/v3/users/1eca276b92bb4be3aaab7d47e762f25d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:32.819821 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28750186-3d42-4003-8b5f-df759edcc60b None admin] RBAC: Authorizing `identity:get_user(user_id=1eca276b92bb4be3aaab7d47e762f25d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:32.821377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28750186-3d42-4003-8b5f-df759edcc60b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:32.823201 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 83/169] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:32 2022] GET /identity/v3/users/1eca276b92bb4be3aaab7d47e762f25d => generated 275 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:32.823796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28750186-3d42-4003-8b5f-df759edcc60b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:32.922385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f27f6d-b579-47a2-960a-5424578886f5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:32.974210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8207395-b3ec-45be-b912-4f4eb4930996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:32.974870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8207395-b3ec-45be-b912-4f4eb4930996 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:32.975149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8207395-b3ec-45be-b912-4f4eb4930996 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:32.975421 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8207395-b3ec-45be-b912-4f4eb4930996 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:32.976653 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8207395-b3ec-45be-b912-4f4eb4930996 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:32.978147 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8207395-b3ec-45be-b912-4f4eb4930996 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:32.985649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 87/170] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:32 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:32.986541 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8207395-b3ec-45be-b912-4f4eb4930996 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:33.017756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:33.111552 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28750186-3d42-4003-8b5f-df759edcc60b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:33.147376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8207395-b3ec-45be-b912-4f4eb4930996 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:33.176143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a41d-9426-4b7f-bc46-6244d9b8045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:33.176804 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a41d-9426-4b7f-bc46-6244d9b8045b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:33.180092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a41d-9426-4b7f-bc46-6244d9b8045b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:33.180369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a41d-9426-4b7f-bc46-6244d9b8045b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:33.198833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7a41d-9426-4b7f-bc46-6244d9b8045b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:33.208964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f5773-e580-413b-b44c-a6396f44b087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:33.209624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f5773-e580-413b-b44c-a6396f44b087 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:33.209903 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f5773-e580-413b-b44c-a6396f44b087 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:33.210176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f5773-e580-413b-b44c-a6396f44b087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b7b7a41d-9426-4b7f-bc46-6244d9b8045b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:33.211551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:33.212400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:33.213183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:33.213183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:33.213183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:33.213183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:33.213183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:33.213183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:33.213183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:33.213183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:33.213183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:33.213183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:33.213183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:33.213183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:33.214949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 84/171] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:31:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:33.215757 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a41d-9426-4b7f-bc46-6244d9b8045b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:33.329404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f5773-e580-413b-b44c-a6396f44b087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:33.329404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f5773-e580-413b-b44c-a6396f44b087 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:33.341324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:33.344244 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:33.394660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7a41d-9426-4b7f-bc46-6244d9b8045b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:33.429354 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221be863-475d-48c3-8be9-b360119e4d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:33.430352 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be863-475d-48c3-8be9-b360119e4d0f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:33.430768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be863-475d-48c3-8be9-b360119e4d0f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:33.431254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be863-475d-48c3-8be9-b360119e4d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:33.432179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221be863-475d-48c3-8be9-b360119e4d0f None admin] RBAC: Adding query filter params (role.id=d93e06f63f2947f98ad9a668b80929dc, scope.project.id=05ea5625e61f40ecad97004ff4e32fa4, user.id=1eca276b92bb4be3aaab7d47e762f25d) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:33.432637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221be863-475d-48c3-8be9-b360119e4d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:33.434267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221be863-475d-48c3-8be9-b360119e4d0f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:33.434795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 88/172] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:33.440627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f5773-e580-413b-b44c-a6396f44b087 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:33.446767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 85/173] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:33 2022] GET /identity/v3/role_assignments?user.id=1eca276b92bb4be3aaab7d47e762f25d&scope.project.id=05ea5625e61f40ecad97004ff4e32fa4&role.id=d93e06f63f2947f98ad9a668b80929dc => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:33.448076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d84ac-7b13-422b-a502-643ab1b1fb45 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:33.448339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d84ac-7b13-422b-a502-643ab1b1fb45 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:33.448613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d84ac-7b13-422b-a502-643ab1b1fb45 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:33.454472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 86/174] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:33.454472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31777-271f-4983-88e0-67cfc15d3852 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:33.454472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31777-271f-4983-88e0-67cfc15d3852 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:33.454472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec31777-271f-4983-88e0-67cfc15d3852 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:33.462364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 87/175] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:33.463677 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec31777-271f-4983-88e0-67cfc15d3852 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:33.562969 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f5773-e580-413b-b44c-a6396f44b087 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:33.596069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:33.603384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba8476-7672-4a52-b39e-a37af12692ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:33.604638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba8476-7672-4a52-b39e-a37af12692ac None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:33.605060 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba8476-7672-4a52-b39e-a37af12692ac None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:33.605515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba8476-7672-4a52-b39e-a37af12692ac None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:33.606424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba8476-7672-4a52-b39e-a37af12692ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:33.606861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba8476-7672-4a52-b39e-a37af12692ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:33.608505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba8476-7672-4a52-b39e-a37af12692ac None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:33.618780 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 89/176] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:33.620720 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e37b4-ee8e-4dee-aad7-c18163490b87 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:33.621145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e37b4-ee8e-4dee-aad7-c18163490b87 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:33.621634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e37b4-ee8e-4dee-aad7-c18163490b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:33.662540 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-433e37b4-ee8e-4dee-aad7-c18163490b87 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:33.663875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-433e37b4-ee8e-4dee-aad7-c18163490b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:33.676020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec31777-271f-4983-88e0-67cfc15d3852 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:33.698228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:33.726506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf5364-c1c5-457c-94ed-5a046582d1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:33.727162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf5364-c1c5-457c-94ed-5a046582d1f1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:33.727441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf5364-c1c5-457c-94ed-5a046582d1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:33.727717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf5364-c1c5-457c-94ed-5a046582d1f1 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:33.729642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf5364-c1c5-457c-94ed-5a046582d1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:33.731424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf5364-c1c5-457c-94ed-5a046582d1f1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:33.733841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 88/177] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:33 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:33.735140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fa224-542f-4224-b28e-65f2ad4ff525 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:33.735256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fa224-542f-4224-b28e-65f2ad4ff525 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:33.735532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fa224-542f-4224-b28e-65f2ad4ff525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:33.747756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 90/178] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:33.749328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e37b4-ee8e-4dee-aad7-c18163490b87 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:33.766378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c04fa224-542f-4224-b28e-65f2ad4ff525 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:33.767586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c04fa224-542f-4224-b28e-65f2ad4ff525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:33.838551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 89/179] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:33.847036 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7a151-2b38-4ee6-9322-53f3bf7414c5 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:33.847328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7a151-2b38-4ee6-9322-53f3bf7414c5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:33.847896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7a151-2b38-4ee6-9322-53f3bf7414c5 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:33.849825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 90/180] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:33.850862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7a151-2b38-4ee6-9322-53f3bf7414c5 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:33.869038 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e37b4-ee8e-4dee-aad7-c18163490b87 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:33.878424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:33.905092 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f583de-0132-4d42-be47-17871db096bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:33.905772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f583de-0132-4d42-be47-17871db096bd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:33.906050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f583de-0132-4d42-be47-17871db096bd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:33.906321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f583de-0132-4d42-be47-17871db096bd None admin] PATH_INFO: `/v3/users/5c2fa740cfd643e6a29f9d9686eada23` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:33.907474 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f583de-0132-4d42-be47-17871db096bd None admin] RBAC: Authorizing `identity:get_user(user_id=5c2fa740cfd643e6a29f9d9686eada23)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:33.908933 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f583de-0132-4d42-be47-17871db096bd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:33.910689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 91/181] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:33 2022] GET /identity/v3/users/5c2fa740cfd643e6a29f9d9686eada23 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:33.911345 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f583de-0132-4d42-be47-17871db096bd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:33.957684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7a151-2b38-4ee6-9322-53f3bf7414c5 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:33.971345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:33.993101 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04f80d-7cc4-4cc0-af8a-2b54f81a60a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:33.993783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04f80d-7cc4-4cc0-af8a-2b54f81a60a2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:33.994056 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04f80d-7cc4-4cc0-af8a-2b54f81a60a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:33.994325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04f80d-7cc4-4cc0-af8a-2b54f81a60a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:33.995117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04f80d-7cc4-4cc0-af8a-2b54f81a60a2 None admin] RBAC: Adding query filter params (role.id=506da913e25f44b1854b24215eb447fc, scope.project.id=05ea5625e61f40ecad97004ff4e32fa4, user.id=1eca276b92bb4be3aaab7d47e762f25d) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:33.995426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04f80d-7cc4-4cc0-af8a-2b54f81a60a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:33.996879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04f80d-7cc4-4cc0-af8a-2b54f81a60a2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:34.002640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 91/182] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:33 2022] GET /identity/v3/role_assignments?user.id=1eca276b92bb4be3aaab7d47e762f25d&scope.project.id=05ea5625e61f40ecad97004ff4e32fa4&role.id=506da913e25f44b1854b24215eb447fc => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:34.003760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c0bcc-39d5-4542-bc9e-4b24667eb6e4 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:34.004038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c0bcc-39d5-4542-bc9e-4b24667eb6e4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:34.004312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c0bcc-39d5-4542-bc9e-4b24667eb6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:34.013152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f583de-0132-4d42-be47-17871db096bd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:34.026316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-299c0bcc-39d5-4542-bc9e-4b24667eb6e4 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:34.027892 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-299c0bcc-39d5-4542-bc9e-4b24667eb6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:34.056079 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764c64d-e9f2-43e6-a9c2-6a8fe711920e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:34.056754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764c64d-e9f2-43e6-a9c2-6a8fe711920e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:34.057034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764c64d-e9f2-43e6-a9c2-6a8fe711920e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:34.057337 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764c64d-e9f2-43e6-a9c2-6a8fe711920e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:34.069813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764c64d-e9f2-43e6-a9c2-6a8fe711920e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-8764c64d-e9f2-43e6-a9c2-6a8fe711920e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:34.074950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:34.075914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:34.076813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:34.076813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:34.076813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:34.076813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:34.076813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:34.076813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:34.076813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:34.076813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:34.076813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:34.076813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:34.076813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:34.076813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:34.076813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 92/183] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:34.077512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764c64d-e9f2-43e6-a9c2-6a8fe711920e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:34.110707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 92/184] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:34.115265 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:34.122871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eb511-7939-438f-9e40-4ae2165b0675 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:34.123175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eb511-7939-438f-9e40-4ae2165b0675 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:34.123432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8eb511-7939-438f-9e40-4ae2165b0675 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:34.125575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 93/185] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:34 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:34.125743 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8eb511-7939-438f-9e40-4ae2165b0675 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:34.196371 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764c64d-e9f2-43e6-a9c2-6a8fe711920e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:34.237799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07855a3c-60ed-4b0e-be20-5ad1c5e9647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:34.238451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07855a3c-60ed-4b0e-be20-5ad1c5e9647f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:34.238732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07855a3c-60ed-4b0e-be20-5ad1c5e9647f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:34.239004 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07855a3c-60ed-4b0e-be20-5ad1c5e9647f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:34.248920 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07855a3c-60ed-4b0e-be20-5ad1c5e9647f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-07855a3c-60ed-4b0e-be20-5ad1c5e9647f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:34.253883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:34.254906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:34.255714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:34.255714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:34.255714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:34.255714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:34.255714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:34.255714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:34.255714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:34.255714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:34.255714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:34.255714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:34.255714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:34.255714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:34.255714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 93/186] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:31:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:34.256356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07855a3c-60ed-4b0e-be20-5ad1c5e9647f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:34.259230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8eb511-7939-438f-9e40-4ae2165b0675 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:34.268774 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:34.293731 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2666cf-48fd-47df-8d68-9e63a00fb2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:34.294348 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2666cf-48fd-47df-8d68-9e63a00fb2cc None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:34.294600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2666cf-48fd-47df-8d68-9e63a00fb2cc None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:34.294898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2666cf-48fd-47df-8d68-9e63a00fb2cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:34.348436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:34.355961 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07855a3c-60ed-4b0e-be20-5ad1c5e9647f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:34.360900 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2666cf-48fd-47df-8d68-9e63a00fb2cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:34.362452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2666cf-48fd-47df-8d68-9e63a00fb2cc None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:34.390190 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aca1d7-7534-4144-9ca2-a1e5c97e0868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:34.390814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aca1d7-7534-4144-9ca2-a1e5c97e0868 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:34.391103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aca1d7-7534-4144-9ca2-a1e5c97e0868 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:34.391374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aca1d7-7534-4144-9ca2-a1e5c97e0868 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:34.392086 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aca1d7-7534-4144-9ca2-a1e5c97e0868 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:34.392388 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aca1d7-7534-4144-9ca2-a1e5c97e0868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:34.393813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aca1d7-7534-4144-9ca2-a1e5c97e0868 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:34.401781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 94/187] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:34.402942 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d1d12-c543-4600-ac12-e218b05ed05c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:34.403224 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d1d12-c543-4600-ac12-e218b05ed05c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:34.403495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d1d12-c543-4600-ac12-e218b05ed05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:34.420851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1a9d1d12-c543-4600-ac12-e218b05ed05c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:34.422090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1a9d1d12-c543-4600-ac12-e218b05ed05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:34.460024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 94/188] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:34.460860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2666cf-48fd-47df-8d68-9e63a00fb2cc None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:34.470715 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:34.493034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 95/189] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:34.493927 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d1d12-c543-4600-ac12-e218b05ed05c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:34.563647 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2666cf-48fd-47df-8d68-9e63a00fb2cc None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:34.578339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:34.593271 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d1d12-c543-4600-ac12-e218b05ed05c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:34.598854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d83ae1-11c1-40c8-9018-50c1a78f6180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:34.599500 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d83ae1-11c1-40c8-9018-50c1a78f6180 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:34.599778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d83ae1-11c1-40c8-9018-50c1a78f6180 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:34.600046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d83ae1-11c1-40c8-9018-50c1a78f6180 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:34.610407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d83ae1-11c1-40c8-9018-50c1a78f6180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-f0d83ae1-11c1-40c8-9018-50c1a78f6180 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:34.615435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:34.616448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:34.617224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:34.617224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:34.617224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:34.617224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:34.617224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:34.617224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:34.617224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:34.617224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:34.617224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:34.617224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:34.617224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:34.617224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:34.617224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 95/190] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:31:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:34.617902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d83ae1-11c1-40c8-9018-50c1a78f6180 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:34.630485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78e9d7-265d-4db9-8c6f-666fd2f4d00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:34.631165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78e9d7-265d-4db9-8c6f-666fd2f4d00f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:34.631507 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78e9d7-265d-4db9-8c6f-666fd2f4d00f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:34.631876 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78e9d7-265d-4db9-8c6f-666fd2f4d00f None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:34.632508 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78e9d7-265d-4db9-8c6f-666fd2f4d00f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:34.632805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78e9d7-265d-4db9-8c6f-666fd2f4d00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:34.634223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78e9d7-265d-4db9-8c6f-666fd2f4d00f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:34.642424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 96/191] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:34.646191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78e9d7-265d-4db9-8c6f-666fd2f4d00f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:34.682858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:34.716039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d83ae1-11c1-40c8-9018-50c1a78f6180 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:34.742635 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78e9d7-265d-4db9-8c6f-666fd2f4d00f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:34.750705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0a9d0-850a-40e4-9c80-4f2ca3e7af2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:34.751344 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0a9d0-850a-40e4-9c80-4f2ca3e7af2f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:34.751612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0a9d0-850a-40e4-9c80-4f2ca3e7af2f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:34.751886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0a9d0-850a-40e4-9c80-4f2ca3e7af2f None admin] PATH_INFO: `/v3/users/b4177059d8c24265a03fd296f8a04ea8` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:34.753076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0a9d0-850a-40e4-9c80-4f2ca3e7af2f None admin] RBAC: Authorizing `identity:get_user(user_id=b4177059d8c24265a03fd296f8a04ea8)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:34.754589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0a9d0-850a-40e4-9c80-4f2ca3e7af2f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:34.756311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 96/192] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:34 2022] GET /identity/v3/users/b4177059d8c24265a03fd296f8a04ea8 => generated 289 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:34.757068 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0a9d0-850a-40e4-9c80-4f2ca3e7af2f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:34.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1718cb1-5350-4284-93ac-755ac1f1a960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:34.781891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1718cb1-5350-4284-93ac-755ac1f1a960 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:34.782176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1718cb1-5350-4284-93ac-755ac1f1a960 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:34.782450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1718cb1-5350-4284-93ac-755ac1f1a960 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:34.783639 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1718cb1-5350-4284-93ac-755ac1f1a960 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:34.785081 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1718cb1-5350-4284-93ac-755ac1f1a960 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:34.786828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 97/193] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:34 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:34.787581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1718cb1-5350-4284-93ac-755ac1f1a960 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:34.805152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:34.860396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0a9d0-850a-40e4-9c80-4f2ca3e7af2f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:34.887694 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1718cb1-5350-4284-93ac-755ac1f1a960 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:34.892857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5f9b9-801a-42cb-b26a-519faeb3f8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:34.893531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5f9b9-801a-42cb-b26a-519faeb3f8e2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:34.893815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5f9b9-801a-42cb-b26a-519faeb3f8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:34.894086 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5f9b9-801a-42cb-b26a-519faeb3f8e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:34.895229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5f9b9-801a-42cb-b26a-519faeb3f8e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:34.896689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5f9b9-801a-42cb-b26a-519faeb3f8e2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:34.898322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 97/194] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:34.903085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5f9b9-801a-42cb-b26a-519faeb3f8e2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:34.904401 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:34.921933 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2516a9-062e-4f06-8f87-eb3ac725dcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:34.922571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2516a9-062e-4f06-8f87-eb3ac725dcf6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:34.922827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2516a9-062e-4f06-8f87-eb3ac725dcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:34.923099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2516a9-062e-4f06-8f87-eb3ac725dcf6 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:34.923823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2516a9-062e-4f06-8f87-eb3ac725dcf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:34.924128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2516a9-062e-4f06-8f87-eb3ac725dcf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:34.925550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2516a9-062e-4f06-8f87-eb3ac725dcf6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:34.934364 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 98/195] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:31:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:34.935149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2516a9-062e-4f06-8f87-eb3ac725dcf6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:35.001524 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5f9b9-801a-42cb-b26a-519faeb3f8e2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:35.012958 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:35.034597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644239aa-0957-49fd-bab9-3e236a808fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:35.034768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2516a9-062e-4f06-8f87-eb3ac725dcf6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:35.035241 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644239aa-0957-49fd-bab9-3e236a808fbd None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:35.035540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644239aa-0957-49fd-bab9-3e236a808fbd None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:35.035818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644239aa-0957-49fd-bab9-3e236a808fbd None admin] PATH_INFO: `/v3/users/d0b238c7801242ed8e2b3c6463bbb0be` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:35.049827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644239aa-0957-49fd-bab9-3e236a808fbd None admin] RBAC: Authorizing `identity:get_user(user_id=d0b238c7801242ed8e2b3c6463bbb0be)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:35.051306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644239aa-0957-49fd-bab9-3e236a808fbd None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:35.053004 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 98/196] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:34 2022] GET /identity/v3/users/d0b238c7801242ed8e2b3c6463bbb0be => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:35.053754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644239aa-0957-49fd-bab9-3e236a808fbd None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:35.071158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee4334-c77f-439b-ba02-f4ecefa51f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:35.071778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee4334-c77f-439b-ba02-f4ecefa51f78 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:35.072056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee4334-c77f-439b-ba02-f4ecefa51f78 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:35.072542 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee4334-c77f-439b-ba02-f4ecefa51f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:35.116497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:35.144876 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee4334-c77f-439b-ba02-f4ecefa51f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:35.146449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee4334-c77f-439b-ba02-f4ecefa51f78 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:35.159959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644239aa-0957-49fd-bab9-3e236a808fbd None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:35.199791 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68119651-bfec-41ec-8dfc-749a2b7ea444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:35.200725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68119651-bfec-41ec-8dfc-749a2b7ea444 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:35.201492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68119651-bfec-41ec-8dfc-749a2b7ea444 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:35.201842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68119651-bfec-41ec-8dfc-749a2b7ea444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:35.202918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68119651-bfec-41ec-8dfc-749a2b7ea444 None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=05ea5625e61f40ecad97004ff4e32fa4, user.id=5c2fa740cfd643e6a29f9d9686eada23) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:35.203229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68119651-bfec-41ec-8dfc-749a2b7ea444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:35.205585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68119651-bfec-41ec-8dfc-749a2b7ea444 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:35.221331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 99/197] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:35 2022] GET /identity/v3/role_assignments?user.id=5c2fa740cfd643e6a29f9d9686eada23&scope.project.id=05ea5625e61f40ecad97004ff4e32fa4&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:35.221331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68119651-bfec-41ec-8dfc-749a2b7ea444 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:35.225374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:35.255533 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 99/198] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:35.256523 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee4334-c77f-439b-ba02-f4ecefa51f78 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:35.355016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68119651-bfec-41ec-8dfc-749a2b7ea444 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:35.369048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee4334-c77f-439b-ba02-f4ecefa51f78 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:35.394221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:35.397757 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae9680-2f30-486b-af23-f371c304d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:35.398804 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae9680-2f30-486b-af23-f371c304d3d1 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:35.399088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae9680-2f30-486b-af23-f371c304d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:35.399360 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae9680-2f30-486b-af23-f371c304d3d1 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:35.400083 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae9680-2f30-486b-af23-f371c304d3d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:35.402453 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae9680-2f30-486b-af23-f371c304d3d1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:35.425157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0c6de-5f09-49b5-9546-14b19a180510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:35.425883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0c6de-5f09-49b5-9546-14b19a180510 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:35.426166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0c6de-5f09-49b5-9546-14b19a180510 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:35.426505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0c6de-5f09-49b5-9546-14b19a180510 None admin] PATH_INFO: `/v3/users/d0b238c7801242ed8e2b3c6463bbb0be` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:35.428548 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0c6de-5f09-49b5-9546-14b19a180510 None admin] RBAC: Authorizing `identity:get_user(user_id=d0b238c7801242ed8e2b3c6463bbb0be)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:35.430072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0c6de-5f09-49b5-9546-14b19a180510 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:35.432028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 100/199] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:35 2022] GET /identity/v3/users/d0b238c7801242ed8e2b3c6463bbb0be => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:35.432816 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0c6de-5f09-49b5-9546-14b19a180510 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:35.441359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 100/200] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:31:35 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:31:35.441359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae9680-2f30-486b-af23-f371c304d3d1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:35.508357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:35.584534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae9680-2f30-486b-af23-f371c304d3d1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:35.587210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0c6de-5f09-49b5-9546-14b19a180510 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:35.625164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07e6ff-636e-4516-b5bd-fcb8fe478dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:35.625861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07e6ff-636e-4516-b5bd-fcb8fe478dc6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:35.626145 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07e6ff-636e-4516-b5bd-fcb8fe478dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:35.626413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07e6ff-636e-4516-b5bd-fcb8fe478dc6 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:35.627587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07e6ff-636e-4516-b5bd-fcb8fe478dc6 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:35.630481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84144-5e10-4dbc-b8a0-e645f7285294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:35.630481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84144-5e10-4dbc-b8a0-e645f7285294 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:35.630678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07e6ff-636e-4516-b5bd-fcb8fe478dc6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:35.630746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84144-5e10-4dbc-b8a0-e645f7285294 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:35.630746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84144-5e10-4dbc-b8a0-e645f7285294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:35.636367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 101/201] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:35 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:35.636367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07e6ff-636e-4516-b5bd-fcb8fe478dc6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:35.688516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:35.717427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e84144-5e10-4dbc-b8a0-e645f7285294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:35.718923 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e84144-5e10-4dbc-b8a0-e645f7285294 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:35.757720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07e6ff-636e-4516-b5bd-fcb8fe478dc6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:35.776318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:35.798814 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade75b2-fd0c-4cb7-864e-5b76743a7e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:35.799438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade75b2-fd0c-4cb7-864e-5b76743a7e80 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:35.799721 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade75b2-fd0c-4cb7-864e-5b76743a7e80 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:35.799997 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade75b2-fd0c-4cb7-864e-5b76743a7e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:35.855547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 101/202] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:35.856892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84144-5e10-4dbc-b8a0-e645f7285294 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:35.877951 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade75b2-fd0c-4cb7-864e-5b76743a7e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:35.879487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade75b2-fd0c-4cb7-864e-5b76743a7e80 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:35.931101 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:35.966462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84144-5e10-4dbc-b8a0-e645f7285294 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:35.985375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 102/203] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:35.986048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade75b2-fd0c-4cb7-864e-5b76743a7e80 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:36.008266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ef7d4-070c-4006-9833-17d26bc31845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:36.008898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ef7d4-070c-4006-9833-17d26bc31845 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:36.009180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ef7d4-070c-4006-9833-17d26bc31845 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:36.009505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ef7d4-070c-4006-9833-17d26bc31845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:36.010310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ef7d4-070c-4006-9833-17d26bc31845 None admin] RBAC: Adding query filter params (role.id=83230fc7c4994327bedaae3eacb6067e, scope.project.id=05ea5625e61f40ecad97004ff4e32fa4, user.id=b4177059d8c24265a03fd296f8a04ea8) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:36.010622 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ef7d4-070c-4006-9833-17d26bc31845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:36.012088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ef7d4-070c-4006-9833-17d26bc31845 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:36.018471 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 102/204] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:35 2022] GET /identity/v3/role_assignments?user.id=b4177059d8c24265a03fd296f8a04ea8&scope.project.id=05ea5625e61f40ecad97004ff4e32fa4&role.id=83230fc7c4994327bedaae3eacb6067e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:36.019362 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ef7d4-070c-4006-9833-17d26bc31845 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:36.032090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:36.145904 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade75b2-fd0c-4cb7-864e-5b76743a7e80 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:36.187521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046e0ea-d225-44e0-8d96-5d44fcb491cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:36.188183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e0ea-d225-44e0-8d96-5d44fcb491cb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:36.188464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e0ea-d225-44e0-8d96-5d44fcb491cb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:36.188739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e0ea-d225-44e0-8d96-5d44fcb491cb None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:36.190711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046e0ea-d225-44e0-8d96-5d44fcb491cb None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:36.192205 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046e0ea-d225-44e0-8d96-5d44fcb491cb None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:36.194291 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 103/205] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:35 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:36.206351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046e0ea-d225-44e0-8d96-5d44fcb491cb None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:36.219506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ef7d4-070c-4006-9833-17d26bc31845 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:36.228328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:36.273579 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918729e8-22a4-412b-8de6-e48d6e532163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:36.274293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918729e8-22a4-412b-8de6-e48d6e532163 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:36.274578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918729e8-22a4-412b-8de6-e48d6e532163 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:36.274851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918729e8-22a4-412b-8de6-e48d6e532163 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:36.277391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918729e8-22a4-412b-8de6-e48d6e532163 None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:36.279318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918729e8-22a4-412b-8de6-e48d6e532163 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:36.282153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 103/206] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:36 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:36.289368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918729e8-22a4-412b-8de6-e48d6e532163 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:36.337948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046e0ea-d225-44e0-8d96-5d44fcb491cb None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:36.378735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591346d-7938-460e-b86f-7cc881ceb162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:36.379403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591346d-7938-460e-b86f-7cc881ceb162 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:36.379671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591346d-7938-460e-b86f-7cc881ceb162 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:36.379938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591346d-7938-460e-b86f-7cc881ceb162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:36.380749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591346d-7938-460e-b86f-7cc881ceb162 None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=7983d7c8afd94591898d105faa79f3ec, user.id=d0b238c7801242ed8e2b3c6463bbb0be) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:36.381053 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591346d-7938-460e-b86f-7cc881ceb162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:36.382570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591346d-7938-460e-b86f-7cc881ceb162 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:36.389701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 104/207] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:36 2022] GET /identity/v3/role_assignments?user.id=d0b238c7801242ed8e2b3c6463bbb0be&scope.project.id=7983d7c8afd94591898d105faa79f3ec&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:36.392901 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:36.419741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918729e8-22a4-412b-8de6-e48d6e532163 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:36.459829 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d3184-e449-4fb6-a7dc-763d8cfe2e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:36.460777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d3184-e449-4fb6-a7dc-763d8cfe2e3c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:36.461260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d3184-e449-4fb6-a7dc-763d8cfe2e3c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:36.461700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d3184-e449-4fb6-a7dc-763d8cfe2e3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:36.462670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d3184-e449-4fb6-a7dc-763d8cfe2e3c None admin] RBAC: Adding query filter params (role.id=506da913e25f44b1854b24215eb447fc, scope.project.id=7983d7c8afd94591898d105faa79f3ec, user.id=d0b238c7801242ed8e2b3c6463bbb0be) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:36.463152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d3184-e449-4fb6-a7dc-763d8cfe2e3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:36.464800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d3184-e449-4fb6-a7dc-763d8cfe2e3c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:36.472201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 104/208] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:36 2022] GET /identity/v3/role_assignments?user.id=d0b238c7801242ed8e2b3c6463bbb0be&scope.project.id=7983d7c8afd94591898d105faa79f3ec&role.id=506da913e25f44b1854b24215eb447fc => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:37.680056 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb4424-442d-4c89-8cc4-249c25e30aa9 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:37.680593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb4424-442d-4c89-8cc4-249c25e30aa9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:37.680593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb4424-442d-4c89-8cc4-249c25e30aa9 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:37.682255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 105/209] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:37.689845 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794317d0-ac5f-4725-bf91-e02a4933bc0a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:37.690245 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794317d0-ac5f-4725-bf91-e02a4933bc0a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:37.690563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794317d0-ac5f-4725-bf91-e02a4933bc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:37.709102 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-794317d0-ac5f-4725-bf91-e02a4933bc0a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:37.710328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-794317d0-ac5f-4725-bf91-e02a4933bc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:37.732976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c93b1d-c4f6-4dfe-8308-1dfa52611a61 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:37.733348 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c93b1d-c4f6-4dfe-8308-1dfa52611a61 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:37.733565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c93b1d-c4f6-4dfe-8308-1dfa52611a61 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:37.735163 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 106/210] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:37.739918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c2cc0-f3ab-4010-9c9a-81572eced95c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:37.740203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c2cc0-f3ab-4010-9c9a-81572eced95c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:37.740476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c2cc0-f3ab-4010-9c9a-81572eced95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:37.758359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e57c2cc0-f3ab-4010-9c9a-81572eced95c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:37.759541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e57c2cc0-f3ab-4010-9c9a-81572eced95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:37.785640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 105/211] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:37.808304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794317d0-ac5f-4725-bf91-e02a4933bc0a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:37.838795 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 107/212] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:37.862820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c2cc0-f3ab-4010-9c9a-81572eced95c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:37.877121 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:37.883884 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:37.916453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794317d0-ac5f-4725-bf91-e02a4933bc0a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:37.953313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94e1bf-1cdd-497d-8217-e71c7ef30c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:37.953966 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94e1bf-1cdd-497d-8217-e71c7ef30c5a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:37.954246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94e1bf-1cdd-497d-8217-e71c7ef30c5a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:37.954517 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94e1bf-1cdd-497d-8217-e71c7ef30c5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:37.965401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf94e1bf-1cdd-497d-8217-e71c7ef30c5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:37.965532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c2cc0-f3ab-4010-9c9a-81572eced95c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-bf94e1bf-1cdd-497d-8217-e71c7ef30c5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:37.970592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:37.971480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:37.972263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:37.972263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:37.972263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:37.972263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:37.972263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:37.972263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:37.972263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:37.972263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:37.972263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:37.972263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:37.972263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:37.972263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:37.972263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 106/213] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:31:37.978039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94e1bf-1cdd-497d-8217-e71c7ef30c5a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:38.001118 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5730ce2-7ff3-421a-aaaa-dde8ccc9e8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:38.001863 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5730ce2-7ff3-421a-aaaa-dde8ccc9e8cb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:38.002143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5730ce2-7ff3-421a-aaaa-dde8ccc9e8cb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:38.002461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5730ce2-7ff3-421a-aaaa-dde8ccc9e8cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:38.003639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5730ce2-7ff3-421a-aaaa-dde8ccc9e8cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:38.005105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5730ce2-7ff3-421a-aaaa-dde8ccc9e8cb None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:38.011639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 108/214] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:38.012611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5730ce2-7ff3-421a-aaaa-dde8ccc9e8cb None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:38.087837 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94e1bf-1cdd-497d-8217-e71c7ef30c5a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:38.094032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:38.114439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5730ce2-7ff3-421a-aaaa-dde8ccc9e8cb None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:38.121396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:38.127624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01338e20-3e2a-4708-acfe-9b5cb4b96385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:38.128253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01338e20-3e2a-4708-acfe-9b5cb4b96385 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:38.128526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01338e20-3e2a-4708-acfe-9b5cb4b96385 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:38.128792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01338e20-3e2a-4708-acfe-9b5cb4b96385 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:38.129639 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01338e20-3e2a-4708-acfe-9b5cb4b96385 None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:38.130026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01338e20-3e2a-4708-acfe-9b5cb4b96385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:38.131411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01338e20-3e2a-4708-acfe-9b5cb4b96385 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:38.145413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 107/215] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:38.146311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01338e20-3e2a-4708-acfe-9b5cb4b96385 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:38.150982 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1602cc-c3a7-4b86-aa47-f3f51296507f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:38.151615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1602cc-c3a7-4b86-aa47-f3f51296507f None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:38.151892 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1602cc-c3a7-4b86-aa47-f3f51296507f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:38.152162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1602cc-c3a7-4b86-aa47-f3f51296507f None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:38.152873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1602cc-c3a7-4b86-aa47-f3f51296507f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:38.154438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1602cc-c3a7-4b86-aa47-f3f51296507f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:38.178564 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 109/216] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:31:38 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:31:38.256242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01338e20-3e2a-4708-acfe-9b5cb4b96385 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:38.294679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cfb05-79b1-4c85-bd3b-fa743b38eeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:38.295354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cfb05-79b1-4c85-bd3b-fa743b38eeeb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:38.295815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cfb05-79b1-4c85-bd3b-fa743b38eeeb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:38.296088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cfb05-79b1-4c85-bd3b-fa743b38eeeb None admin] PATH_INFO: `/v3/users/67d682bb7a8244a286dee4b92176e9fd` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:38.312706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cfb05-79b1-4c85-bd3b-fa743b38eeeb None admin] RBAC: Authorizing `identity:get_user(user_id=67d682bb7a8244a286dee4b92176e9fd)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:38.314363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cfb05-79b1-4c85-bd3b-fa743b38eeeb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:38.316555 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 108/217] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:38 2022] GET /identity/v3/users/67d682bb7a8244a286dee4b92176e9fd => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:38.322470 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1602cc-c3a7-4b86-aa47-f3f51296507f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:38.410679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa24a95-fb96-4ee7-8133-44ea81e78684 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:38.410976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa24a95-fb96-4ee7-8133-44ea81e78684 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:38.411154 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa24a95-fb96-4ee7-8133-44ea81e78684 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:38.413395 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 109/218] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:31:38.418266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddc343-2f68-4fe6-8129-d0e4640a8b3a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:38.418569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddc343-2f68-4fe6-8129-d0e4640a8b3a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:38.418811 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddc343-2f68-4fe6-8129-d0e4640a8b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:38.430982 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1602cc-c3a7-4b86-aa47-f3f51296507f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:38.438879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3fddc343-2f68-4fe6-8129-d0e4640a8b3a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:38.439535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3fddc343-2f68-4fe6-8129-d0e4640a8b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:38.472622 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d31a2-4ef3-4f2e-9ba5-4e2415662990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:38.473715 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d31a2-4ef3-4f2e-9ba5-4e2415662990 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:38.474171 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d31a2-4ef3-4f2e-9ba5-4e2415662990 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:38.475402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d31a2-4ef3-4f2e-9ba5-4e2415662990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:38.478599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:38.501257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:38.533447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 110/219] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:38.534943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b1413-15f0-485c-bd72-b6fa260b568d None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:38.535410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b1413-15f0-485c-bd72-b6fa260b568d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:38.535699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b1413-15f0-485c-bd72-b6fa260b568d None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:38.537180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 111/220] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:31:38.544756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e0276-af5c-451e-8f68-59c846f35b2b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:38.545048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e0276-af5c-451e-8f68-59c846f35b2b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:38.545351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e0276-af5c-451e-8f68-59c846f35b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:38.564008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d31a2-4ef3-4f2e-9ba5-4e2415662990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:38.565969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d31a2-4ef3-4f2e-9ba5-4e2415662990 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:38.573940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e76e0276-af5c-451e-8f68-59c846f35b2b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:38.575274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e76e0276-af5c-451e-8f68-59c846f35b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:38.682105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 110/221] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:38.682998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d31a2-4ef3-4f2e-9ba5-4e2415662990 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:38.683640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 112/222] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:38.691898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e0276-af5c-451e-8f68-59c846f35b2b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:38.739443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:38.809583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e0276-af5c-451e-8f68-59c846f35b2b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:38.823965 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d31a2-4ef3-4f2e-9ba5-4e2415662990 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:38.824156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:38.848111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd030416-df58-4048-aab8-22ab6f266241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:38.848786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd030416-df58-4048-aab8-22ab6f266241 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:38.849061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd030416-df58-4048-aab8-22ab6f266241 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:38.849361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd030416-df58-4048-aab8-22ab6f266241 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:38.850614 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd030416-df58-4048-aab8-22ab6f266241 None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:38.852062 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd030416-df58-4048-aab8-22ab6f266241 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:38.859547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 113/223] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:38 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:38.860608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd030416-df58-4048-aab8-22ab6f266241 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:38.866474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8d39-99b5-439b-90ab-d11a3970211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:38.867342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8d39-99b5-439b-90ab-d11a3970211e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:38.867778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8d39-99b5-439b-90ab-d11a3970211e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:38.868186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de8d39-99b5-439b-90ab-d11a3970211e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:38.884132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de8d39-99b5-439b-90ab-d11a3970211e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-e9de8d39-99b5-439b-90ab-d11a3970211e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:38.889646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:38.890733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:38.891671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:38.891671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:38.891671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:38.891671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:38.891671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:38.891671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:38.891671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:38.891671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:38.891671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:38.891671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:38.891671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:38.891671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:38.891671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 111/224] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:31:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:38.892865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8d39-99b5-439b-90ab-d11a3970211e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:38.975615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd030416-df58-4048-aab8-22ab6f266241 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:38.997472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de8d39-99b5-439b-90ab-d11a3970211e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:39.010518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c38253-f247-46b2-aa2b-07a781d572e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:39.011084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:39.011307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c38253-f247-46b2-aa2b-07a781d572e4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:39.011973 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c38253-f247-46b2-aa2b-07a781d572e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:39.011973 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c38253-f247-46b2-aa2b-07a781d572e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:39.023633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c38253-f247-46b2-aa2b-07a781d572e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-58c38253-f247-46b2-aa2b-07a781d572e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:39.028657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:39.029844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:39.030661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:39.030661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:39.030661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:39.030661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:39.030661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:39.030661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:39.030661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:39.030661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:39.030661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:39.030661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:39.030661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:39.030661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:39.031248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 114/225] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:31:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:39.036426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c38253-f247-46b2-aa2b-07a781d572e4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:39.043085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cd80f-9dc0-4266-a4cb-39675d6641c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:39.043987 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd80f-9dc0-4266-a4cb-39675d6641c1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:39.044469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd80f-9dc0-4266-a4cb-39675d6641c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:39.045010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd80f-9dc0-4266-a4cb-39675d6641c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:39.046065 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cd80f-9dc0-4266-a4cb-39675d6641c1 None admin] RBAC: Adding query filter params (role.id=d93e06f63f2947f98ad9a668b80929dc, scope.project.id=7983d7c8afd94591898d105faa79f3ec, user.id=67d682bb7a8244a286dee4b92176e9fd) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:39.046587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cd80f-9dc0-4266-a4cb-39675d6641c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:39.048255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cd80f-9dc0-4266-a4cb-39675d6641c1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:39.054583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 112/226] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:38 2022] GET /identity/v3/role_assignments?user.id=67d682bb7a8244a286dee4b92176e9fd&scope.project.id=7983d7c8afd94591898d105faa79f3ec&role.id=d93e06f63f2947f98ad9a668b80929dc => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:39.055631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cd80f-9dc0-4266-a4cb-39675d6641c1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:39.110443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:39.164577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cd80f-9dc0-4266-a4cb-39675d6641c1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:39.201128 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df0120-2d04-4d10-a938-5c2de7e6b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:39.202156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df0120-2d04-4d10-a938-5c2de7e6b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:39.202682 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df0120-2d04-4d10-a938-5c2de7e6b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:39.203151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03df0120-2d04-4d10-a938-5c2de7e6b6d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:39.204092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df0120-2d04-4d10-a938-5c2de7e6b6d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:39.204617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df0120-2d04-4d10-a938-5c2de7e6b6d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:39.206297 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03df0120-2d04-4d10-a938-5c2de7e6b6d5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:39.210938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c38253-f247-46b2-aa2b-07a781d572e4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:39.215857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 113/227] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:31:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:39.221871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df0120-2d04-4d10-a938-5c2de7e6b6d5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:39.248902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:39.318191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43771a68-8565-4a1a-8bba-c647db9f71a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:39.318711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43771a68-8565-4a1a-8bba-c647db9f71a5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:39.319002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43771a68-8565-4a1a-8bba-c647db9f71a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:39.319285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43771a68-8565-4a1a-8bba-c647db9f71a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:39.320039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43771a68-8565-4a1a-8bba-c647db9f71a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:39.320344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43771a68-8565-4a1a-8bba-c647db9f71a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:39.321827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43771a68-8565-4a1a-8bba-c647db9f71a5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:39.336187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03df0120-2d04-4d10-a938-5c2de7e6b6d5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:39.343510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 115/228] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:39.349275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43771a68-8565-4a1a-8bba-c647db9f71a5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:39.373887 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a015ab-2040-433b-b62a-7497857a0f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:39.374893 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a015ab-2040-433b-b62a-7497857a0f76 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:39.375395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a015ab-2040-433b-b62a-7497857a0f76 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:39.375861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a015ab-2040-433b-b62a-7497857a0f76 None admin] PATH_INFO: `/v3/users/d0b238c7801242ed8e2b3c6463bbb0be` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:39.377252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a015ab-2040-433b-b62a-7497857a0f76 None admin] RBAC: Authorizing `identity:get_user(user_id=d0b238c7801242ed8e2b3c6463bbb0be)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:39.378935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a015ab-2040-433b-b62a-7497857a0f76 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:39.381069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 114/229] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:39 2022] GET /identity/v3/users/d0b238c7801242ed8e2b3c6463bbb0be => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:39.386637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a015ab-2040-433b-b62a-7497857a0f76 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:39.480737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:39.492712 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a015ab-2040-433b-b62a-7497857a0f76 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:39.528219 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b0d4e-04f1-45fd-8070-d2294b78f9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:39.529311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b0d4e-04f1-45fd-8070-d2294b78f9d4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:39.529809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b0d4e-04f1-45fd-8070-d2294b78f9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:39.530275 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b0d4e-04f1-45fd-8070-d2294b78f9d4 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:39.531663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b0d4e-04f1-45fd-8070-d2294b78f9d4 None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:39.533369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b0d4e-04f1-45fd-8070-d2294b78f9d4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:39.535601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 115/230] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:39 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:39.541407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b0d4e-04f1-45fd-8070-d2294b78f9d4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:39.593571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43771a68-8565-4a1a-8bba-c647db9f71a5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:39.595230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:39.654314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b0d4e-04f1-45fd-8070-d2294b78f9d4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:39.682111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b772065-8f2e-493f-89e9-92cce361dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:39.683174 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b772065-8f2e-493f-89e9-92cce361dee2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:39.683658 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b772065-8f2e-493f-89e9-92cce361dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:39.684120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b772065-8f2e-493f-89e9-92cce361dee2 None admin] PATH_INFO: `/v3/users/d0b238c7801242ed8e2b3c6463bbb0be` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:39.685622 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b772065-8f2e-493f-89e9-92cce361dee2 None admin] RBAC: Authorizing `identity:get_user(user_id=d0b238c7801242ed8e2b3c6463bbb0be)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:39.687374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b772065-8f2e-493f-89e9-92cce361dee2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:39.689562 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 116/231] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:39 2022] GET /identity/v3/users/d0b238c7801242ed8e2b3c6463bbb0be => generated 283 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:39.690269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552e645-8974-4783-8b82-8e19bb9a8568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:39.691465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e645-8974-4783-8b82-8e19bb9a8568 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:39.691755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e645-8974-4783-8b82-8e19bb9a8568 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:39.692032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552e645-8974-4783-8b82-8e19bb9a8568 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec/users/d0b238c7801242ed8e2b3c6463bbb0be/roles/506da913e25f44b1854b24215eb447fc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:39.694708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b772065-8f2e-493f-89e9-92cce361dee2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:39.697023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552e645-8974-4783-8b82-8e19bb9a8568 None admin] RBAC: Authorizing `identity:create_grant(project_id=7983d7c8afd94591898d105faa79f3ec, user_id=d0b238c7801242ed8e2b3c6463bbb0be, role_id=506da913e25f44b1854b24215eb447fc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:39.699072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552e645-8974-4783-8b82-8e19bb9a8568 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:39.724963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 116/232] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:31:39 2022] PUT /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec/users/d0b238c7801242ed8e2b3c6463bbb0be/roles/506da913e25f44b1854b24215eb447fc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:31:39.820587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b772065-8f2e-493f-89e9-92cce361dee2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:39.868068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b5fb7-1501-4389-a369-1c3d5e5acb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:39.869101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b5fb7-1501-4389-a369-1c3d5e5acb6f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:39.869600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b5fb7-1501-4389-a369-1c3d5e5acb6f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:39.870069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b5fb7-1501-4389-a369-1c3d5e5acb6f None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:39.874091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b5fb7-1501-4389-a369-1c3d5e5acb6f None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:39.875834 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b5fb7-1501-4389-a369-1c3d5e5acb6f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:39.878180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 117/233] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:39 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:39.884054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552e645-8974-4783-8b82-8e19bb9a8568 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:39.913106 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:40.008145 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552e645-8974-4783-8b82-8e19bb9a8568 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:40.048841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678798a-5fcf-4943-87d1-0ef134c2908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:40.049551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678798a-5fcf-4943-87d1-0ef134c2908e None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:40.049829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678798a-5fcf-4943-87d1-0ef134c2908e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:40.050100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678798a-5fcf-4943-87d1-0ef134c2908e None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec/users/d0b238c7801242ed8e2b3c6463bbb0be/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:40.054649 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678798a-5fcf-4943-87d1-0ef134c2908e None admin] RBAC: Authorizing `identity:create_grant(project_id=7983d7c8afd94591898d105faa79f3ec, user_id=d0b238c7801242ed8e2b3c6463bbb0be, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:40.056133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678798a-5fcf-4943-87d1-0ef134c2908e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:40.085071 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 117/234] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:31:39 2022] PUT /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec/users/d0b238c7801242ed8e2b3c6463bbb0be/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:31:40.612888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d83f6-e2a6-4693-bc88-64307834dc6c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:40.613551 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d83f6-e2a6-4693-bc88-64307834dc6c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:40.614054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d83f6-e2a6-4693-bc88-64307834dc6c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:40.615880 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 118/235] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:40.620935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a4d93-662b-4451-8181-12df787d5106 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:40.621228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a4d93-662b-4451-8181-12df787d5106 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:40.621533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a4d93-662b-4451-8181-12df787d5106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:40.646544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a03a4d93-662b-4451-8181-12df787d5106 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:40.647764 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a03a4d93-662b-4451-8181-12df787d5106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:40.742074 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 118/236] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:40.767298 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d83f6-e2a6-4693-bc88-64307834dc6c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:40.825022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:40.845009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcca9c-f522-44e3-a331-e717ca844b25 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:40.845316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcca9c-f522-44e3-a331-e717ca844b25 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:40.845760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcca9c-f522-44e3-a331-e717ca844b25 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:40.847629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 119/237] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:40.852271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37842c-c408-4cfe-97b1-1ee4d525234c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:40.852738 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37842c-c408-4cfe-97b1-1ee4d525234c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:40.853156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37842c-c408-4cfe-97b1-1ee4d525234c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:40.881731 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3f37842c-c408-4cfe-97b1-1ee4d525234c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:40.882935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3f37842c-c408-4cfe-97b1-1ee4d525234c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:40.887856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:40.909588 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d83f6-e2a6-4693-bc88-64307834dc6c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:40.943836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68947b-a402-44b5-a939-d88393c4612c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:40.944840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68947b-a402-44b5-a939-d88393c4612c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:40.945267 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68947b-a402-44b5-a939-d88393c4612c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:40.945971 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68947b-a402-44b5-a939-d88393c4612c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:40.947404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68947b-a402-44b5-a939-d88393c4612c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:40.949081 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68947b-a402-44b5-a939-d88393c4612c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:40.951589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 119/238] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:40.957191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68947b-a402-44b5-a939-d88393c4612c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:41.016578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 120/239] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:41.086975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37842c-c408-4cfe-97b1-1ee4d525234c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:41.100729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68947b-a402-44b5-a939-d88393c4612c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:41.111104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:41.139933 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba15df-dcba-4a83-afb2-be105bfdd17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:41.140945 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba15df-dcba-4a83-afb2-be105bfdd17e None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:41.141528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba15df-dcba-4a83-afb2-be105bfdd17e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:41.142045 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba15df-dcba-4a83-afb2-be105bfdd17e None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:41.142951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba15df-dcba-4a83-afb2-be105bfdd17e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:41.144668 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba15df-dcba-4a83-afb2-be105bfdd17e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:41.170061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 120/240] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:31:40 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:31:41.271531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37842c-c408-4cfe-97b1-1ee4d525234c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:41.320847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f76efa-bf97-4e4a-b4b4-a9def7009c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:41.321548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f76efa-bf97-4e4a-b4b4-a9def7009c15 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:41.321833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f76efa-bf97-4e4a-b4b4-a9def7009c15 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:41.322108 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f76efa-bf97-4e4a-b4b4-a9def7009c15 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:41.335879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:41.339890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f76efa-bf97-4e4a-b4b4-a9def7009c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a0f76efa-bf97-4e4a-b4b4-a9def7009c15 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:41.345131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:41.346091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:41.346880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:41.346880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:41.346880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:41.346880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:41.346880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:41.346880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:41.346880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:41.346880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:41.346880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:41.346880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:41.346880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:41.346880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:41.346880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 121/241] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:31:41.355392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba15df-dcba-4a83-afb2-be105bfdd17e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:41.404473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026e713-9d41-40e2-97e0-b22304c91be1 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:41.405049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026e713-9d41-40e2-97e0-b22304c91be1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:41.405542 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026e713-9d41-40e2-97e0-b22304c91be1 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:41.407100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 122/242] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:41.412681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40860f-bc46-4129-aab4-1e37559de7cf None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:41.413045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40860f-bc46-4129-aab4-1e37559de7cf None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:41.413421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40860f-bc46-4129-aab4-1e37559de7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:41.437365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-eb40860f-bc46-4129-aab4-1e37559de7cf None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:41.440216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-eb40860f-bc46-4129-aab4-1e37559de7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:41.473217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba15df-dcba-4a83-afb2-be105bfdd17e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:41.517742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f276-4a37-4e54-aacf-f6816ac897ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:41.518682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f276-4a37-4e54-aacf-f6816ac897ff None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:41.519098 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f276-4a37-4e54-aacf-f6816ac897ff None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:41.519495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27f276-4a37-4e54-aacf-f6816ac897ff None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:41.520606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27f276-4a37-4e54-aacf-f6816ac897ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:41.521091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27f276-4a37-4e54-aacf-f6816ac897ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:41.523367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27f276-4a37-4e54-aacf-f6816ac897ff None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:41.534274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 123/243] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:41.534770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 121/244] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:41.543170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40860f-bc46-4129-aab4-1e37559de7cf None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:41.569844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f276-4a37-4e54-aacf-f6816ac897ff None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:41.607574 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:41.667175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40860f-bc46-4129-aab4-1e37559de7cf None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:41.698663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:41.709702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058db33b-f33e-41b4-8c8a-bad403ba3216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:41.710514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058db33b-f33e-41b4-8c8a-bad403ba3216 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:41.710902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058db33b-f33e-41b4-8c8a-bad403ba3216 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:41.711272 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058db33b-f33e-41b4-8c8a-bad403ba3216 None admin] PATH_INFO: `/v3/users/7c82615b208d403c9c783c2264014842` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:41.718252 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27f276-4a37-4e54-aacf-f6816ac897ff None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:41.734510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058db33b-f33e-41b4-8c8a-bad403ba3216 None admin] RBAC: Authorizing `identity:get_user(user_id=7c82615b208d403c9c783c2264014842)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:41.736154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058db33b-f33e-41b4-8c8a-bad403ba3216 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:41.738109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 124/245] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:41 2022] GET /identity/v3/users/7c82615b208d403c9c783c2264014842 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:41.743743 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058db33b-f33e-41b4-8c8a-bad403ba3216 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:41.762387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4dada-6549-484e-8c93-52b480b6072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:41.763459 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4dada-6549-484e-8c93-52b480b6072c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:41.763887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4dada-6549-484e-8c93-52b480b6072c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:41.764369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4dada-6549-484e-8c93-52b480b6072c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:41.777622 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4dada-6549-484e-8c93-52b480b6072c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-40b4dada-6549-484e-8c93-52b480b6072c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:41.784056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:41.784947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:41.785746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:41.785746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:41.785746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:41.785746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:41.785746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:41.785746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:41.785746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:41.785746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:41.785746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:41.785746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:41.785746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:41.785746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:41.788475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 122/246] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:31:41.799248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4dada-6549-484e-8c93-52b480b6072c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:41.895884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058db33b-f33e-41b4-8c8a-bad403ba3216 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:41.905566 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:41.928255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4dada-6549-484e-8c93-52b480b6072c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:41.945075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5c248-d21b-4f4e-a560-51e0368ec384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:41.946604 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5c248-d21b-4f4e-a560-51e0368ec384 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:41.947034 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5c248-d21b-4f4e-a560-51e0368ec384 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:41.947425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5c248-d21b-4f4e-a560-51e0368ec384 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:41.973317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f811fb-998e-4cbf-8726-c74e8b27e1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:41.973898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f811fb-998e-4cbf-8726-c74e8b27e1c7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:41.974280 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f811fb-998e-4cbf-8726-c74e8b27e1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:41.974653 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f811fb-998e-4cbf-8726-c74e8b27e1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:41.975483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f811fb-998e-4cbf-8726-c74e8b27e1c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:41.975934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f811fb-998e-4cbf-8726-c74e8b27e1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:41.977608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f811fb-998e-4cbf-8726-c74e8b27e1c7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:41.987244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 123/247] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:41.993388 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f811fb-998e-4cbf-8726-c74e8b27e1c7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:42.018175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:42.046064 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5c248-d21b-4f4e-a560-51e0368ec384 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:42.047563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5c248-d21b-4f4e-a560-51e0368ec384 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:42.156421 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f811fb-998e-4cbf-8726-c74e8b27e1c7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:42.221200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a6609-bef2-4df7-8126-90bc33a34725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:42.221798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a6609-bef2-4df7-8126-90bc33a34725 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:42.222081 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a6609-bef2-4df7-8126-90bc33a34725 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:42.222361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a6609-bef2-4df7-8126-90bc33a34725 None admin] PATH_INFO: `/v3/users/67d682bb7a8244a286dee4b92176e9fd` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:42.224657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a6609-bef2-4df7-8126-90bc33a34725 None admin] RBAC: Authorizing `identity:get_user(user_id=67d682bb7a8244a286dee4b92176e9fd)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:42.226146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a6609-bef2-4df7-8126-90bc33a34725 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:42.229249 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 124/248] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:41 2022] GET /identity/v3/users/67d682bb7a8244a286dee4b92176e9fd => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:42.237094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a6609-bef2-4df7-8126-90bc33a34725 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:42.243619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 125/249] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 02:31:42.250284 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5c248-d21b-4f4e-a560-51e0368ec384 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:42.277123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:42.368425 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a6609-bef2-4df7-8126-90bc33a34725 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:42.377661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:42.386762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5c248-d21b-4f4e-a560-51e0368ec384 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:42.404659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2795d-1310-42c4-a7e6-33c3f744aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:42.405851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2795d-1310-42c4-a7e6-33c3f744aa37 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:42.406328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2795d-1310-42c4-a7e6-33c3f744aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:42.406798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2795d-1310-42c4-a7e6-33c3f744aa37 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:42.408165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2795d-1310-42c4-a7e6-33c3f744aa37 None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:42.409977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2795d-1310-42c4-a7e6-33c3f744aa37 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:42.412354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 125/250] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:42 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:42.413740 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780b81d-b263-43da-a7bd-185ae95961df None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:42.414218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780b81d-b263-43da-a7bd-185ae95961df None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:42.414785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780b81d-b263-43da-a7bd-185ae95961df None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:42.416535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 126/251] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:42.417544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780b81d-b263-43da-a7bd-185ae95961df None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:42.428192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da6d77-17c3-47c8-958d-ca2c05d95e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:42.428890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da6d77-17c3-47c8-958d-ca2c05d95e44 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:42.429172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da6d77-17c3-47c8-958d-ca2c05d95e44 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:42.429480 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da6d77-17c3-47c8-958d-ca2c05d95e44 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:42.430789 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da6d77-17c3-47c8-958d-ca2c05d95e44 None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:42.432380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da6d77-17c3-47c8-958d-ca2c05d95e44 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:42.434482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 126/252] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:42 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:42.435858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2b2be-1858-4e7c-9336-5edcb0699b17 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:42.436145 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2b2be-1858-4e7c-9336-5edcb0699b17 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:42.436781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2b2be-1858-4e7c-9336-5edcb0699b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:42.455766 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b2f2b2be-1858-4e7c-9336-5edcb0699b17 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:42.456962 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b2f2b2be-1858-4e7c-9336-5edcb0699b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:42.508460 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:42.529430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780b81d-b263-43da-a7bd-185ae95961df None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:42.531568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 127/253] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:42.538247 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2b2be-1858-4e7c-9336-5edcb0699b17 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:42.577146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7edbd-1ff2-445c-b3c3-04a4cfbe09cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:42.578213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7edbd-1ff2-445c-b3c3-04a4cfbe09cc None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:42.578686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7edbd-1ff2-445c-b3c3-04a4cfbe09cc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:42.579147 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7edbd-1ff2-445c-b3c3-04a4cfbe09cc None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec/users/67d682bb7a8244a286dee4b92176e9fd/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:42.583682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7edbd-1ff2-445c-b3c3-04a4cfbe09cc None admin] RBAC: Authorizing `identity:create_grant(project_id=7983d7c8afd94591898d105faa79f3ec, user_id=67d682bb7a8244a286dee4b92176e9fd, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:42.585514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7edbd-1ff2-445c-b3c3-04a4cfbe09cc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:42.615803 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 127/254] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:31:42 2022] PUT /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec/users/67d682bb7a8244a286dee4b92176e9fd/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:31:42.617234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7edbd-1ff2-445c-b3c3-04a4cfbe09cc None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:42.650232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:42.668390 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2b2be-1858-4e7c-9336-5edcb0699b17 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:42.742466 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808b77c-c22c-4361-827e-d6772465d534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:42.743138 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808b77c-c22c-4361-827e-d6772465d534 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:42.743421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808b77c-c22c-4361-827e-d6772465d534 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:42.743692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808b77c-c22c-4361-827e-d6772465d534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:42.744521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808b77c-c22c-4361-827e-d6772465d534 None admin] RBAC: Adding query filter params (role.id=83230fc7c4994327bedaae3eacb6067e, scope.project.id=7983d7c8afd94591898d105faa79f3ec, user.id=7c82615b208d403c9c783c2264014842) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:42.745051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808b77c-c22c-4361-827e-d6772465d534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:42.746561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808b77c-c22c-4361-827e-d6772465d534 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:42.760816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 128/255] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:42 2022] GET /identity/v3/role_assignments?user.id=7c82615b208d403c9c783c2264014842&scope.project.id=7983d7c8afd94591898d105faa79f3ec&role.id=83230fc7c4994327bedaae3eacb6067e => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:42.763031 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7edbd-1ff2-445c-b3c3-04a4cfbe09cc None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:42.801455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11bac1-6540-4ab1-b1d1-477c677c6f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:42.802232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11bac1-6540-4ab1-b1d1-477c677c6f0e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:42.802515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11bac1-6540-4ab1-b1d1-477c677c6f0e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:42.802776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11bac1-6540-4ab1-b1d1-477c677c6f0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:42.815504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11bac1-6540-4ab1-b1d1-477c677c6f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2f11bac1-6540-4ab1-b1d1-477c677c6f0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:42.821349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:42.822336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:42.823115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:42.823115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:42.823115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:42.823115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:42.823115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:42.823115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:42.823115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:42.823115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:42.823115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:42.823115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:42.823115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:42.823115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:42.823115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 128/256] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:31:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:42.828875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808b77c-c22c-4361-827e-d6772465d534 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:42.873106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c77f4-f595-4573-a323-95edf433116d None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:42.873657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c77f4-f595-4573-a323-95edf433116d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:42.874073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c77f4-f595-4573-a323-95edf433116d None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:42.875756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 129/257] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:31:42.888366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21565db-d77b-41cf-bfc3-f702b881e72e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:42.888914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21565db-d77b-41cf-bfc3-f702b881e72e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:42.889350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21565db-d77b-41cf-bfc3-f702b881e72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:42.899923 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:42.918406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a21565db-d77b-41cf-bfc3-f702b881e72e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:42.926109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a21565db-d77b-41cf-bfc3-f702b881e72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:42.969500 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808b77c-c22c-4361-827e-d6772465d534 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:43.007692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa77a3-e2ca-49aa-bf22-8e4ea452faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:43.008329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa77a3-e2ca-49aa-bf22-8e4ea452faf6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:43.008803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa77a3-e2ca-49aa-bf22-8e4ea452faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:43.009336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa77a3-e2ca-49aa-bf22-8e4ea452faf6 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:43.010309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa77a3-e2ca-49aa-bf22-8e4ea452faf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:43.010935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa77a3-e2ca-49aa-bf22-8e4ea452faf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:43.012317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa77a3-e2ca-49aa-bf22-8e4ea452faf6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:43.025417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 129/258] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:31:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:43.027629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa77a3-e2ca-49aa-bf22-8e4ea452faf6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:43.030382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 130/259] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:43.041704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:43.065804 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21565db-d77b-41cf-bfc3-f702b881e72e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:43.137330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa77a3-e2ca-49aa-bf22-8e4ea452faf6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:43.173142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c41ecf-28b3-4fea-ad4f-bff5f6d5f134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:43.173142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c41ecf-28b3-4fea-ad4f-bff5f6d5f134 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:43.173142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c41ecf-28b3-4fea-ad4f-bff5f6d5f134 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:43.173142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c41ecf-28b3-4fea-ad4f-bff5f6d5f134 None admin] PATH_INFO: `/v3/users/d0b238c7801242ed8e2b3c6463bbb0be` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:43.173629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c41ecf-28b3-4fea-ad4f-bff5f6d5f134 None admin] RBAC: Authorizing `identity:get_user(user_id=d0b238c7801242ed8e2b3c6463bbb0be)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:43.173629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c41ecf-28b3-4fea-ad4f-bff5f6d5f134 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:43.177408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 130/260] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:43 2022] GET /identity/v3/users/d0b238c7801242ed8e2b3c6463bbb0be => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:43.185442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c41ecf-28b3-4fea-ad4f-bff5f6d5f134 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:43.281886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21565db-d77b-41cf-bfc3-f702b881e72e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:43.314202 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:43.336404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c41ecf-28b3-4fea-ad4f-bff5f6d5f134 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:43.355080 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:43.366495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1122a-f9a0-46f7-a19a-79ce603b7ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:43.367256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1122a-f9a0-46f7-a19a-79ce603b7ddc None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:43.367544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1122a-f9a0-46f7-a19a-79ce603b7ddc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:43.367820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1122a-f9a0-46f7-a19a-79ce603b7ddc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:43.378523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60774a6-7d95-4349-897c-13abf9e502d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:43.379167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60774a6-7d95-4349-897c-13abf9e502d8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:43.379452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60774a6-7d95-4349-897c-13abf9e502d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:43.379730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60774a6-7d95-4349-897c-13abf9e502d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:43.389854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b1122a-f9a0-46f7-a19a-79ce603b7ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f8b1122a-f9a0-46f7-a19a-79ce603b7ddc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:43.395250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:43.396207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:43.396990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:43.396990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:43.396990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:43.396990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:43.396990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:43.396990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:43.396990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:43.396990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:43.396990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:43.396990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:43.396990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:43.396990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:43.396990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 131/261] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:31:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:31:43.402589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1122a-f9a0-46f7-a19a-79ce603b7ddc None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:43.480490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60774a6-7d95-4349-897c-13abf9e502d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:43.482047 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60774a6-7d95-4349-897c-13abf9e502d8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:43.561177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:43.587518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 131/262] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:43.589651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60774a6-7d95-4349-897c-13abf9e502d8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:43.601463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1122a-f9a0-46f7-a19a-79ce603b7ddc None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:43.676672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d04d7-68d3-43f0-9b4f-f0329627f869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:43.677330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d04d7-68d3-43f0-9b4f-f0329627f869 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:43.677617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d04d7-68d3-43f0-9b4f-f0329627f869 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:43.677894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d04d7-68d3-43f0-9b4f-f0329627f869 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:43.678636 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d04d7-68d3-43f0-9b4f-f0329627f869 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:43.678943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d04d7-68d3-43f0-9b4f-f0329627f869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:43.680444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d04d7-68d3-43f0-9b4f-f0329627f869 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:43.691455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60774a6-7d95-4349-897c-13abf9e502d8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:43.695683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 132/263] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:43.701449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d04d7-68d3-43f0-9b4f-f0329627f869 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:43.726352 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d3f65-12cd-47de-ad05-f3785340f243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:43.727009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d3f65-12cd-47de-ad05-f3785340f243 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:43.727289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d3f65-12cd-47de-ad05-f3785340f243 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:43.727564 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d3f65-12cd-47de-ad05-f3785340f243 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:43.729099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d3f65-12cd-47de-ad05-f3785340f243 None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:43.730595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d3f65-12cd-47de-ad05-f3785340f243 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:43.737297 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 132/264] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:43 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:43.738520 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d3f65-12cd-47de-ad05-f3785340f243 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:43.802695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:43.823859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:43.856687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d3f65-12cd-47de-ad05-f3785340f243 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:43.898910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d04d7-68d3-43f0-9b4f-f0329627f869 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:43.907107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cb35a-642f-4b23-adf5-806c9e439abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:43.907748 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cb35a-642f-4b23-adf5-806c9e439abb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:43.908023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cb35a-642f-4b23-adf5-806c9e439abb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:43.908295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cb35a-642f-4b23-adf5-806c9e439abb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:43.909103 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cb35a-642f-4b23-adf5-806c9e439abb None admin] RBAC: Adding query filter params (role.id=506da913e25f44b1854b24215eb447fc, scope.project.id=7983d7c8afd94591898d105faa79f3ec, user.id=d0b238c7801242ed8e2b3c6463bbb0be) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:43.909455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cb35a-642f-4b23-adf5-806c9e439abb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:43.910921 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cb35a-642f-4b23-adf5-806c9e439abb None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:43.925143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 133/265] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:43 2022] GET /identity/v3/role_assignments?user.id=d0b238c7801242ed8e2b3c6463bbb0be&scope.project.id=7983d7c8afd94591898d105faa79f3ec&role.id=506da913e25f44b1854b24215eb447fc => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:43.949354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f38c3-a9d3-42b4-9c08-a908a48bf365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:43.950088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f38c3-a9d3-42b4-9c08-a908a48bf365 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:43.950367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f38c3-a9d3-42b4-9c08-a908a48bf365 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:43.950758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f38c3-a9d3-42b4-9c08-a908a48bf365 None admin] PATH_INFO: `/v3/users/d0b238c7801242ed8e2b3c6463bbb0be` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:43.951968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f38c3-a9d3-42b4-9c08-a908a48bf365 None admin] RBAC: Authorizing `identity:get_user(user_id=d0b238c7801242ed8e2b3c6463bbb0be)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:43.953521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f38c3-a9d3-42b4-9c08-a908a48bf365 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:43.955386 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 133/266] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:43 2022] GET /identity/v3/users/d0b238c7801242ed8e2b3c6463bbb0be => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:43.960967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cb35a-642f-4b23-adf5-806c9e439abb None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:44.073958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cb35a-642f-4b23-adf5-806c9e439abb None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:44.089295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:44.123632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4afe76-e59b-42f4-94d9-3b7772ab310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:44.124270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4afe76-e59b-42f4-94d9-3b7772ab310c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:44.124548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4afe76-e59b-42f4-94d9-3b7772ab310c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:44.124829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4afe76-e59b-42f4-94d9-3b7772ab310c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:44.208754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4afe76-e59b-42f4-94d9-3b7772ab310c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:44.210278 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4afe76-e59b-42f4-94d9-3b7772ab310c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:44.321465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 134/267] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:44.327457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f38c3-a9d3-42b4-9c08-a908a48bf365 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:44.480680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f38c3-a9d3-42b4-9c08-a908a48bf365 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:44.512374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:44.524620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8d5e3-4bd2-4863-b35a-aa99136a1e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:44.525293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8d5e3-4bd2-4863-b35a-aa99136a1e11 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:44.529677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8d5e3-4bd2-4863-b35a-aa99136a1e11 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:44.529954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8d5e3-4bd2-4863-b35a-aa99136a1e11 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:44.531193 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8d5e3-4bd2-4863-b35a-aa99136a1e11 None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:44.532664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8d5e3-4bd2-4863-b35a-aa99136a1e11 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:44.534713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 134/268] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:44 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:44.540438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4afe76-e59b-42f4-94d9-3b7772ab310c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:44.560828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:44.678923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4afe76-e59b-42f4-94d9-3b7772ab310c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:44.720515 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4866267-d9ae-49b4-bc68-4a66d439f62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:44.721541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4866267-d9ae-49b4-bc68-4a66d439f62f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:44.722028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4866267-d9ae-49b4-bc68-4a66d439f62f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:44.722482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4866267-d9ae-49b4-bc68-4a66d439f62f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:44.723462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4866267-d9ae-49b4-bc68-4a66d439f62f None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=7983d7c8afd94591898d105faa79f3ec, user.id=d0b238c7801242ed8e2b3c6463bbb0be) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:44.723958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4866267-d9ae-49b4-bc68-4a66d439f62f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:44.725608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4866267-d9ae-49b4-bc68-4a66d439f62f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:44.735306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 135/269] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:44 2022] GET /identity/v3/role_assignments?user.id=d0b238c7801242ed8e2b3c6463bbb0be&scope.project.id=7983d7c8afd94591898d105faa79f3ec&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:45.038930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b5a2-7dc0-4d6b-be97-48877fbfb624 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.039419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b5a2-7dc0-4d6b-be97-48877fbfb624 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.039419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3b5a2-7dc0-4d6b-be97-48877fbfb624 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.041017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 135/270] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:45.046461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d2539-f605-4224-960c-9c24e33bfc9d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.047280 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d2539-f605-4224-960c-9c24e33bfc9d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.047740 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d2539-f605-4224-960c-9c24e33bfc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.071820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4f1d2539-f605-4224-960c-9c24e33bfc9d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:45.073433 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4f1d2539-f605-4224-960c-9c24e33bfc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:45.083731 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1e70f-b660-488e-b716-751c8fdf9f51 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.084017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1e70f-b660-488e-b716-751c8fdf9f51 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.084290 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1e70f-b660-488e-b716-751c8fdf9f51 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.085832 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 136/271] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:45.094126 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357b37c-ea75-4f7d-b7ba-2e0aece47e70 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.094707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357b37c-ea75-4f7d-b7ba-2e0aece47e70 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.095181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357b37c-ea75-4f7d-b7ba-2e0aece47e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.118205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2357b37c-ea75-4f7d-b7ba-2e0aece47e70 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:45.119757 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2357b37c-ea75-4f7d-b7ba-2e0aece47e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:45.153343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 136/272] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:45.179607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d2539-f605-4224-960c-9c24e33bfc9d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:45.189547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:45.207741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 137/273] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:45.231031 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357b37c-ea75-4f7d-b7ba-2e0aece47e70 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:45.292864 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d2539-f605-4224-960c-9c24e33bfc9d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:45.336383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625723a-5f7e-4863-8547-442509ea8656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:45.337039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625723a-5f7e-4863-8547-442509ea8656 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.337354 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625723a-5f7e-4863-8547-442509ea8656 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.338060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625723a-5f7e-4863-8547-442509ea8656 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.339610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625723a-5f7e-4863-8547-442509ea8656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:45.340447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357b37c-ea75-4f7d-b7ba-2e0aece47e70 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:45.341420 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625723a-5f7e-4863-8547-442509ea8656 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:45.344009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 137/274] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:45.348950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625723a-5f7e-4863-8547-442509ea8656 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:45.367061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:45.382568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b07d1f-5877-470c-8cd5-bc473c07e4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:45.383217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07d1f-5877-470c-8cd5-bc473c07e4a8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.383501 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07d1f-5877-470c-8cd5-bc473c07e4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.383769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b07d1f-5877-470c-8cd5-bc473c07e4a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.394336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b07d1f-5877-470c-8cd5-bc473c07e4a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a6b07d1f-5877-470c-8cd5-bc473c07e4a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:45.399307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:45.400184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:45.400967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:45.400967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:45.400967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:45.400967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:45.400967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:45.400967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:45.400967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:45.400967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:45.400967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:45.400967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:45.400967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:45.400967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:45.400967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 138/275] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:45.401985 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005329-a71b-4fb8-8b25-9b21a668089b None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.402411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005329-a71b-4fb8-8b25-9b21a668089b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.402834 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005329-a71b-4fb8-8b25-9b21a668089b None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.404416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 139/276] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:45.409617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2c9e1-b6dc-41f8-a825-57ef8860f7fc None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.409900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2c9e1-b6dc-41f8-a825-57ef8860f7fc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.410149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2c9e1-b6dc-41f8-a825-57ef8860f7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.429031 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-15c2c9e1-b6dc-41f8-a825-57ef8860f7fc None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:45.430255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-15c2c9e1-b6dc-41f8-a825-57ef8860f7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:45.434331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:45.466235 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625723a-5f7e-4863-8547-442509ea8656 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:45.496925 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 140/277] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:45.497812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2c9e1-b6dc-41f8-a825-57ef8860f7fc None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:45.503326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c00f4-466a-49e5-96a5-b38656890e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:45.503972 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c00f4-466a-49e5-96a5-b38656890e4b None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.504245 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c00f4-466a-49e5-96a5-b38656890e4b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.504510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c00f4-466a-49e5-96a5-b38656890e4b None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.505211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c00f4-466a-49e5-96a5-b38656890e4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:45.506686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c00f4-466a-49e5-96a5-b38656890e4b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:45.529709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 138/278] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:31:45 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:31:45.539006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7abd3a-f70b-46a2-8dec-a42ba377fba4 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.539360 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7abd3a-f70b-46a2-8dec-a42ba377fba4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.539560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7abd3a-f70b-46a2-8dec-a42ba377fba4 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.546369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 139/279] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:45.546369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7abd3a-f70b-46a2-8dec-a42ba377fba4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:45.612798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2c9e1-b6dc-41f8-a825-57ef8860f7fc None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:45.624912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:45.651015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6068a74-229f-448b-b7e1-a0eb4c24e1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:45.651663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6068a74-229f-448b-b7e1-a0eb4c24e1fd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.651946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6068a74-229f-448b-b7e1-a0eb4c24e1fd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.652220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6068a74-229f-448b-b7e1-a0eb4c24e1fd None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.652978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6068a74-229f-448b-b7e1-a0eb4c24e1fd None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:45.653326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6068a74-229f-448b-b7e1-a0eb4c24e1fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:45.654898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6068a74-229f-448b-b7e1-a0eb4c24e1fd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:45.664648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 141/280] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:45.666674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76bc21-f899-48e8-93d1-c1f97a8c73c0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.666956 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76bc21-f899-48e8-93d1-c1f97a8c73c0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.667268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76bc21-f899-48e8-93d1-c1f97a8c73c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.677927 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7abd3a-f70b-46a2-8dec-a42ba377fba4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:45.687484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2c76bc21-f899-48e8-93d1-c1f97a8c73c0 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:45.688804 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2c76bc21-f899-48e8-93d1-c1f97a8c73c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:45.706893 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:45.719646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7df5e4-c5b2-4a59-8c79-e90faf3570f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:45.720302 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df5e4-c5b2-4a59-8c79-e90faf3570f7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.720585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df5e4-c5b2-4a59-8c79-e90faf3570f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.720854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7df5e4-c5b2-4a59-8c79-e90faf3570f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.734561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7df5e4-c5b2-4a59-8c79-e90faf3570f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-5b7df5e4-c5b2-4a59-8c79-e90faf3570f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:45.739999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:45.740882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 140/281] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:45.742447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7df5e4-c5b2-4a59-8c79-e90faf3570f7 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:45.767775 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 142/282] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:45.772245 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76bc21-f899-48e8-93d1-c1f97a8c73c0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:45.866549 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7df5e4-c5b2-4a59-8c79-e90faf3570f7 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:45.906540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e660a-7dc0-473a-8fe5-b61c26f73ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:45.907191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e660a-7dc0-473a-8fe5-b61c26f73ab2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.907467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e660a-7dc0-473a-8fe5-b61c26f73ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.907737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e660a-7dc0-473a-8fe5-b61c26f73ab2 None admin] PATH_INFO: `/v3/users/5716ea79b4684f43be84997a536679c7` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.909126 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76bc21-f899-48e8-93d1-c1f97a8c73c0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:45.912117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:45.924081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e660a-7dc0-473a-8fe5-b61c26f73ab2 None admin] RBAC: Authorizing `identity:get_user(user_id=5716ea79b4684f43be84997a536679c7)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:45.925955 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e660a-7dc0-473a-8fe5-b61c26f73ab2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:45.932650 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 141/283] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:45 2022] GET /identity/v3/users/5716ea79b4684f43be84997a536679c7 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:45.932650 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e660a-7dc0-473a-8fe5-b61c26f73ab2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:45.961518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ffb9-cf16-4987-88ab-7d6fc9084a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:45.962675 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ffb9-cf16-4987-88ab-7d6fc9084a75 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:45.963095 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ffb9-cf16-4987-88ab-7d6fc9084a75 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:45.963783 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ffb9-cf16-4987-88ab-7d6fc9084a75 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:45.965343 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ffb9-cf16-4987-88ab-7d6fc9084a75 None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:45.965823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ffb9-cf16-4987-88ab-7d6fc9084a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:45.968386 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ffb9-cf16-4987-88ab-7d6fc9084a75 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:45.980652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 143/284] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:45.982387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ffb9-cf16-4987-88ab-7d6fc9084a75 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:45.986086 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:46.053888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e660a-7dc0-473a-8fe5-b61c26f73ab2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:46.096471 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697cb6e-ed9d-4e25-9a64-d42c2de7b3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:46.097510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697cb6e-ed9d-4e25-9a64-d42c2de7b3e9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:46.097855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697cb6e-ed9d-4e25-9a64-d42c2de7b3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:46.098228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697cb6e-ed9d-4e25-9a64-d42c2de7b3e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:46.112108 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6697cb6e-ed9d-4e25-9a64-d42c2de7b3e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-6697cb6e-ed9d-4e25-9a64-d42c2de7b3e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:46.117409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:46.118266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:46.119090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:46.119090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:46.119090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:46.119090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:46.119090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:46.119090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:46.119090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:46.119090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:46.119090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:46.119090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:46.119090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:46.119090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:46.120999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ffb9-cf16-4987-88ab-7d6fc9084a75 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:46.121731 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 142/285] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:46.123403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697cb6e-ed9d-4e25-9a64-d42c2de7b3e9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:46.169690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0da89-bd9b-4983-8b4f-5cf9fd59114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:46.170748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0da89-bd9b-4983-8b4f-5cf9fd59114a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:46.171259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0da89-bd9b-4983-8b4f-5cf9fd59114a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:46.172195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0da89-bd9b-4983-8b4f-5cf9fd59114a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:46.173242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0da89-bd9b-4983-8b4f-5cf9fd59114a None admin] RBAC: Adding query filter params (role.id=d93e06f63f2947f98ad9a668b80929dc, user.id=5716ea79b4684f43be84997a536679c7, scope.system=all) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:46.173854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0da89-bd9b-4983-8b4f-5cf9fd59114a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:46.176354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0da89-bd9b-4983-8b4f-5cf9fd59114a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:46.183107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 144/286] 10.222.0.39 () {56 vars in 1308 bytes} [Tue Jul 26 02:31:45 2022] GET /identity/v3/role_assignments?user.id=5716ea79b4684f43be84997a536679c7&scope.system=all&role.id=d93e06f63f2947f98ad9a668b80929dc => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:46.184112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0da89-bd9b-4983-8b4f-5cf9fd59114a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:46.260428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:46.299075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697cb6e-ed9d-4e25-9a64-d42c2de7b3e9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:46.308366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:46.372904 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed829a-56e4-40e0-9ee2-56f235fb81ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:46.373954 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed829a-56e4-40e0-9ee2-56f235fb81ee None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:46.374250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed829a-56e4-40e0-9ee2-56f235fb81ee None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:46.374525 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed829a-56e4-40e0-9ee2-56f235fb81ee None admin] PATH_INFO: `/v3/users/67d682bb7a8244a286dee4b92176e9fd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:46.376005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed829a-56e4-40e0-9ee2-56f235fb81ee None admin] RBAC: Authorizing `identity:get_user(user_id=67d682bb7a8244a286dee4b92176e9fd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:46.378460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed829a-56e4-40e0-9ee2-56f235fb81ee None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:46.380699 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 143/287] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:46 2022] GET /identity/v3/users/67d682bb7a8244a286dee4b92176e9fd => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:46.386701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed829a-56e4-40e0-9ee2-56f235fb81ee None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:46.400795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0da89-bd9b-4983-8b4f-5cf9fd59114a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:46.466873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3db6e6-3acf-479e-a6f6-2b46e1fa611f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:46.467494 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3db6e6-3acf-479e-a6f6-2b46e1fa611f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:46.467776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3db6e6-3acf-479e-a6f6-2b46e1fa611f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:46.468053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3db6e6-3acf-479e-a6f6-2b46e1fa611f None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:46.468791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3db6e6-3acf-479e-a6f6-2b46e1fa611f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:46.469097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3db6e6-3acf-479e-a6f6-2b46e1fa611f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:46.470519 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3db6e6-3acf-479e-a6f6-2b46e1fa611f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:46.495922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 145/288] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:46.502232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3db6e6-3acf-479e-a6f6-2b46e1fa611f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:46.545137 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed829a-56e4-40e0-9ee2-56f235fb81ee None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:46.584547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a73196-d818-4103-b8b4-baff905143a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:46.585176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a73196-d818-4103-b8b4-baff905143a3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:46.585862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a73196-d818-4103-b8b4-baff905143a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:46.586134 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a73196-d818-4103-b8b4-baff905143a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:46.634268 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:46.661367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a73196-d818-4103-b8b4-baff905143a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:46.663184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a73196-d818-4103-b8b4-baff905143a3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:46.687461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:46.709170 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3db6e6-3acf-479e-a6f6-2b46e1fa611f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:46.775958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 144/289] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:46.781726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a73196-d818-4103-b8b4-baff905143a3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:46.783199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0de74f-4a7c-49a1-b6b2-c84fdac80a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:46.784228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de74f-4a7c-49a1-b6b2-c84fdac80a49 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:46.784702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de74f-4a7c-49a1-b6b2-c84fdac80a49 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:46.785210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0de74f-4a7c-49a1-b6b2-c84fdac80a49 None admin] PATH_INFO: `/v3/users/7c82615b208d403c9c783c2264014842` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:46.791099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0de74f-4a7c-49a1-b6b2-c84fdac80a49 None admin] RBAC: Authorizing `identity:get_user(user_id=7c82615b208d403c9c783c2264014842)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:46.792922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0de74f-4a7c-49a1-b6b2-c84fdac80a49 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:46.794969 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 146/290] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:46 2022] GET /identity/v3/users/7c82615b208d403c9c783c2264014842 => generated 297 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:46.800914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0de74f-4a7c-49a1-b6b2-c84fdac80a49 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:46.865981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:46.896698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a73196-d818-4103-b8b4-baff905143a3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:46.934937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f70d33-ff2c-4344-954d-8496fe7d9e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:46.935588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f70d33-ff2c-4344-954d-8496fe7d9e42 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:46.935869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f70d33-ff2c-4344-954d-8496fe7d9e42 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:46.936143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f70d33-ff2c-4344-954d-8496fe7d9e42 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:46.938113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f70d33-ff2c-4344-954d-8496fe7d9e42 None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:46.939589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f70d33-ff2c-4344-954d-8496fe7d9e42 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:46.945683 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 145/291] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:46 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:46.947810 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f70d33-ff2c-4344-954d-8496fe7d9e42 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:46.991497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0de74f-4a7c-49a1-b6b2-c84fdac80a49 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:47.048729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d64d6-9b38-4093-b7ad-96985277706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:47.049847 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d64d6-9b38-4093-b7ad-96985277706f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:47.050324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d64d6-9b38-4093-b7ad-96985277706f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:47.050904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d64d6-9b38-4093-b7ad-96985277706f None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:47.054366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d64d6-9b38-4093-b7ad-96985277706f None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:47.056124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d64d6-9b38-4093-b7ad-96985277706f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:47.058589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 147/292] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:46 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:47.061614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f70d33-ff2c-4344-954d-8496fe7d9e42 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:47.065355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d64d6-9b38-4093-b7ad-96985277706f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:47.099203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7059da-4421-4b69-86b0-17f4a0f7ac7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:47.099838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7059da-4421-4b69-86b0-17f4a0f7ac7a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:47.100121 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7059da-4421-4b69-86b0-17f4a0f7ac7a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:47.100393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7059da-4421-4b69-86b0-17f4a0f7ac7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:47.101522 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7059da-4421-4b69-86b0-17f4a0f7ac7a None admin] RBAC: Adding query filter params (role.id=d93e06f63f2947f98ad9a668b80929dc, scope.project.id=7983d7c8afd94591898d105faa79f3ec, user.id=67d682bb7a8244a286dee4b92176e9fd) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:47.101835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7059da-4421-4b69-86b0-17f4a0f7ac7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:47.103278 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7059da-4421-4b69-86b0-17f4a0f7ac7a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:47.110431 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 146/293] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:46 2022] GET /identity/v3/role_assignments?user.id=67d682bb7a8244a286dee4b92176e9fd&scope.project.id=7983d7c8afd94591898d105faa79f3ec&role.id=d93e06f63f2947f98ad9a668b80929dc => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:47.125967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:47.243526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d64d6-9b38-4093-b7ad-96985277706f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:47.280188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad33ba8-1d14-4b37-b23c-115d6f45d243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:47.281306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad33ba8-1d14-4b37-b23c-115d6f45d243 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:47.281788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad33ba8-1d14-4b37-b23c-115d6f45d243 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:47.282251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad33ba8-1d14-4b37-b23c-115d6f45d243 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec/users/7c82615b208d403c9c783c2264014842/roles/83230fc7c4994327bedaae3eacb6067e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:47.284538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad33ba8-1d14-4b37-b23c-115d6f45d243 None admin] RBAC: Authorizing `identity:create_grant(project_id=7983d7c8afd94591898d105faa79f3ec, user_id=7c82615b208d403c9c783c2264014842, role_id=83230fc7c4994327bedaae3eacb6067e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:47.286332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad33ba8-1d14-4b37-b23c-115d6f45d243 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:47.311769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 148/294] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:31:47 2022] PUT /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec/users/7c82615b208d403c9c783c2264014842/roles/83230fc7c4994327bedaae3eacb6067e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:31:47.697512 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de7bc-78ce-4b49-83cd-30ad2706a9c1 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:47.697849 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de7bc-78ce-4b49-83cd-30ad2706a9c1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:47.698077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de7bc-78ce-4b49-83cd-30ad2706a9c1 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:47.699468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 147/295] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:47.704887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907b05-8679-4bae-9b80-5ba375750fc9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:47.705178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907b05-8679-4bae-9b80-5ba375750fc9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:47.705494 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d907b05-8679-4bae-9b80-5ba375750fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:47.726166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8d907b05-8679-4bae-9b80-5ba375750fc9 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:47.727378 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8d907b05-8679-4bae-9b80-5ba375750fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:47.778934 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0d05-7308-44e7-8433-956bbfacb1ff None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:47.779259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0d05-7308-44e7-8433-956bbfacb1ff None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:47.779489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e0d05-7308-44e7-8433-956bbfacb1ff None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:47.780852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 148/296] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:31:47.786807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f84ca-067f-4aea-a9d5-dfd76e9429e4 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:47.787176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f84ca-067f-4aea-a9d5-dfd76e9429e4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:47.787620 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f84ca-067f-4aea-a9d5-dfd76e9429e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:47.797897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 149/297] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:47.801715 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:47.808549 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-560f84ca-067f-4aea-a9d5-dfd76e9429e4 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:47.810128 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-560f84ca-067f-4aea-a9d5-dfd76e9429e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:47.820949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d907b05-8679-4bae-9b80-5ba375750fc9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:47.838683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:47.888332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 149/298] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:47.911281 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f84ca-067f-4aea-a9d5-dfd76e9429e4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:47.923690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d907b05-8679-4bae-9b80-5ba375750fc9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:47.958197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49697d9c-5531-43e2-83b6-36ad87501277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:47.958953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49697d9c-5531-43e2-83b6-36ad87501277 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:47.959298 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49697d9c-5531-43e2-83b6-36ad87501277 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:47.959663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49697d9c-5531-43e2-83b6-36ad87501277 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:47.970475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49697d9c-5531-43e2-83b6-36ad87501277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-49697d9c-5531-43e2-83b6-36ad87501277 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:47.975628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:47.976495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:47.977649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:47.977649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:47.977649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:47.977649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:47.977649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:47.977649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:47.977649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:47.977649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:47.977649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:47.977649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:47.977649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:47.977649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:47.977649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 150/299] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:31:47.983306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49697d9c-5531-43e2-83b6-36ad87501277 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:48.014522 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f84ca-067f-4aea-a9d5-dfd76e9429e4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:48.050214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2dee7-bc24-41e4-8dce-2c43528379ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:48.050967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2dee7-bc24-41e4-8dce-2c43528379ae None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:48.051255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2dee7-bc24-41e4-8dce-2c43528379ae None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:48.051530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2dee7-bc24-41e4-8dce-2c43528379ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:48.052674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2dee7-bc24-41e4-8dce-2c43528379ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:48.054269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2dee7-bc24-41e4-8dce-2c43528379ae None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:48.060899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 150/300] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:48.061733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2dee7-bc24-41e4-8dce-2c43528379ae None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:48.062259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:48.077640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:48.086604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49697d9c-5531-43e2-83b6-36ad87501277 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:48.121570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6682e41-9d5e-4e07-a854-26a7bd6b57b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:48.122344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6682e41-9d5e-4e07-a854-26a7bd6b57b6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:48.122722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6682e41-9d5e-4e07-a854-26a7bd6b57b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:48.123065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6682e41-9d5e-4e07-a854-26a7bd6b57b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:48.123800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6682e41-9d5e-4e07-a854-26a7bd6b57b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:48.124103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6682e41-9d5e-4e07-a854-26a7bd6b57b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:48.125545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6682e41-9d5e-4e07-a854-26a7bd6b57b6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:48.138931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 151/301] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:48.139758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6682e41-9d5e-4e07-a854-26a7bd6b57b6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:48.177484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2dee7-bc24-41e4-8dce-2c43528379ae None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:48.217488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3b660-ef18-4c68-85e2-a992fa4a5a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:48.218124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b660-ef18-4c68-85e2-a992fa4a5a94 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:48.218407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b660-ef18-4c68-85e2-a992fa4a5a94 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:48.218737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3b660-ef18-4c68-85e2-a992fa4a5a94 None admin] PATH_INFO: `/v3/groups` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:48.219417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3b660-ef18-4c68-85e2-a992fa4a5a94 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:48.221632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3b660-ef18-4c68-85e2-a992fa4a5a94 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:48.247460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 151/302] 10.222.0.39 () {60 vars in 1134 bytes} [Tue Jul 26 02:31:48 2022] POST /identity/v3/groups => generated 229 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:31:48.268205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6682e41-9d5e-4e07-a854-26a7bd6b57b6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:48.306210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a87a7-2ee7-44ad-a549-bfa8800416b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:48.306955 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a87a7-2ee7-44ad-a549-bfa8800416b6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:48.307237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a87a7-2ee7-44ad-a549-bfa8800416b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:48.307512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a87a7-2ee7-44ad-a549-bfa8800416b6 None admin] PATH_INFO: `/v3/users/acf89d6265b242cf9c0a0a39eb3b5098` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:48.317761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:48.324624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a87a7-2ee7-44ad-a549-bfa8800416b6 None admin] RBAC: Authorizing `identity:get_user(user_id=acf89d6265b242cf9c0a0a39eb3b5098)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:48.326385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a87a7-2ee7-44ad-a549-bfa8800416b6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:48.328181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 152/303] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:48 2022] GET /identity/v3/users/acf89d6265b242cf9c0a0a39eb3b5098 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:48.334312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3b660-ef18-4c68-85e2-a992fa4a5a94 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:48.404326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:48.451133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3b660-ef18-4c68-85e2-a992fa4a5a94 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:48.487167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a608147-7c6d-46ac-b072-9892cc9067b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:48.487955 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a608147-7c6d-46ac-b072-9892cc9067b3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:48.488245 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a608147-7c6d-46ac-b072-9892cc9067b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:48.488521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a608147-7c6d-46ac-b072-9892cc9067b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:48.489348 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a608147-7c6d-46ac-b072-9892cc9067b3 None admin] RBAC: Adding query filter params (role.id=83230fc7c4994327bedaae3eacb6067e, user.id=acf89d6265b242cf9c0a0a39eb3b5098, scope.system=all) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:48.489661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a608147-7c6d-46ac-b072-9892cc9067b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:48.491112 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a608147-7c6d-46ac-b072-9892cc9067b3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:48.496868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 152/304] 10.222.0.39 () {56 vars in 1308 bytes} [Tue Jul 26 02:31:48 2022] GET /identity/v3/role_assignments?user.id=acf89d6265b242cf9c0a0a39eb3b5098&scope.system=all&role.id=83230fc7c4994327bedaae3eacb6067e => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:48.707208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f58865-0aa4-4092-8ea2-8ddb7de58bf1 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:48.707382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f58865-0aa4-4092-8ea2-8ddb7de58bf1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:48.707652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f58865-0aa4-4092-8ea2-8ddb7de58bf1 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:48.709381 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 153/305] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:48.714706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6f386-2e60-4ada-84f4-0727c53a688f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:48.714993 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6f386-2e60-4ada-84f4-0727c53a688f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:48.715266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6f386-2e60-4ada-84f4-0727c53a688f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:48.734954 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e3e6f386-2e60-4ada-84f4-0727c53a688f None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:48.736154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e3e6f386-2e60-4ada-84f4-0727c53a688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:48.803805 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 153/306] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:48.825604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f58865-0aa4-4092-8ea2-8ddb7de58bf1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:48.927609 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f58865-0aa4-4092-8ea2-8ddb7de58bf1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:48.962442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df99590-2f43-4e48-b1bf-b86811d3f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:48.963424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df99590-2f43-4e48-b1bf-b86811d3f70f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:48.963901 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df99590-2f43-4e48-b1bf-b86811d3f70f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:48.964363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df99590-2f43-4e48-b1bf-b86811d3f70f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:48.977827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df99590-2f43-4e48-b1bf-b86811d3f70f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-1df99590-2f43-4e48-b1bf-b86811d3f70f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:48.983399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:48.984254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:48.985047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:48.985047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:48.985047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:48.985047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:48.985047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:48.985047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:48.985047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:48.985047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:48.985047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:48.985047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:48.985047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:48.985047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:48.985047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 154/307] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:48.990930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6f386-2e60-4ada-84f4-0727c53a688f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:49.051170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:49.096126 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6f386-2e60-4ada-84f4-0727c53a688f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:49.130896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6742b-7288-4988-adfb-623b05465385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:49.131536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6742b-7288-4988-adfb-623b05465385 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:49.131820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6742b-7288-4988-adfb-623b05465385 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:49.132095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6742b-7288-4988-adfb-623b05465385 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:49.132824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6742b-7288-4988-adfb-623b05465385 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:49.133134 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6742b-7288-4988-adfb-623b05465385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:49.134546 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6742b-7288-4988-adfb-623b05465385 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:49.143826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 154/308] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:49.149218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df99590-2f43-4e48-b1bf-b86811d3f70f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:49.209464 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:49.256363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df99590-2f43-4e48-b1bf-b86811d3f70f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:49.290999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d27385-94d7-49eb-b3e2-406d2c58ce90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:49.291644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d27385-94d7-49eb-b3e2-406d2c58ce90 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:49.291921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d27385-94d7-49eb-b3e2-406d2c58ce90 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:49.292194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d27385-94d7-49eb-b3e2-406d2c58ce90 None admin] PATH_INFO: `/v3/users/5716ea79b4684f43be84997a536679c7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:49.293420 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d27385-94d7-49eb-b3e2-406d2c58ce90 None admin] RBAC: Authorizing `identity:get_user(user_id=5716ea79b4684f43be84997a536679c7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:49.294910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d27385-94d7-49eb-b3e2-406d2c58ce90 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:49.296823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 155/309] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:49 2022] GET /identity/v3/users/5716ea79b4684f43be84997a536679c7 => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:49.302560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6742b-7288-4988-adfb-623b05465385 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:49.408977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6742b-7288-4988-adfb-623b05465385 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:49.429440 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:49.450143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023f57b-82cc-47fe-9036-33c1929c1d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:49.450850 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023f57b-82cc-47fe-9036-33c1929c1d7a None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:49.451127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023f57b-82cc-47fe-9036-33c1929c1d7a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:49.451397 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023f57b-82cc-47fe-9036-33c1929c1d7a None admin] PATH_INFO: `/v3/system/users/5716ea79b4684f43be84997a536679c7/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:49.453201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581bbe8-b71c-45b1-998f-f794241a5181 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:49.453510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581bbe8-b71c-45b1-998f-f794241a5181 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:49.453780 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581bbe8-b71c-45b1-998f-f794241a5181 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:49.455243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023f57b-82cc-47fe-9036-33c1929c1d7a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5716ea79b4684f43be84997a536679c7, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:49.455468 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 156/310] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:31:49.457027 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023f57b-82cc-47fe-9036-33c1929c1d7a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:49.462703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd81c1-5fa5-4242-ae9e-3154ff6b5c96 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:49.463107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd81c1-5fa5-4242-ae9e-3154ff6b5c96 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:49.463458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd81c1-5fa5-4242-ae9e-3154ff6b5c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:49.468739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 155/311] 10.222.0.39 () {58 vars in 1334 bytes} [Tue Jul 26 02:31:49 2022] PUT /identity/v3/system/users/5716ea79b4684f43be84997a536679c7/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:31:49.489583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-42dd81c1-5fa5-4242-ae9e-3154ff6b5c96 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:49.491172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-42dd81c1-5fa5-4242-ae9e-3154ff6b5c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:49.570476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 157/312] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:49.593451 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023f57b-82cc-47fe-9036-33c1929c1d7a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:49.704775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023f57b-82cc-47fe-9036-33c1929c1d7a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:49.739738 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0efc4-eee5-4c09-9484-fe9df7c7b943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:49.740388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0efc4-eee5-4c09-9484-fe9df7c7b943 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:49.740666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0efc4-eee5-4c09-9484-fe9df7c7b943 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:49.740935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0efc4-eee5-4c09-9484-fe9df7c7b943 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:49.751339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0efc4-eee5-4c09-9484-fe9df7c7b943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-60a0efc4-eee5-4c09-9484-fe9df7c7b943 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:49.757516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:49.758404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:49.759185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:49.759185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:49.759185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:49.759185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:49.759185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:49.759185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:49.759185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:49.759185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:49.759185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:49.759185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:49.759185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:49.759185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:49.759185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 156/313] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:49.764689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd81c1-5fa5-4242-ae9e-3154ff6b5c96 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:49.821845 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:49.864597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd81c1-5fa5-4242-ae9e-3154ff6b5c96 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:49.899150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9ef07-827b-4bc2-b35b-2a750d3bd255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:49.899758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9ef07-827b-4bc2-b35b-2a750d3bd255 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:49.900037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9ef07-827b-4bc2-b35b-2a750d3bd255 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:49.900308 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9ef07-827b-4bc2-b35b-2a750d3bd255 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:49.901030 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9ef07-827b-4bc2-b35b-2a750d3bd255 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:49.901357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9ef07-827b-4bc2-b35b-2a750d3bd255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:49.902734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9ef07-827b-4bc2-b35b-2a750d3bd255 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:49.911441 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 158/314] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:49.916969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0efc4-eee5-4c09-9484-fe9df7c7b943 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:49.968099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:50.027548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0efc4-eee5-4c09-9484-fe9df7c7b943 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:50.062831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b188e7e-2bd9-4d15-b82e-d12c2de236e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:50.063797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b188e7e-2bd9-4d15-b82e-d12c2de236e1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:50.064253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b188e7e-2bd9-4d15-b82e-d12c2de236e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:50.064728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b188e7e-2bd9-4d15-b82e-d12c2de236e1 None admin] PATH_INFO: `/v3/users/7c82615b208d403c9c783c2264014842` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:50.066119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b188e7e-2bd9-4d15-b82e-d12c2de236e1 None admin] RBAC: Authorizing `identity:get_user(user_id=7c82615b208d403c9c783c2264014842)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:50.067768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b188e7e-2bd9-4d15-b82e-d12c2de236e1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:50.069900 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 157/315] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:49 2022] GET /identity/v3/users/7c82615b208d403c9c783c2264014842 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:50.078631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9ef07-827b-4bc2-b35b-2a750d3bd255 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:50.193995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9ef07-827b-4bc2-b35b-2a750d3bd255 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:50.212192 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:50.231026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afbc95-8fa0-418f-aa0e-a346ba4edb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:50.231979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afbc95-8fa0-418f-aa0e-a346ba4edb2d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:50.232636 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afbc95-8fa0-418f-aa0e-a346ba4edb2d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:50.232909 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afbc95-8fa0-418f-aa0e-a346ba4edb2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:50.301415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afbc95-8fa0-418f-aa0e-a346ba4edb2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:50.302874 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afbc95-8fa0-418f-aa0e-a346ba4edb2d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:50.403596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 159/316] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:50.409313 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b188e7e-2bd9-4d15-b82e-d12c2de236e1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:50.482894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424075c-69c4-472c-b13b-af934589f3f7 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:50.483180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424075c-69c4-472c-b13b-af934589f3f7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:50.483450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424075c-69c4-472c-b13b-af934589f3f7 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:50.485011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 160/317] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:50.490212 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47899ba4-a1db-4ca1-bdee-3e12ee5a01a8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:50.490493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47899ba4-a1db-4ca1-bdee-3e12ee5a01a8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:50.490766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47899ba4-a1db-4ca1-bdee-3e12ee5a01a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:50.509381 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-47899ba4-a1db-4ca1-bdee-3e12ee5a01a8 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:50.510573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-47899ba4-a1db-4ca1-bdee-3e12ee5a01a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:50.521856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:50.527208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b188e7e-2bd9-4d15-b82e-d12c2de236e1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:50.542533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:50.567815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe92ab4-2882-4a8d-8cf5-153766c6bdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:50.568465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe92ab4-2882-4a8d-8cf5-153766c6bdc6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:50.568738 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe92ab4-2882-4a8d-8cf5-153766c6bdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:50.569009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe92ab4-2882-4a8d-8cf5-153766c6bdc6 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:50.570613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe92ab4-2882-4a8d-8cf5-153766c6bdc6 None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:50.572060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe92ab4-2882-4a8d-8cf5-153766c6bdc6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:50.573762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 158/318] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:50 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:50.580089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1655842-230f-4727-86ef-af83fa4e8149 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:50.580223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1655842-230f-4727-86ef-af83fa4e8149 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:50.580390 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1655842-230f-4727-86ef-af83fa4e8149 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:50.593312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 159/319] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:50.593312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1655842-230f-4727-86ef-af83fa4e8149 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:50.593563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 161/320] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:50.593563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765d116-6fc2-4268-8fe4-72d8f5a5a915 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:50.593563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765d116-6fc2-4268-8fe4-72d8f5a5a915 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:50.593563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765d116-6fc2-4268-8fe4-72d8f5a5a915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:50.606916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c765d116-6fc2-4268-8fe4-72d8f5a5a915 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:50.608185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c765d116-6fc2-4268-8fe4-72d8f5a5a915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:50.685587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 162/321] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:50.685587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765d116-6fc2-4268-8fe4-72d8f5a5a915 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:50.707220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1655842-230f-4727-86ef-af83fa4e8149 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:50.743045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b644e4-c1c1-4854-8f0a-a2dc6b644bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:50.743670 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b644e4-c1c1-4854-8f0a-a2dc6b644bad None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:50.743970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b644e4-c1c1-4854-8f0a-a2dc6b644bad None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:50.744246 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b644e4-c1c1-4854-8f0a-a2dc6b644bad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:50.745049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b644e4-c1c1-4854-8f0a-a2dc6b644bad None admin] RBAC: Adding query filter params (role.id=83230fc7c4994327bedaae3eacb6067e, scope.project.id=7983d7c8afd94591898d105faa79f3ec, user.id=7c82615b208d403c9c783c2264014842) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:50.745396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b644e4-c1c1-4854-8f0a-a2dc6b644bad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:50.746841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b644e4-c1c1-4854-8f0a-a2dc6b644bad None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:50.752675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 160/322] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:31:50 2022] GET /identity/v3/role_assignments?user.id=7c82615b208d403c9c783c2264014842&scope.project.id=7983d7c8afd94591898d105faa79f3ec&role.id=83230fc7c4994327bedaae3eacb6067e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:50.753479 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b644e4-c1c1-4854-8f0a-a2dc6b644bad None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:50.788208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:50.813433 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765d116-6fc2-4268-8fe4-72d8f5a5a915 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:50.822778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:50.855546 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b89a6-7dd6-4c20-925a-9320e2d024bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:50.856615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b89a6-7dd6-4c20-925a-9320e2d024bd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:50.857064 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b89a6-7dd6-4c20-925a-9320e2d024bd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:50.857504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b89a6-7dd6-4c20-925a-9320e2d024bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:50.859006 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b89a6-7dd6-4c20-925a-9320e2d024bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:50.860742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b89a6-7dd6-4c20-925a-9320e2d024bd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:50.862663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 163/323] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:31:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:50.868928 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b89a6-7dd6-4c20-925a-9320e2d024bd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:50.900065 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b644e4-c1c1-4854-8f0a-a2dc6b644bad None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:50.945538 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212603d-47c0-4217-8538-31de646e7634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:50.946607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212603d-47c0-4217-8538-31de646e7634 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:50.947081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212603d-47c0-4217-8538-31de646e7634 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:50.947589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212603d-47c0-4217-8538-31de646e7634 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:50.959348 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212603d-47c0-4217-8538-31de646e7634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b212603d-47c0-4217-8538-31de646e7634 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:50.965153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:50.966191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:50.966976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:50.966976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:50.966976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:50.966976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:50.966976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:50.966976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:50.966976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:50.966976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:50.966976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:50.966976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:50.966976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:50.966976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:50.967607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 161/324] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:50.974084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212603d-47c0-4217-8538-31de646e7634 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:50.986344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b89a6-7dd6-4c20-925a-9320e2d024bd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:51.025186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f82835-a3a3-468e-b186-7ef0f3a4b8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:51.025901 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f82835-a3a3-468e-b186-7ef0f3a4b8ca None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:51.026182 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f82835-a3a3-468e-b186-7ef0f3a4b8ca None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:51.026455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f82835-a3a3-468e-b186-7ef0f3a4b8ca None admin] PATH_INFO: `/v3/groups` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:51.027183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f82835-a3a3-468e-b186-7ef0f3a4b8ca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:51.028995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f82835-a3a3-468e-b186-7ef0f3a4b8ca None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:51.053321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 164/325] 10.222.0.39 () {60 vars in 1134 bytes} [Tue Jul 26 02:31:50 2022] POST /identity/v3/groups => generated 226 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:31:51.095654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212603d-47c0-4217-8538-31de646e7634 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:51.098340 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:51.135148 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d27b7-464a-47fd-9979-934fc8a6e736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:51.135794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d27b7-464a-47fd-9979-934fc8a6e736 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:51.136074 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d27b7-464a-47fd-9979-934fc8a6e736 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:51.136341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d27b7-464a-47fd-9979-934fc8a6e736 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:51.137091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d27b7-464a-47fd-9979-934fc8a6e736 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:51.137444 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d27b7-464a-47fd-9979-934fc8a6e736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:51.138934 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d27b7-464a-47fd-9979-934fc8a6e736 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:51.149809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 162/326] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:51.155706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f82835-a3a3-468e-b186-7ef0f3a4b8ca None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:51.159782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:51.262427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f82835-a3a3-468e-b186-7ef0f3a4b8ca None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:51.296691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60004a4-7a23-4c21-bad4-71a472762392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:51.297394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60004a4-7a23-4c21-bad4-71a472762392 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:51.297660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60004a4-7a23-4c21-bad4-71a472762392 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:51.297933 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60004a4-7a23-4c21-bad4-71a472762392 None admin] PATH_INFO: `/v3/users/acf89d6265b242cf9c0a0a39eb3b5098` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:51.299210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60004a4-7a23-4c21-bad4-71a472762392 None admin] RBAC: Authorizing `identity:get_user(user_id=acf89d6265b242cf9c0a0a39eb3b5098)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:51.300665 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60004a4-7a23-4c21-bad4-71a472762392 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:51.302672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 165/327] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:51 2022] GET /identity/v3/users/acf89d6265b242cf9c0a0a39eb3b5098 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:51.308259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d27b7-464a-47fd-9979-934fc8a6e736 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:51.418232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d27b7-464a-47fd-9979-934fc8a6e736 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:51.455231 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e867518-9060-4223-ace6-21ccd5de2f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:51.455905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867518-9060-4223-ace6-21ccd5de2f95 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:51.456183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867518-9060-4223-ace6-21ccd5de2f95 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:51.456452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e867518-9060-4223-ace6-21ccd5de2f95 None admin] PATH_INFO: `/v3/system/users/acf89d6265b242cf9c0a0a39eb3b5098/roles/83230fc7c4994327bedaae3eacb6067e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:51.457944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e867518-9060-4223-ace6-21ccd5de2f95 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=acf89d6265b242cf9c0a0a39eb3b5098, role_id=83230fc7c4994327bedaae3eacb6067e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:51.459348 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e867518-9060-4223-ace6-21ccd5de2f95 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:51.472028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 163/328] 10.222.0.39 () {58 vars in 1334 bytes} [Tue Jul 26 02:31:51 2022] PUT /identity/v3/system/users/acf89d6265b242cf9c0a0a39eb3b5098/roles/83230fc7c4994327bedaae3eacb6067e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:31:51.524631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceeaf0-f483-4612-80b1-0a9ccf33ccf8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:51.524819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceeaf0-f483-4612-80b1-0a9ccf33ccf8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:51.525115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceeaf0-f483-4612-80b1-0a9ccf33ccf8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:51.527119 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 166/329] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:51.533023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e7178-dde3-46d7-84d9-e19f5da36d35 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:51.533443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e7178-dde3-46d7-84d9-e19f5da36d35 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:51.533644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e7178-dde3-46d7-84d9-e19f5da36d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:51.554533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d46e7178-dde3-46d7-84d9-e19f5da36d35 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:51.556129 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d46e7178-dde3-46d7-84d9-e19f5da36d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:51.584756 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:51.638307 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 164/330] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:51.661328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceeaf0-f483-4612-80b1-0a9ccf33ccf8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:51.742817 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:51.779644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ceeaf0-f483-4612-80b1-0a9ccf33ccf8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:51.813539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7613f4-4c57-4208-87c8-eb6fc5a1bccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:51.814194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7613f4-4c57-4208-87c8-eb6fc5a1bccb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:51.814469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7613f4-4c57-4208-87c8-eb6fc5a1bccb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:51.814735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7613f4-4c57-4208-87c8-eb6fc5a1bccb None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:51.825862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7613f4-4c57-4208-87c8-eb6fc5a1bccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6e7613f4-4c57-4208-87c8-eb6fc5a1bccb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:51.831287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:51.832218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:51.833458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:51.833458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:51.833458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:51.833458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:51.833458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:51.833458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:51.833458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:51.833458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:51.833458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:51.833458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:51.833458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:51.833458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:51.833458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 167/331] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:51.838872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e7178-dde3-46d7-84d9-e19f5da36d35 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:51.960475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e7178-dde3-46d7-84d9-e19f5da36d35 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:52.000550 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7740d-0c9c-4d30-ab03-b8e0a4e5250c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:52.001581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7740d-0c9c-4d30-ab03-b8e0a4e5250c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:52.002052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7740d-0c9c-4d30-ab03-b8e0a4e5250c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:52.002534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7740d-0c9c-4d30-ab03-b8e0a4e5250c None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:52.003452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7740d-0c9c-4d30-ab03-b8e0a4e5250c None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:52.003944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7740d-0c9c-4d30-ab03-b8e0a4e5250c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:52.005569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7740d-0c9c-4d30-ab03-b8e0a4e5250c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:52.014796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 165/332] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:52.020591 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7613f4-4c57-4208-87c8-eb6fc5a1bccb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:52.172941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7613f4-4c57-4208-87c8-eb6fc5a1bccb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:52.207712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:52.213394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6e621-14f4-468f-8984-b12be961765a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:52.214267 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6e621-14f4-468f-8984-b12be961765a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:52.214618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6e621-14f4-468f-8984-b12be961765a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:52.215045 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6e621-14f4-468f-8984-b12be961765a None admin] PATH_INFO: `/v3/users/5716ea79b4684f43be84997a536679c7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:52.216690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6e621-14f4-468f-8984-b12be961765a None admin] RBAC: Authorizing `identity:get_user(user_id=5716ea79b4684f43be84997a536679c7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:52.218223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6e621-14f4-468f-8984-b12be961765a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:52.220452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 168/333] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:52 2022] GET /identity/v3/users/5716ea79b4684f43be84997a536679c7 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:52.227001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7740d-0c9c-4d30-ab03-b8e0a4e5250c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:52.272024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:52.362120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7740d-0c9c-4d30-ab03-b8e0a4e5250c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:52.400260 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fc3b9-5d2b-4b2b-b11c-a110cef84c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:52.401261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fc3b9-5d2b-4b2b-b11c-a110cef84c8b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:52.401758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fc3b9-5d2b-4b2b-b11c-a110cef84c8b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:52.402274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fc3b9-5d2b-4b2b-b11c-a110cef84c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:52.403281 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fc3b9-5d2b-4b2b-b11c-a110cef84c8b None admin] RBAC: Adding query filter params (role.id=d93e06f63f2947f98ad9a668b80929dc, user.id=5716ea79b4684f43be84997a536679c7, scope.system=all) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:52.403838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fc3b9-5d2b-4b2b-b11c-a110cef84c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:52.405496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fc3b9-5d2b-4b2b-b11c-a110cef84c8b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:52.422620 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 166/334] 10.222.0.39 () {56 vars in 1308 bytes} [Tue Jul 26 02:31:52 2022] GET /identity/v3/role_assignments?user.id=5716ea79b4684f43be84997a536679c7&scope.system=all&role.id=d93e06f63f2947f98ad9a668b80929dc => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:53.425686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aeaa4-2599-46e6-b4b2-9e61c8244388 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:53.426212 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aeaa4-2599-46e6-b4b2-9e61c8244388 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:53.426519 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aeaa4-2599-46e6-b4b2-9e61c8244388 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:53.428346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 169/335] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:53.434454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ff955-a9cc-4ff7-b00b-2122df1f9085 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:53.435310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ff955-a9cc-4ff7-b00b-2122df1f9085 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:53.435778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ff955-a9cc-4ff7-b00b-2122df1f9085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:53.466383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c42ff955-a9cc-4ff7-b00b-2122df1f9085 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:53.467929 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c42ff955-a9cc-4ff7-b00b-2122df1f9085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:53.558259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 167/336] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:53.593431 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aeaa4-2599-46e6-b4b2-9e61c8244388 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:53.719057 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aeaa4-2599-46e6-b4b2-9e61c8244388 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:53.761330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8d66a-99ff-4e77-94f5-1b467b8df31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:53.761967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8d66a-99ff-4e77-94f5-1b467b8df31d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:53.762246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8d66a-99ff-4e77-94f5-1b467b8df31d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:53.762517 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8d66a-99ff-4e77-94f5-1b467b8df31d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:53.773676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8d66a-99ff-4e77-94f5-1b467b8df31d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9dd8d66a-99ff-4e77-94f5-1b467b8df31d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:53.781207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:53.782150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:53.782940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:53.782940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:53.782940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:53.782940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:53.782940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:53.782940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:53.782940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:53.782940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:53.782940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:53.782940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:53.782940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:53.782940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:53.782940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 170/337] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:53.788786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ff955-a9cc-4ff7-b00b-2122df1f9085 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:53.801772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:53.913070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ff955-a9cc-4ff7-b00b-2122df1f9085 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:53.957473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e3601-9097-4e5c-833a-b915a37fa913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:53.958131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e3601-9097-4e5c-833a-b915a37fa913 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:53.958392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e3601-9097-4e5c-833a-b915a37fa913 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:53.958659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e3601-9097-4e5c-833a-b915a37fa913 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:53.959391 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e3601-9097-4e5c-833a-b915a37fa913 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:53.959870 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e3601-9097-4e5c-833a-b915a37fa913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:53.961369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3611fe0-4ec2-49d3-97e1-378a53079e60 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:53.961883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3611fe0-4ec2-49d3-97e1-378a53079e60 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:53.962341 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3611fe0-4ec2-49d3-97e1-378a53079e60 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:53.962835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e3601-9097-4e5c-833a-b915a37fa913 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:53.964397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 171/338] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:53.971849 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbb3d7-56b6-407b-8c5f-253f66f3b99e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:53.972309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 168/339] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:53.972657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbb3d7-56b6-407b-8c5f-253f66f3b99e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:53.973117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbb3d7-56b6-407b-8c5f-253f66f3b99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:53.977847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e3601-9097-4e5c-833a-b915a37fa913 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:54.000599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6adbb3d7-56b6-407b-8c5f-253f66f3b99e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:54.002210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6adbb3d7-56b6-407b-8c5f-253f66f3b99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:54.072568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:54.075342 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:54.089847 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 172/340] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:54.130554 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbb3d7-56b6-407b-8c5f-253f66f3b99e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:54.131493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e3601-9097-4e5c-833a-b915a37fa913 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:54.175875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baf2c9-a76e-4949-9753-564d772bead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:54.176765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baf2c9-a76e-4949-9753-564d772bead7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:54.177189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baf2c9-a76e-4949-9753-564d772bead7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:54.177620 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baf2c9-a76e-4949-9753-564d772bead7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:54.260958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baf2c9-a76e-4949-9753-564d772bead7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:54.262749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baf2c9-a76e-4949-9753-564d772bead7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:54.335692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:54.354534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbb3d7-56b6-407b-8c5f-253f66f3b99e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:54.369415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 169/341] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 02:31:54.375283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baf2c9-a76e-4949-9753-564d772bead7 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:54.409681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560468f-97c8-41a3-a731-c86bde4b2c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:54.410422 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560468f-97c8-41a3-a731-c86bde4b2c30 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:54.410858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560468f-97c8-41a3-a731-c86bde4b2c30 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:54.411279 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560468f-97c8-41a3-a731-c86bde4b2c30 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:54.429533 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560468f-97c8-41a3-a731-c86bde4b2c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-5560468f-97c8-41a3-a731-c86bde4b2c30 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:54.435649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:54.436690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:54.441753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:54.441753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:54.441753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:54.441753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:54.441753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:54.441753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:54.441753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:54.441753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:54.441753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:54.441753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:54.441753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:54.441753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:54.443914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 173/342] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:31:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:31:54.463475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560468f-97c8-41a3-a731-c86bde4b2c30 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:54.483330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baf2c9-a76e-4949-9753-564d772bead7 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:54.520253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2172b-4708-4c37-a755-452bbd4a15b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:54.520836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2172b-4708-4c37-a755-452bbd4a15b6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:54.521119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2172b-4708-4c37-a755-452bbd4a15b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:54.521437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2172b-4708-4c37-a755-452bbd4a15b6 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:54.522655 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2172b-4708-4c37-a755-452bbd4a15b6 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:54.524283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2172b-4708-4c37-a755-452bbd4a15b6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:54.526441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 170/343] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:54 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:54.527747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651348-61e9-4c26-b493-64b5050acc71 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:54.528173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651348-61e9-4c26-b493-64b5050acc71 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:54.528648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33651348-61e9-4c26-b493-64b5050acc71 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:54.533768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 171/344] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:54.535096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33651348-61e9-4c26-b493-64b5050acc71 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:54.560303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:54.621097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560468f-97c8-41a3-a731-c86bde4b2c30 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:54.636054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:54.663389 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174227d3-fd85-472b-b348-40bf9673dbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:54.664415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174227d3-fd85-472b-b348-40bf9673dbf1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:54.665133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174227d3-fd85-472b-b348-40bf9673dbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:54.665704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174227d3-fd85-472b-b348-40bf9673dbf1 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:54.667014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174227d3-fd85-472b-b348-40bf9673dbf1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:54.667551 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174227d3-fd85-472b-b348-40bf9673dbf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:54.669504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174227d3-fd85-472b-b348-40bf9673dbf1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:54.684056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 174/345] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:31:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:54.685794 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958c37-4ba1-48e6-a1fc-49ce41c0a283 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:54.686125 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958c37-4ba1-48e6-a1fc-49ce41c0a283 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:54.686351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0958c37-4ba1-48e6-a1fc-49ce41c0a283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:54.710522 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f0958c37-4ba1-48e6-a1fc-49ce41c0a283 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:54.711843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f0958c37-4ba1-48e6-a1fc-49ce41c0a283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:54.735414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33651348-61e9-4c26-b493-64b5050acc71 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:54.776662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb59298-9370-46c2-828d-738d81e4d2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:54.777718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb59298-9370-46c2-828d-738d81e4d2f0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:54.778303 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb59298-9370-46c2-828d-738d81e4d2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:54.778809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb59298-9370-46c2-828d-738d81e4d2f0 None admin] PATH_INFO: `/v3/groups/dc8584290b9c4b07be295fb78c477f0b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:54.786764 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb59298-9370-46c2-828d-738d81e4d2f0 None admin] RBAC: Authorizing `identity:get_group(group_id=dc8584290b9c4b07be295fb78c477f0b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:54.788753 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb59298-9370-46c2-828d-738d81e4d2f0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:54.792154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 172/346] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:31:54 2022] GET /identity/v3/groups/dc8584290b9c4b07be295fb78c477f0b => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:54.797629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e606b-816f-43cb-94e9-65219c100af5 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:54.797927 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e606b-816f-43cb-94e9-65219c100af5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:54.798204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e606b-816f-43cb-94e9-65219c100af5 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:54.799649 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 173/347] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:54.800242 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e606b-816f-43cb-94e9-65219c100af5 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:54.802080 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 175/348] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:54.802786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0958c37-4ba1-48e6-a1fc-49ce41c0a283 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:54.877090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:54.946752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e606b-816f-43cb-94e9-65219c100af5 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:54.953064 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:54.954960 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0958c37-4ba1-48e6-a1fc-49ce41c0a283 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:54.991939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101acd3c-4959-4883-a5c2-4f823f86cf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:54.994518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101acd3c-4959-4883-a5c2-4f823f86cf84 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:54.994846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101acd3c-4959-4883-a5c2-4f823f86cf84 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:54.995123 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101acd3c-4959-4883-a5c2-4f823f86cf84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:55.010989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded51853-4cb0-4404-895d-c5b4413091c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:55.011674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded51853-4cb0-4404-895d-c5b4413091c0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:55.012000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded51853-4cb0-4404-895d-c5b4413091c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:55.012277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded51853-4cb0-4404-895d-c5b4413091c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:55.013152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded51853-4cb0-4404-895d-c5b4413091c0 None admin] RBAC: Adding query filter params (group.id=dc8584290b9c4b07be295fb78c477f0b, role.id=d93e06f63f2947f98ad9a668b80929dc, scope.project.id=05ea5625e61f40ecad97004ff4e32fa4) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:55.013553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded51853-4cb0-4404-895d-c5b4413091c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:55.015113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded51853-4cb0-4404-895d-c5b4413091c0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:55.022600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 176/349] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 02:31:54 2022] GET /identity/v3/role_assignments?group.id=dc8584290b9c4b07be295fb78c477f0b&scope.project.id=05ea5625e61f40ecad97004ff4e32fa4&role.id=d93e06f63f2947f98ad9a668b80929dc => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:55.023919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864c50a-59b3-4612-b0ee-90992a9ca542 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:55.024249 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864c50a-59b3-4612-b0ee-90992a9ca542 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:55.024528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864c50a-59b3-4612-b0ee-90992a9ca542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:55.043690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0864c50a-59b3-4612-b0ee-90992a9ca542 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:55.044932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0864c50a-59b3-4612-b0ee-90992a9ca542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:55.083632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101acd3c-4959-4883-a5c2-4f823f86cf84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:55.086033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101acd3c-4959-4883-a5c2-4f823f86cf84 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:55.136247 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 177/350] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:55.137151 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864c50a-59b3-4612-b0ee-90992a9ca542 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:55.195161 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:55.278408 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864c50a-59b3-4612-b0ee-90992a9ca542 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:55.305569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 174/351] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:55.306258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101acd3c-4959-4883-a5c2-4f823f86cf84 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:55.311246 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:55.341113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d60ad4-deee-4364-9c95-83551a5a68c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:55.343862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d60ad4-deee-4364-9c95-83551a5a68c2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:55.343862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d60ad4-deee-4364-9c95-83551a5a68c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:55.343862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d60ad4-deee-4364-9c95-83551a5a68c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:55.355634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d60ad4-deee-4364-9c95-83551a5a68c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-45d60ad4-deee-4364-9c95-83551a5a68c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:55.360768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:55.361699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:55.362557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:55.362557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:55.362557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:55.362557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:55.362557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:55.362557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:55.362557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:55.362557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:55.362557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:55.362557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:55.362557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 02:31:55.362557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:55.363779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 178/352] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:55.364085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d60ad4-deee-4364-9c95-83551a5a68c2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:55.477689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:55.486438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d60ad4-deee-4364-9c95-83551a5a68c2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:55.531688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101acd3c-4959-4883-a5c2-4f823f86cf84 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:55.569546 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6e311-db98-4c31-ad8a-16b72ad62d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:55.570120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6e311-db98-4c31-ad8a-16b72ad62d9f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:55.570397 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6e311-db98-4c31-ad8a-16b72ad62d9f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:55.570663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6e311-db98-4c31-ad8a-16b72ad62d9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:55.578017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335931e-2abc-4425-b5ba-3def00471eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:55.578681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335931e-2abc-4425-b5ba-3def00471eb4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:55.578961 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335931e-2abc-4425-b5ba-3def00471eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:55.579237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335931e-2abc-4425-b5ba-3def00471eb4 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:55.580450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335931e-2abc-4425-b5ba-3def00471eb4 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:55.581938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335931e-2abc-4425-b5ba-3def00471eb4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:55.583791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 179/353] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:55 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:55.584368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335931e-2abc-4425-b5ba-3def00471eb4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:55.584474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6e311-db98-4c31-ad8a-16b72ad62d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-e9c6e311-db98-4c31-ad8a-16b72ad62d9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:55.589886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:55.590983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:55.591771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:55.591771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:55.591771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:55.591771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:55.591771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:55.591771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:55.591771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:55.591771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:55.591771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:55.591771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:55.591771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:55.591771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:55.591771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 175/354] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:55.593169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6e311-db98-4c31-ad8a-16b72ad62d9f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:55.658024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:55.699857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6e311-db98-4c31-ad8a-16b72ad62d9f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:55.734908 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098d621-b0db-4c37-a236-a8708aa048ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:55.735583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098d621-b0db-4c37-a236-a8708aa048ee None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:55.735869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098d621-b0db-4c37-a236-a8708aa048ee None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:55.736141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098d621-b0db-4c37-a236-a8708aa048ee None admin] PATH_INFO: `/v3/groups/dc8584290b9c4b07be295fb78c477f0b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:55.737316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098d621-b0db-4c37-a236-a8708aa048ee None admin] RBAC: Authorizing `identity:get_group(group_id=dc8584290b9c4b07be295fb78c477f0b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:55.738775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098d621-b0db-4c37-a236-a8708aa048ee None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:55.740387 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 176/355] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:31:55 2022] GET /identity/v3/groups/dc8584290b9c4b07be295fb78c477f0b => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:55.741231 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098d621-b0db-4c37-a236-a8708aa048ee None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:55.774332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335931e-2abc-4425-b5ba-3def00471eb4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:55.818238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f05fae-815c-43e0-b291-a4a33a1e59a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:55.818872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f05fae-815c-43e0-b291-a4a33a1e59a5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:55.819399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f05fae-815c-43e0-b291-a4a33a1e59a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:55.819732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f05fae-815c-43e0-b291-a4a33a1e59a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:55.821313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f05fae-815c-43e0-b291-a4a33a1e59a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:55.821631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f05fae-815c-43e0-b291-a4a33a1e59a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:55.823022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f05fae-815c-43e0-b291-a4a33a1e59a5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:55.834377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 180/356] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:55.836221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835a0bc-ef09-437e-a4f8-9dfd54f3672b None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:55.836644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835a0bc-ef09-437e-a4f8-9dfd54f3672b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:55.837049 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835a0bc-ef09-437e-a4f8-9dfd54f3672b None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:55.838697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 181/357] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:55.839621 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835a0bc-ef09-437e-a4f8-9dfd54f3672b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:55.861166 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098d621-b0db-4c37-a236-a8708aa048ee None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:55.881232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:55.896288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:55.902136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2229e-922c-435b-8bc1-288df5650c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:55.903041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2229e-922c-435b-8bc1-288df5650c86 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:55.903508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2229e-922c-435b-8bc1-288df5650c86 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:55.903776 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2229e-922c-435b-8bc1-288df5650c86 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:55.904505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2229e-922c-435b-8bc1-288df5650c86 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:55.904810 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2229e-922c-435b-8bc1-288df5650c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:55.906226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2229e-922c-435b-8bc1-288df5650c86 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:55.915067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 177/358] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:55.915788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2229e-922c-435b-8bc1-288df5650c86 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:55.974945 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835a0bc-ef09-437e-a4f8-9dfd54f3672b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:56.013214 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce8232-6874-4cc7-b10e-30de6f7ff3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:56.013939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8232-6874-4cc7-b10e-30de6f7ff3e4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:56.014219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8232-6874-4cc7-b10e-30de6f7ff3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:56.014485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8232-6874-4cc7-b10e-30de6f7ff3e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:56.015288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce8232-6874-4cc7-b10e-30de6f7ff3e4 None admin] RBAC: Adding query filter params (group.id=dc8584290b9c4b07be295fb78c477f0b, role.id=506da913e25f44b1854b24215eb447fc, scope.project.id=05ea5625e61f40ecad97004ff4e32fa4) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:56.015596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce8232-6874-4cc7-b10e-30de6f7ff3e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:56.017040 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce8232-6874-4cc7-b10e-30de6f7ff3e4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:56.025584 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 182/359] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 02:31:55 2022] GET /identity/v3/role_assignments?group.id=dc8584290b9c4b07be295fb78c477f0b&scope.project.id=05ea5625e61f40ecad97004ff4e32fa4&role.id=506da913e25f44b1854b24215eb447fc => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:56.026903 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3e4d5-d28d-4106-87f1-c4b88b9b2429 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:56.027205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3e4d5-d28d-4106-87f1-c4b88b9b2429 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:56.028006 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3e4d5-d28d-4106-87f1-c4b88b9b2429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:56.029478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2229e-922c-435b-8bc1-288df5650c86 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:56.048090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-45c3e4d5-d28d-4106-87f1-c4b88b9b2429 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:56.049313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-45c3e4d5-d28d-4106-87f1-c4b88b9b2429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:56.067428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924b871-7ec9-4770-bb37-3faecd8c4c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:56.068096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924b871-7ec9-4770-bb37-3faecd8c4c4d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:56.068367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924b871-7ec9-4770-bb37-3faecd8c4c4d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:56.068635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924b871-7ec9-4770-bb37-3faecd8c4c4d None admin] PATH_INFO: `/v3/users/acf89d6265b242cf9c0a0a39eb3b5098` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:56.069959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924b871-7ec9-4770-bb37-3faecd8c4c4d None admin] RBAC: Authorizing `identity:get_user(user_id=acf89d6265b242cf9c0a0a39eb3b5098)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:56.071389 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924b871-7ec9-4770-bb37-3faecd8c4c4d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:56.073169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 178/360] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:31:55 2022] GET /identity/v3/users/acf89d6265b242cf9c0a0a39eb3b5098 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:56.075234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924b871-7ec9-4770-bb37-3faecd8c4c4d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:56.146388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:56.190120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924b871-7ec9-4770-bb37-3faecd8c4c4d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:56.224621 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 183/361] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:56.225951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3e4d5-d28d-4106-87f1-c4b88b9b2429 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:56.230812 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12428051-e014-48c9-8e59-07b757f245a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:56.231512 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428051-e014-48c9-8e59-07b757f245a1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:56.231791 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428051-e014-48c9-8e59-07b757f245a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:56.232059 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428051-e014-48c9-8e59-07b757f245a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:56.253141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:56.303495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12428051-e014-48c9-8e59-07b757f245a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:56.305225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12428051-e014-48c9-8e59-07b757f245a1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:56.343132 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3e4d5-d28d-4106-87f1-c4b88b9b2429 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:56.368133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:56.383806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9847e9-03c7-42c8-af5b-4ee796ca8a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:56.384787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9847e9-03c7-42c8-af5b-4ee796ca8a2c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:56.385428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9847e9-03c7-42c8-af5b-4ee796ca8a2c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:56.385896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9847e9-03c7-42c8-af5b-4ee796ca8a2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:56.386891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9847e9-03c7-42c8-af5b-4ee796ca8a2c None admin] RBAC: Adding query filter params (role.id=83230fc7c4994327bedaae3eacb6067e, user.id=acf89d6265b242cf9c0a0a39eb3b5098, scope.system=all) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:56.387602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9847e9-03c7-42c8-af5b-4ee796ca8a2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:56.389362 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9847e9-03c7-42c8-af5b-4ee796ca8a2c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:56.403569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 184/362] 10.222.0.39 () {56 vars in 1308 bytes} [Tue Jul 26 02:31:56 2022] GET /identity/v3/role_assignments?user.id=acf89d6265b242cf9c0a0a39eb3b5098&scope.system=all&role.id=83230fc7c4994327bedaae3eacb6067e => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:56.405324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882fc17-ca0a-4f84-b024-1e802db7a96c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:56.405812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882fc17-ca0a-4f84-b024-1e802db7a96c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:56.406281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882fc17-ca0a-4f84-b024-1e802db7a96c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:56.408238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 185/363] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:56.409457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882fc17-ca0a-4f84-b024-1e802db7a96c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:56.414498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 179/364] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:56.415051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5150d-f866-4fc5-a46d-5051f89d0c84 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:56.415330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5150d-f866-4fc5-a46d-5051f89d0c84 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:56.415595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5150d-f866-4fc5-a46d-5051f89d0c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:56.434824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2ae5150d-f866-4fc5-a46d-5051f89d0c84 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:56.436375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2ae5150d-f866-4fc5-a46d-5051f89d0c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:56.547969 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:56.563124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882fc17-ca0a-4f84-b024-1e802db7a96c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:56.597883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 180/365] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:56.598818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5150d-f866-4fc5-a46d-5051f89d0c84 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:56.606480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe202c0-c499-48a9-aa94-9824e11d494c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:56.607689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe202c0-c499-48a9-aa94-9824e11d494c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:56.608190 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe202c0-c499-48a9-aa94-9824e11d494c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:56.610940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe202c0-c499-48a9-aa94-9824e11d494c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:56.623439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe202c0-c499-48a9-aa94-9824e11d494c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-5fe202c0-c499-48a9-aa94-9824e11d494c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:56.628967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:56.630001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:56.630979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:56.630979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:56.630979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:56.630979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:56.630979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:56.630979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:56.630979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:56.630979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:56.630979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:56.630979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:56.630979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:56.630979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:56.633004 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 186/366] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:31:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:56.633988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe202c0-c499-48a9-aa94-9824e11d494c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:56.751485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:56.762206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe202c0-c499-48a9-aa94-9824e11d494c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:56.762728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5150d-f866-4fc5-a46d-5051f89d0c84 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:56.817742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17b906-715f-49b0-b2a9-f252423f38ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:56.818400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17b906-715f-49b0-b2a9-f252423f38ee None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:56.818679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17b906-715f-49b0-b2a9-f252423f38ee None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:56.818946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17b906-715f-49b0-b2a9-f252423f38ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:56.823951 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62167ac7-288b-4606-9ba3-fee1d6e7ee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:56.824836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62167ac7-288b-4606-9ba3-fee1d6e7ee1c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:56.825433 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62167ac7-288b-4606-9ba3-fee1d6e7ee1c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:56.826073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62167ac7-288b-4606-9ba3-fee1d6e7ee1c None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:56.827076 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:56.828639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62167ac7-288b-4606-9ba3-fee1d6e7ee1c None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:56.830490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62167ac7-288b-4606-9ba3-fee1d6e7ee1c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:56.831819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17b906-715f-49b0-b2a9-f252423f38ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-3a17b906-715f-49b0-b2a9-f252423f38ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:56.836949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:56.838048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:56.838864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:56.838864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:56.838864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:56.838864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:56.838864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:56.838864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:56.838864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:56.838864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:56.838864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:56.838864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:56.838864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:31:56.838864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:56.839899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 187/368] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:31:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:31:56.840166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17b906-715f-49b0-b2a9-f252423f38ee None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:56.840254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 181/368] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:56 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:56.842182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62167ac7-288b-4606-9ba3-fee1d6e7ee1c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:56.947958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62167ac7-288b-4606-9ba3-fee1d6e7ee1c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:56.949428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17b906-715f-49b0-b2a9-f252423f38ee None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:56.983806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05500b6-4411-4c71-b3cb-a2ffa34ca4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:56.985137 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05500b6-4411-4c71-b3cb-a2ffa34ca4e1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:56.985749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05500b6-4411-4c71-b3cb-a2ffa34ca4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:56.986211 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50382f3-4f28-4528-afc5-f1357e483ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:56.986411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05500b6-4411-4c71-b3cb-a2ffa34ca4e1 None admin] PATH_INFO: `/v3/groups/dc8584290b9c4b07be295fb78c477f0b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:56.986823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50382f3-4f28-4528-afc5-f1357e483ae0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:56.987112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50382f3-4f28-4528-afc5-f1357e483ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:56.987555 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50382f3-4f28-4528-afc5-f1357e483ae0 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:56.988298 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50382f3-4f28-4528-afc5-f1357e483ae0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:56.988606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50382f3-4f28-4528-afc5-f1357e483ae0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:56.989037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05500b6-4411-4c71-b3cb-a2ffa34ca4e1 None admin] RBAC: Authorizing `identity:get_group(group_id=dc8584290b9c4b07be295fb78c477f0b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:56.990029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50382f3-4f28-4528-afc5-f1357e483ae0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:56.990937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05500b6-4411-4c71-b3cb-a2ffa34ca4e1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:56.997015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 182/369] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:31:56 2022] GET /identity/v3/groups/dc8584290b9c4b07be295fb78c477f0b => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:56.998147 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05500b6-4411-4c71-b3cb-a2ffa34ca4e1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:56.998984 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 188/370] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:31:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:57.003430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50382f3-4f28-4528-afc5-f1357e483ae0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:57.028529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:57.070327 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:57.103073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05500b6-4411-4c71-b3cb-a2ffa34ca4e1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:57.116117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50382f3-4f28-4528-afc5-f1357e483ae0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:57.139060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4c61d-99ad-406d-b0b2-664534f56fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:57.140122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4c61d-99ad-406d-b0b2-664534f56fdd None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:57.140592 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4c61d-99ad-406d-b0b2-664534f56fdd None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:57.141050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4c61d-99ad-406d-b0b2-664534f56fdd None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:57.142067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4c61d-99ad-406d-b0b2-664534f56fdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:57.142636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4c61d-99ad-406d-b0b2-664534f56fdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:57.144277 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4c61d-99ad-406d-b0b2-664534f56fdd None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:57.152835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc466b5f-fd69-4b12-bd9a-85d92fedcc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:57.153553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc466b5f-fd69-4b12-bd9a-85d92fedcc46 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:57.153839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc466b5f-fd69-4b12-bd9a-85d92fedcc46 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:57.154115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc466b5f-fd69-4b12-bd9a-85d92fedcc46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:57.154867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 183/371] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:57.155222 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc466b5f-fd69-4b12-bd9a-85d92fedcc46 None admin] RBAC: Adding query filter params (group.id=dc8584290b9c4b07be295fb78c477f0b, role.id=d93e06f63f2947f98ad9a668b80929dc, scope.project.id=7983d7c8afd94591898d105faa79f3ec) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:57.155539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc466b5f-fd69-4b12-bd9a-85d92fedcc46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:57.156450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4c61d-99ad-406d-b0b2-664534f56fdd None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:57.157011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc466b5f-fd69-4b12-bd9a-85d92fedcc46 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:57.164591 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 189/372] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 02:31:57 2022] GET /identity/v3/role_assignments?group.id=dc8584290b9c4b07be295fb78c477f0b&scope.project.id=7983d7c8afd94591898d105faa79f3ec&role.id=d93e06f63f2947f98ad9a668b80929dc => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:57.165447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc466b5f-fd69-4b12-bd9a-85d92fedcc46 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:57.257826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:57.270822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4c61d-99ad-406d-b0b2-664534f56fdd None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:57.292635 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc466b5f-fd69-4b12-bd9a-85d92fedcc46 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:57.318616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929265-c11d-469d-81e5-30e833b4ea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:57.320098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929265-c11d-469d-81e5-30e833b4ea1e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:57.320613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929265-c11d-469d-81e5-30e833b4ea1e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:57.321052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70929265-c11d-469d-81e5-30e833b4ea1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:57.327740 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:57.375805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431a9e7-ba13-4abc-bd39-665936fe98bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:57.376409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431a9e7-ba13-4abc-bd39-665936fe98bf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:57.376689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431a9e7-ba13-4abc-bd39-665936fe98bf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:57.376963 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431a9e7-ba13-4abc-bd39-665936fe98bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:57.408635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70929265-c11d-469d-81e5-30e833b4ea1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:57.410718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70929265-c11d-469d-81e5-30e833b4ea1e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:57.532411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:57.550494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 184/373] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:57.561034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431a9e7-ba13-4abc-bd39-665936fe98bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:57.562534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431a9e7-ba13-4abc-bd39-665936fe98bf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:57.566189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929265-c11d-469d-81e5-30e833b4ea1e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:57.751215 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70929265-c11d-469d-81e5-30e833b4ea1e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:57.756059 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 190/374] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:31:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:31:57.761744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431a9e7-ba13-4abc-bd39-665936fe98bf None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:57.806320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:57.826964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc94b6e-bba7-4874-94b9-0697da9ee988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:57.827625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc94b6e-bba7-4874-94b9-0697da9ee988 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:57.827906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc94b6e-bba7-4874-94b9-0697da9ee988 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:57.828179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc94b6e-bba7-4874-94b9-0697da9ee988 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:57.829499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc94b6e-bba7-4874-94b9-0697da9ee988 None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:57.831017 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc94b6e-bba7-4874-94b9-0697da9ee988 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:57.832784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 185/375] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:57 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:57.839593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc94b6e-bba7-4874-94b9-0697da9ee988 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:57.919407 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431a9e7-ba13-4abc-bd39-665936fe98bf None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:57.931033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:57.965173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953a7ba-6a3e-45c0-8ff8-8e1048a6f8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:57.966415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953a7ba-6a3e-45c0-8ff8-8e1048a6f8c5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:57.967323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953a7ba-6a3e-45c0-8ff8-8e1048a6f8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:57.967754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953a7ba-6a3e-45c0-8ff8-8e1048a6f8c5 None admin] PATH_INFO: `/v3/projects/dcd69a7399884288be80cb2c7e9c442d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:57.969086 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953a7ba-6a3e-45c0-8ff8-8e1048a6f8c5 None admin] RBAC: Authorizing `identity:get_project(project_id=dcd69a7399884288be80cb2c7e9c442d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:57.971545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953a7ba-6a3e-45c0-8ff8-8e1048a6f8c5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:57.974416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 191/376] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:57 2022] GET /identity/v3/projects/dcd69a7399884288be80cb2c7e9c442d => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:57.975762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d55d52-37dd-411f-84ef-37974dc44f53 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:57.976213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d55d52-37dd-411f-84ef-37974dc44f53 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:57.976632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d55d52-37dd-411f-84ef-37974dc44f53 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:57.978826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 192/377] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:57.983999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d55d52-37dd-411f-84ef-37974dc44f53 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:57.991885 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc94b6e-bba7-4874-94b9-0697da9ee988 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:58.037710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d5d5f-68c3-4ae4-bf73-670d5ce4a678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:58.037710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d5d5f-68c3-4ae4-bf73-670d5ce4a678 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:58.038016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d5d5f-68c3-4ae4-bf73-670d5ce4a678 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:58.038231 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d5d5f-68c3-4ae4-bf73-670d5ce4a678 None admin] PATH_INFO: `/v3/groups/dc8584290b9c4b07be295fb78c477f0b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:58.039383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d5d5f-68c3-4ae4-bf73-670d5ce4a678 None admin] RBAC: Authorizing `identity:get_group(group_id=dc8584290b9c4b07be295fb78c477f0b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:58.040861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d5d5f-68c3-4ae4-bf73-670d5ce4a678 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:58.042880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 186/378] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:31:57 2022] GET /identity/v3/groups/dc8584290b9c4b07be295fb78c477f0b => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:58.049896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bbf49-2fbc-4bb5-8894-e600f7fb6d00 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:58.050180 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bbf49-2fbc-4bb5-8894-e600f7fb6d00 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:58.050461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776bbf49-2fbc-4bb5-8894-e600f7fb6d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:58.072368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-776bbf49-2fbc-4bb5-8894-e600f7fb6d00 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:58.073508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-776bbf49-2fbc-4bb5-8894-e600f7fb6d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:58.107127 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:58.122276 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d55d52-37dd-411f-84ef-37974dc44f53 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:58.156062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 187/379] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:58.157459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bbf49-2fbc-4bb5-8894-e600f7fb6d00 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:58.166974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168f3a9-ccc3-47e9-a840-f8a6ad3e876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:58.167641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168f3a9-ccc3-47e9-a840-f8a6ad3e876a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:58.167924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168f3a9-ccc3-47e9-a840-f8a6ad3e876a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:58.168205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168f3a9-ccc3-47e9-a840-f8a6ad3e876a None admin] PATH_INFO: `/v3/groups/ec0d8308cbff44e690f9f5501743ad22` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:58.179258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168f3a9-ccc3-47e9-a840-f8a6ad3e876a None admin] RBAC: Authorizing `identity:get_group(group_id=ec0d8308cbff44e690f9f5501743ad22)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:58.180712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168f3a9-ccc3-47e9-a840-f8a6ad3e876a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:58.182796 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 193/380] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:31:57 2022] GET /identity/v3/groups/ec0d8308cbff44e690f9f5501743ad22 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:58.194341 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168f3a9-ccc3-47e9-a840-f8a6ad3e876a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:58.227778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:58.275938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776bbf49-2fbc-4bb5-8894-e600f7fb6d00 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:58.305116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168f3a9-ccc3-47e9-a840-f8a6ad3e876a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:58.314498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb42f26-9e17-46cd-ba80-708485d56c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:58.315658 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb42f26-9e17-46cd-ba80-708485d56c4d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:58.316193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb42f26-9e17-46cd-ba80-708485d56c4d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:58.316677 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb42f26-9e17-46cd-ba80-708485d56c4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:58.317775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb42f26-9e17-46cd-ba80-708485d56c4d None admin] RBAC: Adding query filter params (group.id=dc8584290b9c4b07be295fb78c477f0b, role.id=506da913e25f44b1854b24215eb447fc, scope.project.id=7983d7c8afd94591898d105faa79f3ec) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:58.318296 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb42f26-9e17-46cd-ba80-708485d56c4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:58.320061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb42f26-9e17-46cd-ba80-708485d56c4d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:58.327082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 188/381] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 02:31:58 2022] GET /identity/v3/role_assignments?group.id=dc8584290b9c4b07be295fb78c477f0b&scope.project.id=7983d7c8afd94591898d105faa79f3ec&role.id=506da913e25f44b1854b24215eb447fc => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:58.328137 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb42f26-9e17-46cd-ba80-708485d56c4d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:58.341810 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf853d-e505-44b5-8dfa-048c3220f431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:58.342855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf853d-e505-44b5-8dfa-048c3220f431 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:58.342855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf853d-e505-44b5-8dfa-048c3220f431 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:58.343144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf853d-e505-44b5-8dfa-048c3220f431 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:58.363970 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf853d-e505-44b5-8dfa-048c3220f431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ffcf853d-e505-44b5-8dfa-048c3220f431 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:58.369688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:58.370691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:58.371535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:58.371535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:58.371535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:58.371535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:58.371535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:58.371535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:58.371535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:58.371535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:58.371535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:58.371535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:58.371535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:31:58.371535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:31:58.372947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 194/382] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:31:58.383853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf853d-e505-44b5-8dfa-048c3220f431 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:58.419023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:58.488711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb42f26-9e17-46cd-ba80-708485d56c4d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:58.511371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:58.521089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf853d-e505-44b5-8dfa-048c3220f431 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:58.527465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94632402-3f10-41fb-9ea1-4f0d11e8e79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:58.528159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94632402-3f10-41fb-9ea1-4f0d11e8e79b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:58.528502 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94632402-3f10-41fb-9ea1-4f0d11e8e79b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:58.528772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94632402-3f10-41fb-9ea1-4f0d11e8e79b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:58.529607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94632402-3f10-41fb-9ea1-4f0d11e8e79b None admin] RBAC: Adding query filter params (group.id=ec0d8308cbff44e690f9f5501743ad22, role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=dcd69a7399884288be80cb2c7e9c442d) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:58.529913 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94632402-3f10-41fb-9ea1-4f0d11e8e79b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:58.531483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94632402-3f10-41fb-9ea1-4f0d11e8e79b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:58.539009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 189/383] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 02:31:58 2022] GET /identity/v3/role_assignments?group.id=ec0d8308cbff44e690f9f5501743ad22&scope.project.id=dcd69a7399884288be80cb2c7e9c442d&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:58.540445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30dff-5cb7-4dc6-af17-e8d4b9ff90f7 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:58.540719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30dff-5cb7-4dc6-af17-e8d4b9ff90f7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:58.540990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30dff-5cb7-4dc6-af17-e8d4b9ff90f7 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:58.542670 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 190/384] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:58.548651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a4d93-0ffa-40be-b090-4d62d67452c8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:58.548931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a4d93-0ffa-40be-b090-4d62d67452c8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:58.549208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a4d93-0ffa-40be-b090-4d62d67452c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:58.564414 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b73a6-280d-4e01-a9ca-ad92d83e3923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:58.565692 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b73a6-280d-4e01-a9ca-ad92d83e3923 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:58.566139 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b73a6-280d-4e01-a9ca-ad92d83e3923 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:58.566567 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b73a6-280d-4e01-a9ca-ad92d83e3923 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:58.567458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b73a6-280d-4e01-a9ca-ad92d83e3923 None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:58.567916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b73a6-280d-4e01-a9ca-ad92d83e3923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:58.569633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b73a6-280d-4e01-a9ca-ad92d83e3923 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:58.569782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d32a4d93-0ffa-40be-b090-4d62d67452c8 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:58.571003 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d32a4d93-0ffa-40be-b090-4d62d67452c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:58.580760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 195/385] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:31:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:58.586919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b73a6-280d-4e01-a9ca-ad92d83e3923 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:58.656590 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 191/386] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:31:58.682273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a4d93-0ffa-40be-b090-4d62d67452c8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:58.691748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:58.725214 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b73a6-280d-4e01-a9ca-ad92d83e3923 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:58.783448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c2cac-3f4d-41f3-b7d3-140027273f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:58.784521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c2cac-3f4d-41f3-b7d3-140027273f26 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:58.785010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c2cac-3f4d-41f3-b7d3-140027273f26 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:58.785531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c2cac-3f4d-41f3-b7d3-140027273f26 None admin] PATH_INFO: `/v3/groups/dc8584290b9c4b07be295fb78c477f0b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:58.790147 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c2cac-3f4d-41f3-b7d3-140027273f26 None admin] RBAC: Authorizing `identity:get_group(group_id=dc8584290b9c4b07be295fb78c477f0b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:58.791878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c2cac-3f4d-41f3-b7d3-140027273f26 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:58.794185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 196/387] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:31:58 2022] GET /identity/v3/groups/dc8584290b9c4b07be295fb78c477f0b => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:58.797343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a4d93-0ffa-40be-b090-4d62d67452c8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:58.800394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c2cac-3f4d-41f3-b7d3-140027273f26 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:58.812241 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:58.834498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b153f4-dea5-4c98-8b08-6675053b29fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:58.835077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b153f4-dea5-4c98-8b08-6675053b29fc None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:58.835353 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b153f4-dea5-4c98-8b08-6675053b29fc None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:58.835621 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b153f4-dea5-4c98-8b08-6675053b29fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:58.849318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b153f4-dea5-4c98-8b08-6675053b29fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-68b153f4-dea5-4c98-8b08-6675053b29fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:31:58.854141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:31:58.855026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:31:58.855798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:31:58.855798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:31:58.855798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:31:58.855798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:31:58.855798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:31:58.855798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:31:58.855798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:31:58.855798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:31:58.855798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:31:58.855798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:31:58.855798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:31:58.855798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:31:58.855798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 192/388] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:31:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:31:58.861553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b153f4-dea5-4c98-8b08-6675053b29fc None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:58.920317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c2cac-3f4d-41f3-b7d3-140027273f26 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:58.955478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed509bbb-732d-4d48-88a9-458f211d294a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:58.956524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed509bbb-732d-4d48-88a9-458f211d294a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:58.957019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed509bbb-732d-4d48-88a9-458f211d294a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:58.957527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed509bbb-732d-4d48-88a9-458f211d294a None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:58.958930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed509bbb-732d-4d48-88a9-458f211d294a None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:58.960610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed509bbb-732d-4d48-88a9-458f211d294a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:58.963914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 197/389] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:58 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:58.968861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b153f4-dea5-4c98-8b08-6675053b29fc None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:58.969995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed509bbb-732d-4d48-88a9-458f211d294a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:59.006714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce6886-2e89-4080-9b02-0e13e58cbf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:59.007356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce6886-2e89-4080-9b02-0e13e58cbf82 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:59.007623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce6886-2e89-4080-9b02-0e13e58cbf82 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:59.007896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce6886-2e89-4080-9b02-0e13e58cbf82 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:59.008610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce6886-2e89-4080-9b02-0e13e58cbf82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:31:59.008914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce6886-2e89-4080-9b02-0e13e58cbf82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:59.010352 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce6886-2e89-4080-9b02-0e13e58cbf82 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:59.021165 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 193/390] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:31:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:31:59.027799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce6886-2e89-4080-9b02-0e13e58cbf82 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:59.041711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:59.082639 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed509bbb-732d-4d48-88a9-458f211d294a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:59.101814 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:59.129439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf629b-203a-4f6e-9b4e-8888265a7a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:59.130224 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf629b-203a-4f6e-9b4e-8888265a7a21 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:59.130506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf629b-203a-4f6e-9b4e-8888265a7a21 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:59.130783 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf629b-203a-4f6e-9b4e-8888265a7a21 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4/groups/dc8584290b9c4b07be295fb78c477f0b/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:59.134364 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf629b-203a-4f6e-9b4e-8888265a7a21 None admin] RBAC: Authorizing `identity:create_grant(project_id=05ea5625e61f40ecad97004ff4e32fa4, group_id=dc8584290b9c4b07be295fb78c477f0b, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:59.137675 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf629b-203a-4f6e-9b4e-8888265a7a21 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:59.161704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 198/391] 10.222.0.39 () {58 vars in 1442 bytes} [Tue Jul 26 02:31:58 2022] PUT /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4/groups/dc8584290b9c4b07be295fb78c477f0b/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:31:59.207790 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce6886-2e89-4080-9b02-0e13e58cbf82 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:59.256373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7cdb4-fccd-4f80-829c-8b5c2ad603f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:59.257450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7cdb4-fccd-4f80-829c-8b5c2ad603f1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:59.257989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7cdb4-fccd-4f80-829c-8b5c2ad603f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:59.258496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7cdb4-fccd-4f80-829c-8b5c2ad603f1 None admin] PATH_INFO: `/v3/groups/dc8584290b9c4b07be295fb78c477f0b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:59.260836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7cdb4-fccd-4f80-829c-8b5c2ad603f1 None admin] RBAC: Authorizing `identity:get_group(group_id=dc8584290b9c4b07be295fb78c477f0b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:59.262725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7cdb4-fccd-4f80-829c-8b5c2ad603f1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:59.264692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 194/392] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:31:59 2022] GET /identity/v3/groups/dc8584290b9c4b07be295fb78c477f0b => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:59.271000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf629b-203a-4f6e-9b4e-8888265a7a21 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:59.369065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:59.401302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf629b-203a-4f6e-9b4e-8888265a7a21 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:59.438839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73a075-dda8-436b-9386-7259c3be1dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:59.439498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73a075-dda8-436b-9386-7259c3be1dd1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:59.439782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73a075-dda8-436b-9386-7259c3be1dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:59.440057 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73a075-dda8-436b-9386-7259c3be1dd1 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:59.441355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73a075-dda8-436b-9386-7259c3be1dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:59.442827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73a075-dda8-436b-9386-7259c3be1dd1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:59.444969 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 199/393] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:31:59 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:31:59.450847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7cdb4-fccd-4f80-829c-8b5c2ad603f1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:59.575699 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7cdb4-fccd-4f80-829c-8b5c2ad603f1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:31:59.578135 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:31:59.619749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c1c58-c3c9-46c6-b760-2d86a120cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:31:59.620353 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c1c58-c3c9-46c6-b760-2d86a120cc5d None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:59.620646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c1c58-c3c9-46c6-b760-2d86a120cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:59.620917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c1c58-c3c9-46c6-b760-2d86a120cc5d None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4/groups/dc8584290b9c4b07be295fb78c477f0b/roles/506da913e25f44b1854b24215eb447fc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:59.623264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c1c58-c3c9-46c6-b760-2d86a120cc5d None admin] RBAC: Authorizing `identity:create_grant(project_id=05ea5625e61f40ecad97004ff4e32fa4, group_id=dc8584290b9c4b07be295fb78c477f0b, role_id=506da913e25f44b1854b24215eb447fc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:31:59.624743 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c1c58-c3c9-46c6-b760-2d86a120cc5d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:31:59.642073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 195/394] 10.222.0.39 () {58 vars in 1442 bytes} [Tue Jul 26 02:31:59 2022] PUT /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4/groups/dc8584290b9c4b07be295fb78c477f0b/roles/506da913e25f44b1854b24215eb447fc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:31:59.681208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b65f1-ec22-4c10-a418-ffa44b8227d2 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:59.681819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b65f1-ec22-4c10-a418-ffa44b8227d2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:59.681819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b65f1-ec22-4c10-a418-ffa44b8227d2 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:59.683194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 200/395] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:31:59.689250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d261b-94e0-49a0-9626-e83c36ce0b16 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:31:59.689785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d261b-94e0-49a0-9626-e83c36ce0b16 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:31:59.690229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3d261b-94e0-49a0-9626-e83c36ce0b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:31:59.716422 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ee3d261b-94e0-49a0-9626-e83c36ce0b16 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:31:59.717981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ee3d261b-94e0-49a0-9626-e83c36ce0b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:31:59.816312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 196/396] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:31:59.844568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b65f1-ec22-4c10-a418-ffa44b8227d2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:31:59.988174 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b65f1-ec22-4c10-a418-ffa44b8227d2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:00.032819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f3aab-4928-45e8-a73b-b4dc7b3fcd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:00.033499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f3aab-4928-45e8-a73b-b4dc7b3fcd4e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:00.033781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f3aab-4928-45e8-a73b-b4dc7b3fcd4e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:00.034053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f3aab-4928-45e8-a73b-b4dc7b3fcd4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:00.050803 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f3aab-4928-45e8-a73b-b4dc7b3fcd4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-df9f3aab-4928-45e8-a73b-b4dc7b3fcd4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:00.056419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:00.057334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:00.058123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:00.058123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:00.058123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:00.058123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:00.058123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:00.058123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:00.058123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:00.058123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:00.058123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:00.058123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:00.058123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:32:00.058123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:00.058123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 201/397] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:31:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:00.063608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d261b-94e0-49a0-9626-e83c36ce0b16 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:00.174759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:00.184935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3d261b-94e0-49a0-9626-e83c36ce0b16 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:00.235462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba873b0-6872-41d0-87cf-0608c036e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:00.236101 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba873b0-6872-41d0-87cf-0608c036e541 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:00.236385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba873b0-6872-41d0-87cf-0608c036e541 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:00.236661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba873b0-6872-41d0-87cf-0608c036e541 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:00.237425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba873b0-6872-41d0-87cf-0608c036e541 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:00.237734 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba873b0-6872-41d0-87cf-0608c036e541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:00.239194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba873b0-6872-41d0-87cf-0608c036e541 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:00.248857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 197/398] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:32:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:00.254246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f3aab-4928-45e8-a73b-b4dc7b3fcd4e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:00.257469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:00.432923 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f3aab-4928-45e8-a73b-b4dc7b3fcd4e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:00.474814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1164924-feff-4d2b-a80d-ddf8a767c602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:00.475460 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1164924-feff-4d2b-a80d-ddf8a767c602 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:00.475742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1164924-feff-4d2b-a80d-ddf8a767c602 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:00.476015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1164924-feff-4d2b-a80d-ddf8a767c602 None admin] PATH_INFO: `/v3/groups/dc8584290b9c4b07be295fb78c477f0b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:00.477155 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1164924-feff-4d2b-a80d-ddf8a767c602 None admin] RBAC: Authorizing `identity:get_group(group_id=dc8584290b9c4b07be295fb78c477f0b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:00.479114 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1164924-feff-4d2b-a80d-ddf8a767c602 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:00.480719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 202/399] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:32:00 2022] GET /identity/v3/groups/dc8584290b9c4b07be295fb78c477f0b => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:00.486537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba873b0-6872-41d0-87cf-0608c036e541 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:00.622189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba873b0-6872-41d0-87cf-0608c036e541 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:00.662936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4def9fd-3798-451d-bd6e-01abbcc509f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:00.663602 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4def9fd-3798-451d-bd6e-01abbcc509f3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:00.663884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4def9fd-3798-451d-bd6e-01abbcc509f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:00.664158 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4def9fd-3798-451d-bd6e-01abbcc509f3 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:00.665389 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4def9fd-3798-451d-bd6e-01abbcc509f3 None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:00.666862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4def9fd-3798-451d-bd6e-01abbcc509f3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:00.668554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 198/400] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:32:00 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:00.674737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1164924-feff-4d2b-a80d-ddf8a767c602 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:00.809684 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:00.859066 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1164924-feff-4d2b-a80d-ddf8a767c602 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:00.906060 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8302ab-2329-462d-af32-51591ed51e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:00.906656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8302ab-2329-462d-af32-51591ed51e27 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:00.906931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8302ab-2329-462d-af32-51591ed51e27 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:00.907207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8302ab-2329-462d-af32-51591ed51e27 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec/groups/dc8584290b9c4b07be295fb78c477f0b/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:00.914589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8302ab-2329-462d-af32-51591ed51e27 None admin] RBAC: Authorizing `identity:create_grant(project_id=7983d7c8afd94591898d105faa79f3ec, group_id=dc8584290b9c4b07be295fb78c477f0b, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:00.916027 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8302ab-2329-462d-af32-51591ed51e27 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:00.954672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 203/401] 10.222.0.39 () {58 vars in 1442 bytes} [Tue Jul 26 02:32:00 2022] PUT /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec/groups/dc8584290b9c4b07be295fb78c477f0b/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:32:01.362098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8513e-d6b4-4f33-976a-31b6c05fa3a3 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:01.362595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8513e-d6b4-4f33-976a-31b6c05fa3a3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:01.362595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8513e-d6b4-4f33-976a-31b6c05fa3a3 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:01.363939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 199/402] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:01.372846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8153b-fd70-42c3-9627-a2d482adb590 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:01.372846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8153b-fd70-42c3-9627-a2d482adb590 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:01.372846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8153b-fd70-42c3-9627-a2d482adb590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:01.392909 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-64b8153b-fd70-42c3-9627-a2d482adb590 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:01.394565 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-64b8153b-fd70-42c3-9627-a2d482adb590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:01.479447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 204/403] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:01.514036 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8513e-d6b4-4f33-976a-31b6c05fa3a3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:01.547695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:01.579152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cd31f-777a-4623-a038-4ec564be5a9f None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:01.579475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cd31f-777a-4623-a038-4ec564be5a9f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:01.579712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cd31f-777a-4623-a038-4ec564be5a9f None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:01.582237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 205/404] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:01.586630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6603634-5037-49f7-a525-ceff406241e4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:01.586916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6603634-5037-49f7-a525-ceff406241e4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:01.587188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6603634-5037-49f7-a525-ceff406241e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:01.621589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e6603634-5037-49f7-a525-ceff406241e4 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:01.622862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e6603634-5037-49f7-a525-ceff406241e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:01.641294 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8513e-d6b4-4f33-976a-31b6c05fa3a3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:01.696945 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:01.700862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee80714-0184-4fb7-919b-dc0d87b74318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:01.701551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee80714-0184-4fb7-919b-dc0d87b74318 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:01.701835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee80714-0184-4fb7-919b-dc0d87b74318 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:01.702109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee80714-0184-4fb7-919b-dc0d87b74318 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:01.712631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 206/405] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:32:01.736609 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6603634-5037-49f7-a525-ceff406241e4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:01.738224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee80714-0184-4fb7-919b-dc0d87b74318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-3ee80714-0184-4fb7-919b-dc0d87b74318 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:01.743765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:01.744730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:01.745543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:01.745543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:01.745543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:01.745543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:01.745543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:01.745543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:01.745543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:01.745543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:01.745543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:01.745543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:01.745543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:01.745543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:01.745543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 200/406] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:01.752013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee80714-0184-4fb7-919b-dc0d87b74318 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:01.874512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6603634-5037-49f7-a525-ceff406241e4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:01.899599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:01.911981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff5a43-a81e-4dd8-a1d9-54d772441f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:01.912961 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff5a43-a81e-4dd8-a1d9-54d772441f62 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:01.913472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff5a43-a81e-4dd8-a1d9-54d772441f62 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:01.913598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee80714-0184-4fb7-919b-dc0d87b74318 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:01.913997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff5a43-a81e-4dd8-a1d9-54d772441f62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:01.926530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff5a43-a81e-4dd8-a1d9-54d772441f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a4ff5a43-a81e-4dd8-a1d9-54d772441f62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:01.931948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:01.932848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:01.933688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:01.933688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:01.933688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:01.933688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:01.933688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:01.933688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:01.933688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:01.933688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:01.933688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:01.933688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:01.933688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:32:01.933688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:01.936375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 207/407] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:32:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:01.937952 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729b304-5283-467a-b880-45de1fc6a2f5 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:01.938497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729b304-5283-467a-b880-45de1fc6a2f5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:01.938980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729b304-5283-467a-b880-45de1fc6a2f5 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:01.940697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 208/408] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:01.941623 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729b304-5283-467a-b880-45de1fc6a2f5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:01.951740 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec42302-1307-4178-b6d3-ef0c694a90f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:01.952373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec42302-1307-4178-b6d3-ef0c694a90f2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:01.952653 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec42302-1307-4178-b6d3-ef0c694a90f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:01.952934 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec42302-1307-4178-b6d3-ef0c694a90f2 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:01.953674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec42302-1307-4178-b6d3-ef0c694a90f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:01.953972 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec42302-1307-4178-b6d3-ef0c694a90f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:01.955519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec42302-1307-4178-b6d3-ef0c694a90f2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:01.965054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 201/409] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:01.966642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b34cb-609e-48bf-8a0e-fbeaa7213494 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:01.967068 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b34cb-609e-48bf-8a0e-fbeaa7213494 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:01.967488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b34cb-609e-48bf-8a0e-fbeaa7213494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:01.986936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-552b34cb-609e-48bf-8a0e-fbeaa7213494 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:01.988525 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-552b34cb-609e-48bf-8a0e-fbeaa7213494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:02.005862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:02.060867 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729b304-5283-467a-b880-45de1fc6a2f5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:02.061922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 202/410] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:02.062848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b34cb-609e-48bf-8a0e-fbeaa7213494 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:02.098184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928330-5a9a-4937-b308-7fe0407d6060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:02.099258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928330-5a9a-4937-b308-7fe0407d6060 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:02.099734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928330-5a9a-4937-b308-7fe0407d6060 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:02.100229 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928330-5a9a-4937-b308-7fe0407d6060 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:02.101164 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f928330-5a9a-4937-b308-7fe0407d6060 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:02.101701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f928330-5a9a-4937-b308-7fe0407d6060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:02.103709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f928330-5a9a-4937-b308-7fe0407d6060 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:02.112855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 209/411] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:02.113987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928330-5a9a-4937-b308-7fe0407d6060 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:02.153761 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:02.173258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b34cb-609e-48bf-8a0e-fbeaa7213494 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:02.213524 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca517860-98c0-40a6-9d80-80ed7f4dbb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:02.214430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca517860-98c0-40a6-9d80-80ed7f4dbb57 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:02.214853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca517860-98c0-40a6-9d80-80ed7f4dbb57 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:02.215265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca517860-98c0-40a6-9d80-80ed7f4dbb57 None admin] PATH_INFO: `/v3/groups/ec0d8308cbff44e690f9f5501743ad22` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:02.216666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca517860-98c0-40a6-9d80-80ed7f4dbb57 None admin] RBAC: Authorizing `identity:get_group(group_id=ec0d8308cbff44e690f9f5501743ad22)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:02.218319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca517860-98c0-40a6-9d80-80ed7f4dbb57 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:02.220415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 203/412] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:32:02 2022] GET /identity/v3/groups/ec0d8308cbff44e690f9f5501743ad22 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:02.225563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca517860-98c0-40a6-9d80-80ed7f4dbb57 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:02.236267 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928330-5a9a-4937-b308-7fe0407d6060 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:02.253739 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:02.283548 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d05b07-3f94-46d1-b0e5-b3781d1a0a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:02.284190 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d05b07-3f94-46d1-b0e5-b3781d1a0a3d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:02.284471 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d05b07-3f94-46d1-b0e5-b3781d1a0a3d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:02.284739 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d05b07-3f94-46d1-b0e5-b3781d1a0a3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:02.298636 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d05b07-3f94-46d1-b0e5-b3781d1a0a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f8d05b07-3f94-46d1-b0e5-b3781d1a0a3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:02.305188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:02.306184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:02.306982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:02.306982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:02.306982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:02.306982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:02.306982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:02.306982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:02.306982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:02.306982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:02.306982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:02.306982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:02.306982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:32:02.306982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:02.306982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 210/413] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:02.307644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d05b07-3f94-46d1-b0e5-b3781d1a0a3d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:02.331942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca517860-98c0-40a6-9d80-80ed7f4dbb57 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:02.367865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120baf8-d631-4a23-80bf-083bd4d9ebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:02.368515 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120baf8-d631-4a23-80bf-083bd4d9ebee None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:02.368772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120baf8-d631-4a23-80bf-083bd4d9ebee None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:02.369041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120baf8-d631-4a23-80bf-083bd4d9ebee None admin] PATH_INFO: `/v3/groups/dc8584290b9c4b07be295fb78c477f0b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:02.370585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120baf8-d631-4a23-80bf-083bd4d9ebee None admin] RBAC: Authorizing `identity:get_group(group_id=dc8584290b9c4b07be295fb78c477f0b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:02.372105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120baf8-d631-4a23-80bf-083bd4d9ebee None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:02.374077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 204/414] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:32:02 2022] GET /identity/v3/groups/dc8584290b9c4b07be295fb78c477f0b => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:02.375315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141b076-13c3-40d0-87ca-c9ba9c23d5b8 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:02.375593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141b076-13c3-40d0-87ca-c9ba9c23d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:02.375865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141b076-13c3-40d0-87ca-c9ba9c23d5b8 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:02.377217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 205/415] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:02.377830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141b076-13c3-40d0-87ca-c9ba9c23d5b8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:02.393163 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:02.425021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d05b07-3f94-46d1-b0e5-b3781d1a0a3d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:02.460461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b88d5c-306d-4301-ab8d-cee4a4a9d328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:02.461105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88d5c-306d-4301-ab8d-cee4a4a9d328 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:02.461433 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88d5c-306d-4301-ab8d-cee4a4a9d328 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:02.461704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b88d5c-306d-4301-ab8d-cee4a4a9d328 None admin] PATH_INFO: `/v3/projects/dcd69a7399884288be80cb2c7e9c442d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:02.462891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b88d5c-306d-4301-ab8d-cee4a4a9d328 None admin] RBAC: Authorizing `identity:get_project(project_id=dcd69a7399884288be80cb2c7e9c442d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:02.464319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b88d5c-306d-4301-ab8d-cee4a4a9d328 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:02.466048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 211/416] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:32:02 2022] GET /identity/v3/projects/dcd69a7399884288be80cb2c7e9c442d => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:02.466806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b88d5c-306d-4301-ab8d-cee4a4a9d328 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:02.497175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141b076-13c3-40d0-87ca-c9ba9c23d5b8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:02.511075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:02.534547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c59f8-c39c-46ae-ad7b-3b0475b658a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:02.535176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c59f8-c39c-46ae-ad7b-3b0475b658a9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:02.535458 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c59f8-c39c-46ae-ad7b-3b0475b658a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:02.535731 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c59f8-c39c-46ae-ad7b-3b0475b658a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:02.536452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c59f8-c39c-46ae-ad7b-3b0475b658a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:02.536755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c59f8-c39c-46ae-ad7b-3b0475b658a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:02.538167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c59f8-c39c-46ae-ad7b-3b0475b658a9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:02.551003 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 206/417] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:32:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:02.552277 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a41a1-4c8c-4098-90b0-aac7b2194947 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:02.552562 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a41a1-4c8c-4098-90b0-aac7b2194947 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:02.552833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a41a1-4c8c-4098-90b0-aac7b2194947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:02.572252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6a2a41a1-4c8c-4098-90b0-aac7b2194947 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:02.573538 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6a2a41a1-4c8c-4098-90b0-aac7b2194947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:02.576826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b88d5c-306d-4301-ab8d-cee4a4a9d328 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:02.612237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5bc43-6c87-45cb-8400-8e6489b16f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:02.612881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5bc43-6c87-45cb-8400-8e6489b16f47 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:02.613157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5bc43-6c87-45cb-8400-8e6489b16f47 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:02.613451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5bc43-6c87-45cb-8400-8e6489b16f47 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:02.614609 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5bc43-6c87-45cb-8400-8e6489b16f47 None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:02.616279 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5bc43-6c87-45cb-8400-8e6489b16f47 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:02.618006 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 212/418] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:32:02 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:02.619063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5bc43-6c87-45cb-8400-8e6489b16f47 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:02.654007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 207/419] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:02.654667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a41a1-4c8c-4098-90b0-aac7b2194947 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:02.658589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:02.743610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5bc43-6c87-45cb-8400-8e6489b16f47 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:02.752722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:02.760486 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a41a1-4c8c-4098-90b0-aac7b2194947 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:02.782804 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf475c-1f47-4571-95bc-7d72215741d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:02.783496 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf475c-1f47-4571-95bc-7d72215741d2 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:02.783777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf475c-1f47-4571-95bc-7d72215741d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:02.784041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf475c-1f47-4571-95bc-7d72215741d2 None admin] PATH_INFO: `/v3/projects/dcd69a7399884288be80cb2c7e9c442d/groups/ec0d8308cbff44e690f9f5501743ad22/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:02.786128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf475c-1f47-4571-95bc-7d72215741d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcd69a7399884288be80cb2c7e9c442d, group_id=ec0d8308cbff44e690f9f5501743ad22, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:02.787583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf475c-1f47-4571-95bc-7d72215741d2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:02.795212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99e23-cb34-474f-8a6b-eec8e77106d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:02.796045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99e23-cb34-474f-8a6b-eec8e77106d1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:02.796493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99e23-cb34-474f-8a6b-eec8e77106d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:02.797107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99e23-cb34-474f-8a6b-eec8e77106d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:02.805313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 213/420] 10.222.0.39 () {58 vars in 1442 bytes} [Tue Jul 26 02:32:02 2022] PUT /identity/v3/projects/dcd69a7399884288be80cb2c7e9c442d/groups/ec0d8308cbff44e690f9f5501743ad22/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:32:02.805313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf475c-1f47-4571-95bc-7d72215741d2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:02.909614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db99e23-cb34-474f-8a6b-eec8e77106d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:02.912368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db99e23-cb34-474f-8a6b-eec8e77106d1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:02.917306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:02.920807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf475c-1f47-4571-95bc-7d72215741d2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:02.960445 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2eeab-64da-41c9-bf8b-3b7671533cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:02.961164 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2eeab-64da-41c9-bf8b-3b7671533cd9 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:02.961497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2eeab-64da-41c9-bf8b-3b7671533cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:02.961766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2eeab-64da-41c9-bf8b-3b7671533cd9 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec/groups/dc8584290b9c4b07be295fb78c477f0b/roles/506da913e25f44b1854b24215eb447fc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:02.965062 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2eeab-64da-41c9-bf8b-3b7671533cd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7983d7c8afd94591898d105faa79f3ec, group_id=dc8584290b9c4b07be295fb78c477f0b, role_id=506da913e25f44b1854b24215eb447fc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:02.966700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2eeab-64da-41c9-bf8b-3b7671533cd9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:02.987287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 214/421] 10.222.0.39 () {58 vars in 1442 bytes} [Tue Jul 26 02:32:02 2022] PUT /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec/groups/dc8584290b9c4b07be295fb78c477f0b/roles/506da913e25f44b1854b24215eb447fc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:32:02.988420 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2eeab-64da-41c9-bf8b-3b7671533cd9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:03.039774 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:03.052655 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 208/422] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:03.058213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99e23-cb34-474f-8a6b-eec8e77106d1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:03.124523 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2eeab-64da-41c9-bf8b-3b7671533cd9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:03.163370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd9343-acd3-449f-b133-974153f00324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:03.164037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd9343-acd3-449f-b133-974153f00324 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:03.164206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99e23-cb34-474f-8a6b-eec8e77106d1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:03.164301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd9343-acd3-449f-b133-974153f00324 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:03.164573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd9343-acd3-449f-b133-974153f00324 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:03.166765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:03.178579 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd9343-acd3-449f-b133-974153f00324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-99bd9343-acd3-449f-b133-974153f00324 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:03.184598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:03.185576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:03.186368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:03.186368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:03.186368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:03.186368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:03.186368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:03.186368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:03.186368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:03.186368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:03.186368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:03.186368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:03.186368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:32:03.186368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:03.186368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 215/423] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:32:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:03.198404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd9343-acd3-449f-b133-974153f00324 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:03.207597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf466bd-0917-4085-9509-35bbaae87209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:03.208257 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf466bd-0917-4085-9509-35bbaae87209 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:03.208536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf466bd-0917-4085-9509-35bbaae87209 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:03.208811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf466bd-0917-4085-9509-35bbaae87209 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:03.210002 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf466bd-0917-4085-9509-35bbaae87209 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:03.211495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf466bd-0917-4085-9509-35bbaae87209 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:03.213565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 209/424] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:32:03 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:03.230271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf466bd-0917-4085-9509-35bbaae87209 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:03.321277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:03.344820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd9343-acd3-449f-b133-974153f00324 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:03.391667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf466bd-0917-4085-9509-35bbaae87209 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:03.410947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60479b4-13e9-488f-86fd-0af64e0e40ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:03.411576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60479b4-13e9-488f-86fd-0af64e0e40ef None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:03.411856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60479b4-13e9-488f-86fd-0af64e0e40ef None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:03.412124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60479b4-13e9-488f-86fd-0af64e0e40ef None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:03.412853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60479b4-13e9-488f-86fd-0af64e0e40ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:03.413157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60479b4-13e9-488f-86fd-0af64e0e40ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:03.414561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60479b4-13e9-488f-86fd-0af64e0e40ef None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:03.432128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 216/425] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:03.437787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60479b4-13e9-488f-86fd-0af64e0e40ef None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:03.467050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9726a3b-96ae-471f-bcd9-4147d1dbd2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:03.467724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9726a3b-96ae-471f-bcd9-4147d1dbd2d0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:03.468005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9726a3b-96ae-471f-bcd9-4147d1dbd2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:03.468277 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9726a3b-96ae-471f-bcd9-4147d1dbd2d0 None admin] PATH_INFO: `/v3/groups/dc8584290b9c4b07be295fb78c477f0b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:03.474029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9726a3b-96ae-471f-bcd9-4147d1dbd2d0 None admin] RBAC: Authorizing `identity:get_group(group_id=dc8584290b9c4b07be295fb78c477f0b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:03.475503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9726a3b-96ae-471f-bcd9-4147d1dbd2d0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:03.477480 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 210/426] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:32:03 2022] GET /identity/v3/groups/dc8584290b9c4b07be295fb78c477f0b => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:03.484009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9726a3b-96ae-471f-bcd9-4147d1dbd2d0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:03.532436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:03.560251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60479b4-13e9-488f-86fd-0af64e0e40ef None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:03.604682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aad06-c790-4bc4-8585-4552d9d4aee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:03.605350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aad06-c790-4bc4-8585-4552d9d4aee9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:03.605708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aad06-c790-4bc4-8585-4552d9d4aee9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:03.608659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aad06-c790-4bc4-8585-4552d9d4aee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:03.608799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9726a3b-96ae-471f-bcd9-4147d1dbd2d0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:03.641305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:03.647448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c8e2a-eb5e-4803-81db-b40583f0689f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:03.648482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c8e2a-eb5e-4803-81db-b40583f0689f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:03.649089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c8e2a-eb5e-4803-81db-b40583f0689f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:03.649481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c8e2a-eb5e-4803-81db-b40583f0689f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:03.650531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c8e2a-eb5e-4803-81db-b40583f0689f None admin] RBAC: Adding query filter params (group.id=dc8584290b9c4b07be295fb78c477f0b, role.id=d93e06f63f2947f98ad9a668b80929dc, scope.project.id=05ea5625e61f40ecad97004ff4e32fa4) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:03.651200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c8e2a-eb5e-4803-81db-b40583f0689f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:03.653046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c8e2a-eb5e-4803-81db-b40583f0689f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:03.660822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 211/427] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 02:32:03 2022] GET /identity/v3/role_assignments?group.id=dc8584290b9c4b07be295fb78c477f0b&scope.project.id=05ea5625e61f40ecad97004ff4e32fa4&role.id=d93e06f63f2947f98ad9a668b80929dc => generated 611 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:03.662267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f591aa4-c634-4ef1-bed6-1020a87b2215 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:03.663003 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f591aa4-c634-4ef1-bed6-1020a87b2215 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:03.663373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f591aa4-c634-4ef1-bed6-1020a87b2215 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:03.669403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 212/428] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:03.671502 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf0c8c-6489-4218-9d37-7dcac1d509f6 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:03.671785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf0c8c-6489-4218-9d37-7dcac1d509f6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:03.672059 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf0c8c-6489-4218-9d37-7dcac1d509f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:03.691807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7eaf0c8c-6489-4218-9d37-7dcac1d509f6 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:03.693142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7eaf0c8c-6489-4218-9d37-7dcac1d509f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:03.699230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aad06-c790-4bc4-8585-4552d9d4aee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:03.700915 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aad06-c790-4bc4-8585-4552d9d4aee9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:03.768600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 213/429] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:32:03.831582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 217/430] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:03.834186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf0c8c-6489-4218-9d37-7dcac1d509f6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:03.839238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aad06-c790-4bc4-8585-4552d9d4aee9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:03.894529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:03.927273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:03.977459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf0c8c-6489-4218-9d37-7dcac1d509f6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:03.997674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aad06-c790-4bc4-8585-4552d9d4aee9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:04.023038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8596b-8aed-4b19-b182-224801ff7d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:04.024046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8596b-8aed-4b19-b182-224801ff7d52 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:04.024631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8596b-8aed-4b19-b182-224801ff7d52 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:04.025094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8596b-8aed-4b19-b182-224801ff7d52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:04.037451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb69cf6-13e2-447e-b53a-261790820635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:04.038171 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb69cf6-13e2-447e-b53a-261790820635 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:04.038395 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb69cf6-13e2-447e-b53a-261790820635 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:04.038667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb69cf6-13e2-447e-b53a-261790820635 None admin] PATH_INFO: `/v3/projects/05ea5625e61f40ecad97004ff4e32fa4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:04.039243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8596b-8aed-4b19-b182-224801ff7d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:04.040011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb69cf6-13e2-447e-b53a-261790820635 None admin] RBAC: Authorizing `identity:get_project(project_id=05ea5625e61f40ecad97004ff4e32fa4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:04.041490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb69cf6-13e2-447e-b53a-261790820635 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:04.043466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 218/431] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:32:03 2022] GET /identity/v3/projects/05ea5625e61f40ecad97004ff4e32fa4 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-91a8596b-8aed-4b19-b182-224801ff7d52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:04.049327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:04.050258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:04.051037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:04.051037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:04.051037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:04.051037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:04.051037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:04.051037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:04.051037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:04.051037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:04.051037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:04.051037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:04.051037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 02:32:04.051037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:04.051037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 214/432] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:04.053165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb69cf6-13e2-447e-b53a-261790820635 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:04.055035 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8596b-8aed-4b19-b182-224801ff7d52 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:04.165919 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:04.173177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8596b-8aed-4b19-b182-224801ff7d52 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:04.175383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb69cf6-13e2-447e-b53a-261790820635 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:04.201676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:04.212797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070e6da-7aea-4488-ad81-f78b058f4c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:04.212797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070e6da-7aea-4488-ad81-f78b058f4c81 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:04.213090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070e6da-7aea-4488-ad81-f78b058f4c81 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:04.213354 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070e6da-7aea-4488-ad81-f78b058f4c81 None admin] PATH_INFO: `/v3/groups/dc8584290b9c4b07be295fb78c477f0b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:04.215543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070e6da-7aea-4488-ad81-f78b058f4c81 None admin] RBAC: Authorizing `identity:get_group(group_id=dc8584290b9c4b07be295fb78c477f0b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:04.217026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070e6da-7aea-4488-ad81-f78b058f4c81 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:04.219089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 215/433] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:32:04 2022] GET /identity/v3/groups/dc8584290b9c4b07be295fb78c477f0b => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:04.219438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e2cba-f7b8-41b4-b5fb-1bc0f86a7a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:04.220303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e2cba-f7b8-41b4-b5fb-1bc0f86a7a3a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:04.220798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e2cba-f7b8-41b4-b5fb-1bc0f86a7a3a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:04.221259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e2cba-f7b8-41b4-b5fb-1bc0f86a7a3a None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:04.223801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e2cba-f7b8-41b4-b5fb-1bc0f86a7a3a None admin] RBAC: Adding query filter params (name=member) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:04.224798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e2cba-f7b8-41b4-b5fb-1bc0f86a7a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:04.225417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070e6da-7aea-4488-ad81-f78b058f4c81 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:04.226798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e2cba-f7b8-41b4-b5fb-1bc0f86a7a3a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:04.242525 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 219/434] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:32:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:04.243826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e2cba-f7b8-41b4-b5fb-1bc0f86a7a3a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:04.339896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070e6da-7aea-4488-ad81-f78b058f4c81 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:04.373087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e2cba-f7b8-41b4-b5fb-1bc0f86a7a3a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:04.380464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e098d5-0787-422d-9469-640c4e3950bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:04.381219 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e098d5-0787-422d-9469-640c4e3950bb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:04.381530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e098d5-0787-422d-9469-640c4e3950bb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:04.381802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e098d5-0787-422d-9469-640c4e3950bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:04.382614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e098d5-0787-422d-9469-640c4e3950bb None admin] RBAC: Adding query filter params (group.id=dc8584290b9c4b07be295fb78c477f0b, role.id=506da913e25f44b1854b24215eb447fc, scope.project.id=05ea5625e61f40ecad97004ff4e32fa4) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:04.382926 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e098d5-0787-422d-9469-640c4e3950bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:04.384560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e098d5-0787-422d-9469-640c4e3950bb None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:04.392743 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 216/435] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 02:32:04 2022] GET /identity/v3/role_assignments?group.id=dc8584290b9c4b07be295fb78c477f0b&scope.project.id=05ea5625e61f40ecad97004ff4e32fa4&role.id=506da913e25f44b1854b24215eb447fc => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:04.411690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800d172-7970-4e0e-bdd7-b9a75b60b8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:04.412347 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d172-7970-4e0e-bdd7-b9a75b60b8ec None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:04.412627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d172-7970-4e0e-bdd7-b9a75b60b8ec None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:04.412899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d172-7970-4e0e-bdd7-b9a75b60b8ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:04.467285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:04.490054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800d172-7970-4e0e-bdd7-b9a75b60b8ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:04.491542 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800d172-7970-4e0e-bdd7-b9a75b60b8ec None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:04.596981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 220/436] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:04.602485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e098d5-0787-422d-9469-640c4e3950bb None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:04.653193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:04.729424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e098d5-0787-422d-9469-640c4e3950bb None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:04.769605 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7378dc-bea5-4ffe-bff8-4a8c374f4ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:04.770265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7378dc-bea5-4ffe-bff8-4a8c374f4ba9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:04.770545 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7378dc-bea5-4ffe-bff8-4a8c374f4ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:04.770816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7378dc-bea5-4ffe-bff8-4a8c374f4ba9 None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:04.772015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7378dc-bea5-4ffe-bff8-4a8c374f4ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:04.773500 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7378dc-bea5-4ffe-bff8-4a8c374f4ba9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:04.775494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 217/437] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:32:04 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:04.781092 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800d172-7970-4e0e-bdd7-b9a75b60b8ec None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:04.870797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:04.892495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800d172-7970-4e0e-bdd7-b9a75b60b8ec None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:04.928744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99e58a-e021-4612-b6c6-c9b5cdf57401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:04.929560 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e58a-e021-4612-b6c6-c9b5cdf57401 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:04.929717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e58a-e021-4612-b6c6-c9b5cdf57401 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:04.929994 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e58a-e021-4612-b6c6-c9b5cdf57401 None admin] PATH_INFO: `/v3/groups/dc8584290b9c4b07be295fb78c477f0b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:04.931149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99e58a-e021-4612-b6c6-c9b5cdf57401 None admin] RBAC: Authorizing `identity:get_group(group_id=dc8584290b9c4b07be295fb78c477f0b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:04.932605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99e58a-e021-4612-b6c6-c9b5cdf57401 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:04.935557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 221/438] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:32:04 2022] GET /identity/v3/groups/dc8584290b9c4b07be295fb78c477f0b => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:04.940392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7378dc-bea5-4ffe-bff8-4a8c374f4ba9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:05.036223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:05.044440 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7378dc-bea5-4ffe-bff8-4a8c374f4ba9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:05.078003 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fef52-261e-49a4-90b4-e3651eb9556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:05.078626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fef52-261e-49a4-90b4-e3651eb9556b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:05.078905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fef52-261e-49a4-90b4-e3651eb9556b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:05.079179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fef52-261e-49a4-90b4-e3651eb9556b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:05.079968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fef52-261e-49a4-90b4-e3651eb9556b None admin] RBAC: Adding query filter params (group.id=dc8584290b9c4b07be295fb78c477f0b, role.id=d93e06f63f2947f98ad9a668b80929dc, scope.project.id=7983d7c8afd94591898d105faa79f3ec) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:05.080276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fef52-261e-49a4-90b4-e3651eb9556b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:05.081798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fef52-261e-49a4-90b4-e3651eb9556b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:05.087856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 218/439] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 02:32:04 2022] GET /identity/v3/role_assignments?group.id=dc8584290b9c4b07be295fb78c477f0b&scope.project.id=7983d7c8afd94591898d105faa79f3ec&role.id=d93e06f63f2947f98ad9a668b80929dc => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:05.183648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a867a-7ca0-4a26-a058-a3dc585051e3 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:05.183997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a867a-7ca0-4a26-a058-a3dc585051e3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:05.184255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a867a-7ca0-4a26-a058-a3dc585051e3 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:05.185870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 222/440] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:05.191521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0a058-4fa7-49fc-93e1-a582738c3372 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:05.191871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0a058-4fa7-49fc-93e1-a582738c3372 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:05.192053 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0a058-4fa7-49fc-93e1-a582738c3372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:05.212038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d2c0a058-4fa7-49fc-93e1-a582738c3372 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:05.213248 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d2c0a058-4fa7-49fc-93e1-a582738c3372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:05.285674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 219/441] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:05.296487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66fbfb-00b6-47f3-96a3-00ae31f79e3a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:05.296696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66fbfb-00b6-47f3-96a3-00ae31f79e3a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:05.296962 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66fbfb-00b6-47f3-96a3-00ae31f79e3a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:05.298369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 223/442] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:05.303912 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b244f2b-1d95-4c43-bb03-9b29ad7d4b72 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:05.304255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b244f2b-1d95-4c43-bb03-9b29ad7d4b72 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:05.304529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b244f2b-1d95-4c43-bb03-9b29ad7d4b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:05.308595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66fbfb-00b6-47f3-96a3-00ae31f79e3a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:05.325500 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4b244f2b-1d95-4c43-bb03-9b29ad7d4b72 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:05.326689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4b244f2b-1d95-4c43-bb03-9b29ad7d4b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:05.405449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 220/443] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:05.427565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b244f2b-1d95-4c43-bb03-9b29ad7d4b72 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:05.428966 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66fbfb-00b6-47f3-96a3-00ae31f79e3a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:05.448494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:05.467475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8c61b-a0ca-4f5f-bb5d-1e70bc94a342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:05.468119 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8c61b-a0ca-4f5f-bb5d-1e70bc94a342 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:05.468398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8c61b-a0ca-4f5f-bb5d-1e70bc94a342 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:05.468671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8c61b-a0ca-4f5f-bb5d-1e70bc94a342 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:05.478939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8c61b-a0ca-4f5f-bb5d-1e70bc94a342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-93e8c61b-a0ca-4f5f-bb5d-1e70bc94a342 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:05.483907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:05.484786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:05.485895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:05.485895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:05.485895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:05.485895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:05.485895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:05.485895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:05.485895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:05.485895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:05.485895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:05.485895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:05.485895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:05.485895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:05.485895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 224/444] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:05.490899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8c61b-a0ca-4f5f-bb5d-1e70bc94a342 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:05.501389 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:05.530644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b244f2b-1d95-4c43-bb03-9b29ad7d4b72 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:05.563785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c1799-30a2-4ff5-b77b-9042b3f841c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:05.564358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c1799-30a2-4ff5-b77b-9042b3f841c7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:05.564640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c1799-30a2-4ff5-b77b-9042b3f841c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:05.564913 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c1799-30a2-4ff5-b77b-9042b3f841c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:05.577076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c1799-30a2-4ff5-b77b-9042b3f841c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-816c1799-30a2-4ff5-b77b-9042b3f841c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:05.582077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:05.583006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:05.583808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:05.583808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:05.583808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:05.583808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:05.583808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:05.583808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:05.583808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:05.583808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:05.583808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:05.583808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:05.583808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:32:05.583808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:05.583808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 221/445] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:32:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:05.589379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c1799-30a2-4ff5-b77b-9042b3f841c7 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:05.591077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8c61b-a0ca-4f5f-bb5d-1e70bc94a342 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:05.624946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a2e27-991b-4de1-9c3b-d033d2c9ae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:05.625618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a2e27-991b-4de1-9c3b-d033d2c9ae4e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:05.625896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a2e27-991b-4de1-9c3b-d033d2c9ae4e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:05.626163 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a2e27-991b-4de1-9c3b-d033d2c9ae4e None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:05.626873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a2e27-991b-4de1-9c3b-d033d2c9ae4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:05.627171 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a2e27-991b-4de1-9c3b-d033d2c9ae4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:05.628538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a2e27-991b-4de1-9c3b-d033d2c9ae4e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:05.637575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 225/446] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:05.642980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a2e27-991b-4de1-9c3b-d033d2c9ae4e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:05.670955 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:05.692951 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c1799-30a2-4ff5-b77b-9042b3f841c7 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:05.711812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:05.731395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe1ffc-f7a8-4856-9281-baa7df6a1965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:05.732010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe1ffc-f7a8-4856-9281-baa7df6a1965 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:05.732288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe1ffc-f7a8-4856-9281-baa7df6a1965 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:05.732554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe1ffc-f7a8-4856-9281-baa7df6a1965 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:05.733268 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe1ffc-f7a8-4856-9281-baa7df6a1965 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:05.733595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe1ffc-f7a8-4856-9281-baa7df6a1965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:05.735020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe1ffc-f7a8-4856-9281-baa7df6a1965 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:05.742884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 222/447] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:05.744663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a2e27-991b-4de1-9c3b-d033d2c9ae4e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:05.748586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe1ffc-f7a8-4856-9281-baa7df6a1965 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:05.778465 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da3c87-ca9a-40b8-9716-e301e3704bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:05.779092 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da3c87-ca9a-40b8-9716-e301e3704bc3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:05.779377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da3c87-ca9a-40b8-9716-e301e3704bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:05.779651 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da3c87-ca9a-40b8-9716-e301e3704bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:05.844463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da3c87-ca9a-40b8-9716-e301e3704bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:05.845868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe1ffc-f7a8-4856-9281-baa7df6a1965 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:05.845973 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da3c87-ca9a-40b8-9716-e301e3704bc3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:05.880474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9f18d-0aa6-41db-b98c-79425f7e0305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:05.881103 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9f18d-0aa6-41db-b98c-79425f7e0305 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:05.881473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9f18d-0aa6-41db-b98c-79425f7e0305 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:05.881751 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9f18d-0aa6-41db-b98c-79425f7e0305 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:05.892343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:05.912949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:05.945822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 226/448] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 02:32:05.951043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9f18d-0aa6-41db-b98c-79425f7e0305 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:05.951520 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da3c87-ca9a-40b8-9716-e301e3704bc3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:05.952506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9f18d-0aa6-41db-b98c-79425f7e0305 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:06.049402 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da3c87-ca9a-40b8-9716-e301e3704bc3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:06.049961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 223/449] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 02:32:06.055392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9f18d-0aa6-41db-b98c-79425f7e0305 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:06.084468 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e81cb-9fac-4320-8fc2-ad6ebd90a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:06.085100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e81cb-9fac-4320-8fc2-ad6ebd90a3f6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:06.085422 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e81cb-9fac-4320-8fc2-ad6ebd90a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:06.085710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e81cb-9fac-4320-8fc2-ad6ebd90a3f6 None admin] PATH_INFO: `/v3/projects/dcd69a7399884288be80cb2c7e9c442d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:06.086873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e81cb-9fac-4320-8fc2-ad6ebd90a3f6 None admin] RBAC: Authorizing `identity:get_project(project_id=dcd69a7399884288be80cb2c7e9c442d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:06.088397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e81cb-9fac-4320-8fc2-ad6ebd90a3f6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:06.090113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 227/450] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:32:05 2022] GET /identity/v3/projects/dcd69a7399884288be80cb2c7e9c442d => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:06.095939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e81cb-9fac-4320-8fc2-ad6ebd90a3f6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:06.106293 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:06.137276 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:06.165898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9f18d-0aa6-41db-b98c-79425f7e0305 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:06.196092 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e81cb-9fac-4320-8fc2-ad6ebd90a3f6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:06.198697 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3860b8-d09a-4c62-8abb-f30a0adf069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:06.199341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3860b8-d09a-4c62-8abb-f30a0adf069d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:06.199587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3860b8-d09a-4c62-8abb-f30a0adf069d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:06.199935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3860b8-d09a-4c62-8abb-f30a0adf069d None admin] PATH_INFO: `/v3/projects/7983d7c8afd94591898d105faa79f3ec` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:06.201085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3860b8-d09a-4c62-8abb-f30a0adf069d None admin] RBAC: Authorizing `identity:get_project(project_id=7983d7c8afd94591898d105faa79f3ec)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:06.202560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3860b8-d09a-4c62-8abb-f30a0adf069d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:06.204186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 224/451] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:32:06 2022] GET /identity/v3/projects/7983d7c8afd94591898d105faa79f3ec => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:06.209850 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3860b8-d09a-4c62-8abb-f30a0adf069d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:06.232304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04ada8-0ba0-4d23-acc9-2c265177e4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:06.232944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04ada8-0ba0-4d23-acc9-2c265177e4c6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:06.233224 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04ada8-0ba0-4d23-acc9-2c265177e4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:06.233521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04ada8-0ba0-4d23-acc9-2c265177e4c6 None admin] PATH_INFO: `/v3/groups/ec0d8308cbff44e690f9f5501743ad22` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:06.234691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04ada8-0ba0-4d23-acc9-2c265177e4c6 None admin] RBAC: Authorizing `identity:get_group(group_id=ec0d8308cbff44e690f9f5501743ad22)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:06.236111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04ada8-0ba0-4d23-acc9-2c265177e4c6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:06.237735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 228/452] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:32:06 2022] GET /identity/v3/groups/ec0d8308cbff44e690f9f5501743ad22 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:06.243545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04ada8-0ba0-4d23-acc9-2c265177e4c6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:06.307461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3860b8-d09a-4c62-8abb-f30a0adf069d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:06.317098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:06.340188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04ada8-0ba0-4d23-acc9-2c265177e4c6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:06.341728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207bddb-b156-4639-b207-4bede8d2b985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:06.342371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207bddb-b156-4639-b207-4bede8d2b985 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:06.342652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207bddb-b156-4639-b207-4bede8d2b985 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:06.342923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207bddb-b156-4639-b207-4bede8d2b985 None admin] PATH_INFO: `/v3/groups/dc8584290b9c4b07be295fb78c477f0b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:06.344070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207bddb-b156-4639-b207-4bede8d2b985 None admin] RBAC: Authorizing `identity:get_group(group_id=dc8584290b9c4b07be295fb78c477f0b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:06.345562 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207bddb-b156-4639-b207-4bede8d2b985 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:06.347461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:06.347649 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 225/453] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 02:32:06 2022] GET /identity/v3/groups/dc8584290b9c4b07be295fb78c477f0b => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:06.353535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207bddb-b156-4639-b207-4bede8d2b985 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:06.380783 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738557fa-6507-4b08-be0d-0374b3bd698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:06.381435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738557fa-6507-4b08-be0d-0374b3bd698a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:06.381771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738557fa-6507-4b08-be0d-0374b3bd698a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:06.382044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738557fa-6507-4b08-be0d-0374b3bd698a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:06.382838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738557fa-6507-4b08-be0d-0374b3bd698a None admin] RBAC: Adding query filter params (group.id=ec0d8308cbff44e690f9f5501743ad22, role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=dcd69a7399884288be80cb2c7e9c442d) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:06.383145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738557fa-6507-4b08-be0d-0374b3bd698a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:06.384600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738557fa-6507-4b08-be0d-0374b3bd698a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:06.390909 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 229/454] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 02:32:06 2022] GET /identity/v3/role_assignments?group.id=ec0d8308cbff44e690f9f5501743ad22&scope.project.id=dcd69a7399884288be80cb2c7e9c442d&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:06.481227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207bddb-b156-4639-b207-4bede8d2b985 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:06.516162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15901203-18f4-4414-aba4-15f098dcce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:06.516792 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15901203-18f4-4414-aba4-15f098dcce44 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:06.517070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15901203-18f4-4414-aba4-15f098dcce44 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:06.517339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15901203-18f4-4414-aba4-15f098dcce44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:06.518167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15901203-18f4-4414-aba4-15f098dcce44 None admin] RBAC: Adding query filter params (group.id=dc8584290b9c4b07be295fb78c477f0b, role.id=506da913e25f44b1854b24215eb447fc, scope.project.id=7983d7c8afd94591898d105faa79f3ec) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:06.518473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15901203-18f4-4414-aba4-15f098dcce44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:06.519937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15901203-18f4-4414-aba4-15f098dcce44 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:06.526674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 226/455] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 02:32:06 2022] GET /identity/v3/role_assignments?group.id=dc8584290b9c4b07be295fb78c477f0b&scope.project.id=7983d7c8afd94591898d105faa79f3ec&role.id=506da913e25f44b1854b24215eb447fc => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:09.241400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6c547-ac76-4e64-9900-acaec136c81a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:09.241936 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6c547-ac76-4e64-9900-acaec136c81a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:09.241936 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6c547-ac76-4e64-9900-acaec136c81a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:09.243452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 230/456] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:09.252486 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07e4d6-68e6-45c6-9d69-5a3b61e90894 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:09.252486 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07e4d6-68e6-45c6-9d69-5a3b61e90894 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:09.252486 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07e4d6-68e6-45c6-9d69-5a3b61e90894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:09.278356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9d07e4d6-68e6-45c6-9d69-5a3b61e90894 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:09.279902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9d07e4d6-68e6-45c6-9d69-5a3b61e90894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:09.334011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:09.382145 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 227/457] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:09.413950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6c547-ac76-4e64-9900-acaec136c81a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:09.472626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f154fc-4f2c-457c-ace5-20a34a81939b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:09.473248 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f154fc-4f2c-457c-ace5-20a34a81939b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:09.473731 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f154fc-4f2c-457c-ace5-20a34a81939b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:09.475727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 228/458] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:09.485310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53357f-794d-458d-b3b5-37fa0f1688e6 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:09.485310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53357f-794d-458d-b3b5-37fa0f1688e6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:09.485310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53357f-794d-458d-b3b5-37fa0f1688e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:09.524061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ce53357f-794d-458d-b3b5-37fa0f1688e6 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:09.525631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ce53357f-794d-458d-b3b5-37fa0f1688e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:09.652442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6c547-ac76-4e64-9900-acaec136c81a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:09.662094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 229/459] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:09.695666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53357f-794d-458d-b3b5-37fa0f1688e6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:09.717033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e9ee9-bdb5-412b-a8d8-c26a1abcdb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:09.718064 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9ee9-bdb5-412b-a8d8-c26a1abcdb88 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:09.725959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9ee9-bdb5-412b-a8d8-c26a1abcdb88 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:09.726521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e9ee9-bdb5-412b-a8d8-c26a1abcdb88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:09.767888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e9ee9-bdb5-412b-a8d8-c26a1abcdb88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:09.769476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e9ee9-bdb5-412b-a8d8-c26a1abcdb88 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4f0e9ee9-bdb5-412b-a8d8-c26a1abcdb88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:09.795009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:09.795889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:09.796722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:09.796722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:09.796722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:09.796722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:09.797605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 231/460] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:09.798842 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc7093-3f2a-4336-a301-6fcf75ef36ea None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:09.799129 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc7093-3f2a-4336-a301-6fcf75ef36ea None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:09.799405 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc7093-3f2a-4336-a301-6fcf75ef36ea None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:09.804948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 232/461] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:09.804948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc7093-3f2a-4336-a301-6fcf75ef36ea None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:09.859144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:09.864027 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:09.868090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53357f-794d-458d-b3b5-37fa0f1688e6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:09.912170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37019c-2b06-4341-85cf-e2ea172980c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:09.913560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37019c-2b06-4341-85cf-e2ea172980c0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:09.914030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37019c-2b06-4341-85cf-e2ea172980c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:09.914731 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37019c-2b06-4341-85cf-e2ea172980c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:09.928330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37019c-2b06-4341-85cf-e2ea172980c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:09.930119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37019c-2b06-4341-85cf-e2ea172980c0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-ad37019c-2b06-4341-85cf-e2ea172980c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:09.949117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:09.950263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:09.951082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:09.951082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:09.951082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:09.951082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:09.953672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 230/462] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:09.955262 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e3153-aca2-4fea-90d4-373ba0b9cd8e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:09.955845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e3153-aca2-4fea-90d4-373ba0b9cd8e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:09.956301 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e3153-aca2-4fea-90d4-373ba0b9cd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:09.976661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5a1e3153-aca2-4fea-90d4-373ba0b9cd8e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:09.978703 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5a1e3153-aca2-4fea-90d4-373ba0b9cd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:10.006097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc7093-3f2a-4336-a301-6fcf75ef36ea None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:10.062118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5ec50-1c3a-435a-b613-06ba108b224f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:10.062673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5ec50-1c3a-435a-b613-06ba108b224f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:10.062955 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5ec50-1c3a-435a-b613-06ba108b224f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:10.063224 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5ec50-1c3a-435a-b613-06ba108b224f None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:10.063934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5ec50-1c3a-435a-b613-06ba108b224f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:10.064223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5ec50-1c3a-435a-b613-06ba108b224f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:10.065856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf5ec50-1c3a-435a-b613-06ba108b224f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:10.073303 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 231/463] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:10.073303 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e3153-aca2-4fea-90d4-373ba0b9cd8e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:10.088035 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 233/464] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:10.090389 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e081eb2-a5df-4ec4-b5b5-513936024dcf None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:10.090686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e081eb2-a5df-4ec4-b5b5-513936024dcf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:10.090964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e081eb2-a5df-4ec4-b5b5-513936024dcf None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:10.092547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 234/465] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:10.093242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e081eb2-a5df-4ec4-b5b5-513936024dcf None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:10.179775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:10.203457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:10.206601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e3153-aca2-4fea-90d4-373ba0b9cd8e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:10.231659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e081eb2-a5df-4ec4-b5b5-513936024dcf None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:10.255206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f1894-025e-4b8e-bce2-b68f72a9a0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:10.255852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f1894-025e-4b8e-bce2-b68f72a9a0a5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:10.256138 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f1894-025e-4b8e-bce2-b68f72a9a0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:10.256415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f1894-025e-4b8e-bce2-b68f72a9a0a5 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:10.257131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f1894-025e-4b8e-bce2-b68f72a9a0a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:10.257463 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f1894-025e-4b8e-bce2-b68f72a9a0a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:10.258944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f1894-025e-4b8e-bce2-b68f72a9a0a5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:10.274815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428830f-7499-4916-9ae9-0b54457921fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:10.275499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428830f-7499-4916-9ae9-0b54457921fc None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:10.275701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428830f-7499-4916-9ae9-0b54457921fc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:10.276018 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428830f-7499-4916-9ae9-0b54457921fc None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:10.276242 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 232/466] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:10.276971 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428830f-7499-4916-9ae9-0b54457921fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:10.277070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f1894-025e-4b8e-bce2-b68f72a9a0a5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:10.279710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428830f-7499-4916-9ae9-0b54457921fc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:10.309093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 235/467] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:32:10 2022] POST /identity/v3/users => generated 246 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:32:10.310402 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e30d5-7402-4196-97e7-17d09cd015d1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:10.310690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e30d5-7402-4196-97e7-17d09cd015d1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:10.310958 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e30d5-7402-4196-97e7-17d09cd015d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:10.342274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-af7e30d5-7402-4196-97e7-17d09cd015d1 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:10.343425 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-af7e30d5-7402-4196-97e7-17d09cd015d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:10.458799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f1894-025e-4b8e-bce2-b68f72a9a0a5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:10.474693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 236/468] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:10.476061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e30d5-7402-4196-97e7-17d09cd015d1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:10.505272 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f6a88-7b24-4966-8c29-6bf70de88320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:10.506494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f6a88-7b24-4966-8c29-6bf70de88320 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:10.506494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f6a88-7b24-4966-8c29-6bf70de88320 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:10.506494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f6a88-7b24-4966-8c29-6bf70de88320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:10.521067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f6a88-7b24-4966-8c29-6bf70de88320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:10.522623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f6a88-7b24-4966-8c29-6bf70de88320 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:10.525539 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-839f6a88-7b24-4966-8c29-6bf70de88320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:10.544127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:10.545049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:10.546357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:10.546357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:10.546357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:10.546357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:10.546357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 233/469] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:10.546357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f6a88-7b24-4966-8c29-6bf70de88320 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:10.566111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:10.620839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e30d5-7402-4196-97e7-17d09cd015d1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:10.675314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249b891-c8f5-4041-b759-af63d54fe795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:10.675947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249b891-c8f5-4041-b759-af63d54fe795 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:10.676225 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249b891-c8f5-4041-b759-af63d54fe795 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:10.676491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249b891-c8f5-4041-b759-af63d54fe795 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:10.677185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249b891-c8f5-4041-b759-af63d54fe795 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:10.678670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249b891-c8f5-4041-b759-af63d54fe795 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:10.710613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 237/470] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:32:10 2022] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:32:10.711954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249b891-c8f5-4041-b759-af63d54fe795 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:10.723396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f6a88-7b24-4966-8c29-6bf70de88320 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:10.839732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249b891-c8f5-4041-b759-af63d54fe795 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:10.877436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:10.887287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0e3e1-ee55-42ba-822e-6ec220dddd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:10.893346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0e3e1-ee55-42ba-822e-6ec220dddd9c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:10.893346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0e3e1-ee55-42ba-822e-6ec220dddd9c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:10.893346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0e3e1-ee55-42ba-822e-6ec220dddd9c None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:10.893346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0e3e1-ee55-42ba-822e-6ec220dddd9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:10.893346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0e3e1-ee55-42ba-822e-6ec220dddd9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:10.893346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a0e3e1-ee55-42ba-822e-6ec220dddd9c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:10.898147 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e68af-14ca-4fdc-b102-d4b4e3c9d4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:10.898909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e68af-14ca-4fdc-b102-d4b4e3c9d4ff None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:10.899202 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e68af-14ca-4fdc-b102-d4b4e3c9d4ff None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:10.899470 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e68af-14ca-4fdc-b102-d4b4e3c9d4ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:10.909217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 238/471] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:10.915850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0e3e1-ee55-42ba-822e-6ec220dddd9c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:10.945413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e68af-14ca-4fdc-b102-d4b4e3c9d4ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:10.945413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e68af-14ca-4fdc-b102-d4b4e3c9d4ff None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-7a8e68af-14ca-4fdc-b102-d4b4e3c9d4ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:10.965707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:10.966611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:10.967884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:10.967884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:10.967884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:10.967884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:10.967884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 234/472] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:10.975345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e68af-14ca-4fdc-b102-d4b4e3c9d4ff None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:11.042848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0e3e1-ee55-42ba-822e-6ec220dddd9c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:11.047847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:11.092310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f970bdc-a334-44b7-919a-6b6b612a58e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:11.093435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f970bdc-a334-44b7-919a-6b6b612a58e5 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:11.093723 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f970bdc-a334-44b7-919a-6b6b612a58e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:11.094973 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f970bdc-a334-44b7-919a-6b6b612a58e5 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:11.095941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f970bdc-a334-44b7-919a-6b6b612a58e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:11.097799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f970bdc-a334-44b7-919a-6b6b612a58e5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:11.114339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e68af-14ca-4fdc-b102-d4b4e3c9d4ff None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:11.132282 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 239/473] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:32:10 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:32:11.155104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8d241-2e75-4a12-aedd-299f92e2a6f7 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:11.155416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8d241-2e75-4a12-aedd-299f92e2a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:11.155660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8d241-2e75-4a12-aedd-299f92e2a6f7 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:11.160946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 240/474] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:11.165959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fe709-e768-4389-8cb8-b777482fc23e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:11.166164 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fe709-e768-4389-8cb8-b777482fc23e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:11.166439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fe709-e768-4389-8cb8-b777482fc23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:11.178591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf57771-6816-4d11-95dd-7bf55a346ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:11.178591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf57771-6816-4d11-95dd-7bf55a346ea8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:11.178591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf57771-6816-4d11-95dd-7bf55a346ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:11.178591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf57771-6816-4d11-95dd-7bf55a346ea8 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:11.178998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf57771-6816-4d11-95dd-7bf55a346ea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:11.178998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf57771-6816-4d11-95dd-7bf55a346ea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:11.178998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf57771-6816-4d11-95dd-7bf55a346ea8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:11.193313 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 235/475] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:11.193527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-966fe709-e768-4389-8cb8-b777482fc23e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:11.194321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-966fe709-e768-4389-8cb8-b777482fc23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:11.199579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf57771-6816-4d11-95dd-7bf55a346ea8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:11.245337 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:11.289472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 241/476] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:11.322219 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf57771-6816-4d11-95dd-7bf55a346ea8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:11.330384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fe709-e768-4389-8cb8-b777482fc23e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:11.341311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:11.374128 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd0b8e-866a-4d6b-a0cb-e032aa1227b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:11.374772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd0b8e-866a-4d6b-a0cb-e032aa1227b9 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:11.375054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd0b8e-866a-4d6b-a0cb-e032aa1227b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:11.375326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd0b8e-866a-4d6b-a0cb-e032aa1227b9 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:11.376040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd0b8e-866a-4d6b-a0cb-e032aa1227b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:11.378506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd0b8e-866a-4d6b-a0cb-e032aa1227b9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:11.414086 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 236/477] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:32:11 2022] POST /identity/v3/users => generated 249 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:32:11.496423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fe709-e768-4389-8cb8-b777482fc23e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:11.535302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774064e-7363-43c1-9410-a89b12fddcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:11.536924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774064e-7363-43c1-9410-a89b12fddcf5 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:11.536924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774064e-7363-43c1-9410-a89b12fddcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:11.536924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774064e-7363-43c1-9410-a89b12fddcf5 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:11.537264 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774064e-7363-43c1-9410-a89b12fddcf5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:11.538721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774064e-7363-43c1-9410-a89b12fddcf5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:11.549867 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.sql.core [None req-9774064e-7363-43c1-9410-a89b12fddcf5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 02:32:11.549867 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 02:32:11.549867 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [parameters: {'id': '0963a63024694aea946646b47033140f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 02:32:11.549867 dv-cinder-850840-2-smb devstack@keystone.service[86830]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86830) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9774064e-7363-43c1-9410-a89b12fddcf5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 26 02:32:11.567896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return ref.to_dict() Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 02:32:11.568838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application yield resource Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise self.value Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application session.commit() Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 02:32:11.569814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.flush() Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application compat.raise_( Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 02:32:11.570661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 02:32:11.571524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 02:32:11.572319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [parameters: {'id': '0963a63024694aea946646b47033140f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:11.573107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 02:32:11.576158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:11.578113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 242/478] 10.222.0.39 () {60 vars in 1131 bytes} [Tue Jul 26 02:32:11 2022] POST /identity/v3/roles => generated 144 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:11.578244 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd0b8e-866a-4d6b-a0cb-e032aa1227b9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:11.723134 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd0b8e-866a-4d6b-a0cb-e032aa1227b9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:11.758333 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c86a0-891e-48d3-b210-54882742eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:11.758993 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c86a0-891e-48d3-b210-54882742eac4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:11.759275 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c86a0-891e-48d3-b210-54882742eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:11.759551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c86a0-891e-48d3-b210-54882742eac4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:11.772080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c86a0-891e-48d3-b210-54882742eac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d68c86a0-891e-48d3-b210-54882742eac4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:11.778530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:11.779400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:11.780629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:11.780629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:11.780629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:11.780629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:11.780629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:11.780629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:11.780629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:11.780629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:11.780629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:11.780629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:11.780629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 02:32:11.780629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:11.780629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 237/479] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:32:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:11.785766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774064e-7363-43c1-9410-a89b12fddcf5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:11.830202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:11.919149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774064e-7363-43c1-9410-a89b12fddcf5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:11.964198 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c234-379e-4368-b474-d6eecf69524b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:11.964663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c234-379e-4368-b474-d6eecf69524b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:11.964952 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c234-379e-4368-b474-d6eecf69524b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:11.965599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c234-379e-4368-b474-d6eecf69524b None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:11.969306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9c234-379e-4368-b474-d6eecf69524b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:11.969306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9c234-379e-4368-b474-d6eecf69524b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:11.969306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9c234-379e-4368-b474-d6eecf69524b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:11.978825 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 243/480] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:13.114604 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21645fec-416c-4776-81d7-8a1ce29cf7b5 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:13.115110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21645fec-416c-4776-81d7-8a1ce29cf7b5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:13.115110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21645fec-416c-4776-81d7-8a1ce29cf7b5 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:13.116625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 238/481] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:13.131090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd486d-8d22-4877-a9dd-ec685162e2e8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:13.131708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd486d-8d22-4877-a9dd-ec685162e2e8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:13.131708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd486d-8d22-4877-a9dd-ec685162e2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:13.158526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-48fd486d-8d22-4877-a9dd-ec685162e2e8 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:13.159795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-48fd486d-8d22-4877-a9dd-ec685162e2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:13.263272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 244/482] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:13.298336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21645fec-416c-4776-81d7-8a1ce29cf7b5 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:13.335707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:13.492059 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21645fec-416c-4776-81d7-8a1ce29cf7b5 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:13.558824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e086d-b5e4-4517-bca7-3904b2352ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:13.558824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e086d-b5e4-4517-bca7-3904b2352ddc None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:13.559090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e086d-b5e4-4517-bca7-3904b2352ddc None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:13.559364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e086d-b5e4-4517-bca7-3904b2352ddc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:13.578794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e086d-b5e4-4517-bca7-3904b2352ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-3f6e086d-b5e4-4517-bca7-3904b2352ddc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:13.584332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:13.585210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:13.586033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:13.586033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:13.586033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:13.586033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:13.586033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:13.586033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:13.586033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:13.586033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:13.586033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:13.586033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:13.586033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:13.586033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:13.586033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 239/483] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:13.593328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd486d-8d22-4877-a9dd-ec685162e2e8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:13.647348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:13.687268 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd973a4-1b62-4dec-8e9b-dc2d720a2d44 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:13.687734 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd973a4-1b62-4dec-8e9b-dc2d720a2d44 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:13.688018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd973a4-1b62-4dec-8e9b-dc2d720a2d44 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:13.693441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 240/484] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:32:13.702018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3264056-f816-4f2e-bf9d-3a686abd2b60 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:13.702579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3264056-f816-4f2e-bf9d-3a686abd2b60 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:13.703034 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3264056-f816-4f2e-bf9d-3a686abd2b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:13.745374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd486d-8d22-4877-a9dd-ec685162e2e8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:13.766544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f3264056-f816-4f2e-bf9d-3a686abd2b60 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:13.768119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f3264056-f816-4f2e-bf9d-3a686abd2b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:13.791304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e8b12-d1af-4582-b84d-338c0d3447f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:13.792278 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e8b12-d1af-4582-b84d-338c0d3447f7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:13.792758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e8b12-d1af-4582-b84d-338c0d3447f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:13.793436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e8b12-d1af-4582-b84d-338c0d3447f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:13.794473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e8b12-d1af-4582-b84d-338c0d3447f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:13.801909 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e8b12-d1af-4582-b84d-338c0d3447f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:13.803640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e8b12-d1af-4582-b84d-338c0d3447f7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:13.825415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 245/485] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:13.831478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e8b12-d1af-4582-b84d-338c0d3447f7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:13.906232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 241/486] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:13.934438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3264056-f816-4f2e-bf9d-3a686abd2b60 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:13.953657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:14.012719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:14.035317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e8b12-d1af-4582-b84d-338c0d3447f7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:14.076846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe6f864-250e-4311-b116-02b893151823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:14.077535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6f864-250e-4311-b116-02b893151823 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:14.077822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6f864-250e-4311-b116-02b893151823 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:14.078384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe6f864-250e-4311-b116-02b893151823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:14.090828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6f864-250e-4311-b116-02b893151823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:14.092553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe6f864-250e-4311-b116-02b893151823 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:14.113094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3264056-f816-4f2e-bf9d-3a686abd2b60 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-fbe6f864-250e-4311-b116-02b893151823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:14.123786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:14.124656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:14.125524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:14.125524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:14.125524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:14.125524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:14.125524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 246/487] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:14.126634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc9585-12b8-465b-a63f-2518802dceb4 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:14.126915 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc9585-12b8-465b-a63f-2518802dceb4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:14.127194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc9585-12b8-465b-a63f-2518802dceb4 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:14.133563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 247/488] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:14.133563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc9585-12b8-465b-a63f-2518802dceb4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:14.168329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d8487-94ce-454d-9b12-dc09f600a3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:14.170521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8487-94ce-454d-9b12-dc09f600a3b4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:14.171115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8487-94ce-454d-9b12-dc09f600a3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:14.171575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8487-94ce-454d-9b12-dc09f600a3b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:14.196585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d8487-94ce-454d-9b12-dc09f600a3b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-cf6d8487-94ce-454d-9b12-dc09f600a3b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:14.204447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:14.205497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:14.206299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:14.206299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:14.206299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:14.206299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:14.206299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:14.206299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:14.206299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:14.206299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:14.206299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:14.206299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:14.206299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:14.206299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:14.211733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 242/489] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:14.213609 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3fc82-0854-4f0d-b53d-4e3849b3bf38 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:14.213896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3fc82-0854-4f0d-b53d-4e3849b3bf38 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:14.214174 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3fc82-0854-4f0d-b53d-4e3849b3bf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:14.255345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4cd3fc82-0854-4f0d-b53d-4e3849b3bf38 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:14.256588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4cd3fc82-0854-4f0d-b53d-4e3849b3bf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:14.303927 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc9585-12b8-465b-a63f-2518802dceb4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:14.345977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b35ab-76d1-4079-a12c-ac35023a9b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:14.346614 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b35ab-76d1-4079-a12c-ac35023a9b11 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:14.346869 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b35ab-76d1-4079-a12c-ac35023a9b11 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:14.347139 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b35ab-76d1-4079-a12c-ac35023a9b11 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:14.347838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b35ab-76d1-4079-a12c-ac35023a9b11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:14.348252 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b35ab-76d1-4079-a12c-ac35023a9b11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:14.349671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b35ab-76d1-4079-a12c-ac35023a9b11 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:14.360751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:14.370293 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 243/491] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:14.371514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3fc82-0854-4f0d-b53d-4e3849b3bf38 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:14.371680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 248/491] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:14.373156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a74144-97ef-4f55-93b5-5a70709cca07 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:14.373528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a74144-97ef-4f55-93b5-5a70709cca07 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:14.374172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a74144-97ef-4f55-93b5-5a70709cca07 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:14.375768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 249/492] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:14.378266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:14.381073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a74144-97ef-4f55-93b5-5a70709cca07 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:14.498623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3fc82-0854-4f0d-b53d-4e3849b3bf38 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:14.519447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a74144-97ef-4f55-93b5-5a70709cca07 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:14.538893 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31750372-52e4-4ed5-a7af-f22d92172720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:14.539504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31750372-52e4-4ed5-a7af-f22d92172720 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:14.539773 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31750372-52e4-4ed5-a7af-f22d92172720 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:14.540042 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31750372-52e4-4ed5-a7af-f22d92172720 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:14.541744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31750372-52e4-4ed5-a7af-f22d92172720 None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:14.541744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31750372-52e4-4ed5-a7af-f22d92172720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:14.542816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31750372-52e4-4ed5-a7af-f22d92172720 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:14.557622 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 244/493] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:14.559060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65edde-7e24-4d0a-be62-cc230880db8b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:14.559454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65edde-7e24-4d0a-be62-cc230880db8b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:14.559636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65edde-7e24-4d0a-be62-cc230880db8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:14.572304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dab434-9e76-47ae-9a05-000128cdb7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:14.572958 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab434-9e76-47ae-9a05-000128cdb7fe None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:14.573242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab434-9e76-47ae-9a05-000128cdb7fe None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:14.573541 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dab434-9e76-47ae-9a05-000128cdb7fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:14.580096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ce65edde-7e24-4d0a-be62-cc230880db8b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:14.581351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ce65edde-7e24-4d0a-be62-cc230880db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:14.582191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dab434-9e76-47ae-9a05-000128cdb7fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:14.583818 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dab434-9e76-47ae-9a05-000128cdb7fe None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-42dab434-9e76-47ae-9a05-000128cdb7fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:14.603434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:14.604370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:14.606160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:14.606160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:14.606160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:14.606160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:14.606160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:14.606160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:14.606160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:14.606160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:14.606160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:32:14.606160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:14.606160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 250/494] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 02:32:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:14.606160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dab434-9e76-47ae-9a05-000128cdb7fe None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:14.661452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:14.671133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 245/495] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:14.672171 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65edde-7e24-4d0a-be62-cc230880db8b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:14.707846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:14.759141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dab434-9e76-47ae-9a05-000128cdb7fe None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:14.787803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65edde-7e24-4d0a-be62-cc230880db8b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:14.810435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2dbb3-b48d-41d0-9f57-4396cf67d56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:14.811019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2dbb3-b48d-41d0-9f57-4396cf67d56e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:14.811518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2dbb3-b48d-41d0-9f57-4396cf67d56e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:14.811799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2dbb3-b48d-41d0-9f57-4396cf67d56e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:14.825950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2dbb3-b48d-41d0-9f57-4396cf67d56e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:14.827670 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d33f67-d76c-4f19-b570-36708ae7f497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:14.828316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d33f67-d76c-4f19-b570-36708ae7f497 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:14.828629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d33f67-d76c-4f19-b570-36708ae7f497 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:14.828899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d33f67-d76c-4f19-b570-36708ae7f497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-fae2dbb3-b48d-41d0-9f57-4396cf67d56e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:14.832749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:14.833754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:14.834563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:14.834563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:14.834563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:14.834563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:14.834563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:14.834563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:14.834563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:14.834563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:14.834563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:14.834563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:14.834563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:14.834563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:14.834563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 251/496] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:14.835212 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2dbb3-b48d-41d0-9f57-4396cf67d56e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:14.846720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d33f67-d76c-4f19-b570-36708ae7f497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:14.851213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d33f67-d76c-4f19-b570-36708ae7f497 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-69d33f67-d76c-4f19-b570-36708ae7f497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:14.873062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:14.874015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:14.874854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:14.874854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:14.874854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:14.874854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:14.877525 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 246/497] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:14.879178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d33f67-d76c-4f19-b570-36708ae7f497 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:14.933532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:14.959100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2dbb3-b48d-41d0-9f57-4396cf67d56e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:14.980327 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:14.992723 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d33f67-d76c-4f19-b570-36708ae7f497 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:14.998303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c7800-00d8-402f-852d-1b17f96bfa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:14.999013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c7800-00d8-402f-852d-1b17f96bfa07 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:14.999295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c7800-00d8-402f-852d-1b17f96bfa07 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:14.999568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c7800-00d8-402f-852d-1b17f96bfa07 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:15.000355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c7800-00d8-402f-852d-1b17f96bfa07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:15.000659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c7800-00d8-402f-852d-1b17f96bfa07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:15.002131 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c7800-00d8-402f-852d-1b17f96bfa07 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:15.027441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d31e33-7069-43e4-b3e9-2cd1a9f18611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:15.028127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d31e33-7069-43e4-b3e9-2cd1a9f18611 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:15.028410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d31e33-7069-43e4-b3e9-2cd1a9f18611 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:15.028681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d31e33-7069-43e4-b3e9-2cd1a9f18611 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:15.040076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d31e33-7069-43e4-b3e9-2cd1a9f18611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:15.044759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 252/498] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 02:32:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:15.044759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c7800-00d8-402f-852d-1b17f96bfa07 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a9d31e33-7069-43e4-b3e9-2cd1a9f18611 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:15.045636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:15.046495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:15.047289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:15.047289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:15.047289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:15.047289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:15.047289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:15.047289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:15.047289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:15.047289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:15.047289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:15.047289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:15.047289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:15.047289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:15.047289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 247/499] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:15.047947 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430983-fc96-4820-b429-f05be0ddd53c None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:15.048229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430983-fc96-4820-b429-f05be0ddd53c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:15.048503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3430983-fc96-4820-b429-f05be0ddd53c None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:15.049976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 248/500] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:15.054083 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3430983-fc96-4820-b429-f05be0ddd53c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:15.154270 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c7800-00d8-402f-852d-1b17f96bfa07 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:15.166671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3430983-fc96-4820-b429-f05be0ddd53c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:15.174587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:15.193230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6d0ee-193e-41f6-9d44-ee5c764fb1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:15.193886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6d0ee-193e-41f6-9d44-ee5c764fb1a2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:15.194169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6d0ee-193e-41f6-9d44-ee5c764fb1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:15.194442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6d0ee-193e-41f6-9d44-ee5c764fb1a2 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:15.195169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6d0ee-193e-41f6-9d44-ee5c764fb1a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:15.195477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6d0ee-193e-41f6-9d44-ee5c764fb1a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:15.196857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6d0ee-193e-41f6-9d44-ee5c764fb1a2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:15.209328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 253/501] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:15.209493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62115d5-e0e8-4729-bdfe-2d136efb7cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:15.209493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62115d5-e0e8-4729-bdfe-2d136efb7cf4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:15.209667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6d0ee-193e-41f6-9d44-ee5c764fb1a2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:15.209747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62115d5-e0e8-4729-bdfe-2d136efb7cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:15.209747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62115d5-e0e8-4729-bdfe-2d136efb7cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:15.209747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62115d5-e0e8-4729-bdfe-2d136efb7cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:15.209747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62115d5-e0e8-4729-bdfe-2d136efb7cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:15.209747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62115d5-e0e8-4729-bdfe-2d136efb7cf4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:15.223596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 249/502] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:15.224443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62115d5-e0e8-4729-bdfe-2d136efb7cf4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:15.254782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:15.316955 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6d0ee-193e-41f6-9d44-ee5c764fb1a2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:15.336176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62115d5-e0e8-4729-bdfe-2d136efb7cf4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:15.355275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470b220-b947-4c4a-8aa8-9b771b4e2cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:15.356115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470b220-b947-4c4a-8aa8-9b771b4e2cb9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:15.356491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470b220-b947-4c4a-8aa8-9b771b4e2cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:15.356858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470b220-b947-4c4a-8aa8-9b771b4e2cb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:15.372627 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd32b2-4f4b-4feb-b23e-21430c5653b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:15.374050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd32b2-4f4b-4feb-b23e-21430c5653b4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:15.374347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd32b2-4f4b-4feb-b23e-21430c5653b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:15.374618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd32b2-4f4b-4feb-b23e-21430c5653b4 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:15.375359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd32b2-4f4b-4feb-b23e-21430c5653b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:15.375664 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd32b2-4f4b-4feb-b23e-21430c5653b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:15.377057 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd32b2-4f4b-4feb-b23e-21430c5653b4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:15.386109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 250/503] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:15.387931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2549cb-a597-4c9e-9f90-c0a9537ac91a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:15.388220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2549cb-a597-4c9e-9f90-c0a9537ac91a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:15.388492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2549cb-a597-4c9e-9f90-c0a9537ac91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:15.411034 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6f2549cb-a597-4c9e-9f90-c0a9537ac91a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:15.412163 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6f2549cb-a597-4c9e-9f90-c0a9537ac91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:15.429447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470b220-b947-4c4a-8aa8-9b771b4e2cb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:15.430952 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470b220-b947-4c4a-8aa8-9b771b4e2cb9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:15.436835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:15.473528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:15.493857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 251/504] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:15.494537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2549cb-a597-4c9e-9f90-c0a9537ac91a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:15.544235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 254/505] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:15.545203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470b220-b947-4c4a-8aa8-9b771b4e2cb9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:15.608402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2549cb-a597-4c9e-9f90-c0a9537ac91a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:15.646978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46f095-6503-4324-b21f-c6fcf0ce0956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:15.647630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46f095-6503-4324-b21f-c6fcf0ce0956 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:15.647909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46f095-6503-4324-b21f-c6fcf0ce0956 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:15.648181 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46f095-6503-4324-b21f-c6fcf0ce0956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:15.659615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470b220-b947-4c4a-8aa8-9b771b4e2cb9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:15.659851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46f095-6503-4324-b21f-c6fcf0ce0956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:15.661752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46f095-6503-4324-b21f-c6fcf0ce0956 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-0f46f095-6503-4324-b21f-c6fcf0ce0956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:15.676758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:15.677698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:15.678544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:15.678544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:15.678544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:15.678544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:15.678544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 252/506] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:15.678824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46f095-6503-4324-b21f-c6fcf0ce0956 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:15.693264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:15.702541 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0b9e5-b956-4e0a-86a1-1e178f2fd11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:15.703400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0b9e5-b956-4e0a-86a1-1e178f2fd11e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:15.703720 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0b9e5-b956-4e0a-86a1-1e178f2fd11e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:15.703997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0b9e5-b956-4e0a-86a1-1e178f2fd11e None admin] PATH_INFO: `/v3/users/glance` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:15.711650 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0b9e5-b956-4e0a-86a1-1e178f2fd11e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:15.713357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0b9e5-b956-4e0a-86a1-1e178f2fd11e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:15.715882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-d4a0b9e5-b956-4e0a-86a1-1e178f2fd11e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:15.729633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:15.730771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:15.731657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:15.731657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:15.731657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:15.731657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:15.731657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:15.731657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:15.731657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:15.731657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:15.731657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 02:32:15.731657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:15.732156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 255/507] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:15.732585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0b9e5-b956-4e0a-86a1-1e178f2fd11e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:15.796513 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46f095-6503-4324-b21f-c6fcf0ce0956 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:15.836164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24876cc0-ade1-4a2e-a051-215a35b37c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:15.836838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24876cc0-ade1-4a2e-a051-215a35b37c3a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:15.837123 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24876cc0-ade1-4a2e-a051-215a35b37c3a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:15.837454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24876cc0-ade1-4a2e-a051-215a35b37c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:15.841629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0b9e5-b956-4e0a-86a1-1e178f2fd11e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:15.850335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24876cc0-ade1-4a2e-a051-215a35b37c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:15.852172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24876cc0-ade1-4a2e-a051-215a35b37c3a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-24876cc0-ade1-4a2e-a051-215a35b37c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:15.868719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:15.869719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:15.870574 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:15.870574 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:15.870574 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:15.870574 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:15.870574 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 253/508] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:15.871267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24876cc0-ade1-4a2e-a051-215a35b37c3a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:15.881376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f9670-b60b-454a-b0fc-338f1b8a6b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:15.882017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f9670-b60b-454a-b0fc-338f1b8a6b14 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:15.882518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f9670-b60b-454a-b0fc-338f1b8a6b14 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:15.882789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f9670-b60b-454a-b0fc-338f1b8a6b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:15.893455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f9670-b60b-454a-b0fc-338f1b8a6b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:15.894888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f9670-b60b-454a-b0fc-338f1b8a6b14 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-8a5f9670-b60b-454a-b0fc-338f1b8a6b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:15.910108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:15.910989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:15.911882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:15.911882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:15.911882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:15.911882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:15.913820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 256/509] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:15.914802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f9670-b60b-454a-b0fc-338f1b8a6b14 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:15.943354 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:15.972930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:15.985331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24876cc0-ade1-4a2e-a051-215a35b37c3a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:16.022539 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbb05b-532d-4de5-bd29-1f598ec10532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:16.023442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbb05b-532d-4de5-bd29-1f598ec10532 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:16.023728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbb05b-532d-4de5-bd29-1f598ec10532 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:16.024004 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbb05b-532d-4de5-bd29-1f598ec10532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:16.025131 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f9670-b60b-454a-b0fc-338f1b8a6b14 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:16.035239 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbb05b-532d-4de5-bd29-1f598ec10532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:16.036720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbb05b-532d-4de5-bd29-1f598ec10532 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-27fbb05b-532d-4de5-bd29-1f598ec10532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:16.052383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:16.053496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:16.054347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:16.054347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:16.054347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:16.054347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:16.057461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 254/510] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:16.058288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbb05b-532d-4de5-bd29-1f598ec10532 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:16.059196 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b4569-d25f-4cf6-a4ba-074ca1074f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:16.059817 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b4569-d25f-4cf6-a4ba-074ca1074f4b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:16.060099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b4569-d25f-4cf6-a4ba-074ca1074f4b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:16.060373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b4569-d25f-4cf6-a4ba-074ca1074f4b None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:16.061079 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b4569-d25f-4cf6-a4ba-074ca1074f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:16.061436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b4569-d25f-4cf6-a4ba-074ca1074f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:16.063115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b4569-d25f-4cf6-a4ba-074ca1074f4b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:16.075540 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 257/511] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:16.076363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b4569-d25f-4cf6-a4ba-074ca1074f4b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:16.167543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbb05b-532d-4de5-bd29-1f598ec10532 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:16.182078 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:16.191080 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b4569-d25f-4cf6-a4ba-074ca1074f4b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:16.204107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e20e6e-b048-4583-801f-a0cabdaabc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:16.204764 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e20e6e-b048-4583-801f-a0cabdaabc19 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:16.205045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e20e6e-b048-4583-801f-a0cabdaabc19 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:16.205358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e20e6e-b048-4583-801f-a0cabdaabc19 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:16.205880 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:16.206178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e20e6e-b048-4583-801f-a0cabdaabc19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:16.206484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e20e6e-b048-4583-801f-a0cabdaabc19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:16.208117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e20e6e-b048-4583-801f-a0cabdaabc19 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:16.227859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9cf02-6dfd-40d8-8b18-272171b070b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:16.228550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9cf02-6dfd-40d8-8b18-272171b070b6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:16.228858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9cf02-6dfd-40d8-8b18-272171b070b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:16.229120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9cf02-6dfd-40d8-8b18-272171b070b6 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:16.229927 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9cf02-6dfd-40d8-8b18-272171b070b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:16.230247 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9cf02-6dfd-40d8-8b18-272171b070b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:16.231758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9cf02-6dfd-40d8-8b18-272171b070b6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:16.248224 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 258/512] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:16.248224 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9cf02-6dfd-40d8-8b18-272171b070b6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:16.248509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 255/513] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Jul 26 02:32:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:16.248509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e20e6e-b048-4583-801f-a0cabdaabc19 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:16.354196 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e20e6e-b048-4583-801f-a0cabdaabc19 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:16.360176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9cf02-6dfd-40d8-8b18-272171b070b6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:16.390194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d8fc-2008-4ea2-97fb-743ab7105481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:16.390824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d8fc-2008-4ea2-97fb-743ab7105481 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:16.391105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d8fc-2008-4ea2-97fb-743ab7105481 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:16.391381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10d8fc-2008-4ea2-97fb-743ab7105481 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:16.392092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d8fc-2008-4ea2-97fb-743ab7105481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:16.392508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d8fc-2008-4ea2-97fb-743ab7105481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:16.393867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d10d8fc-2008-4ea2-97fb-743ab7105481 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:16.396411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00494240-c1a4-4e35-9cc0-716ca758f357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:16.397023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00494240-c1a4-4e35-9cc0-716ca758f357 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:16.397424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00494240-c1a4-4e35-9cc0-716ca758f357 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:16.397605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00494240-c1a4-4e35-9cc0-716ca758f357 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:16.398295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00494240-c1a4-4e35-9cc0-716ca758f357 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:16.398592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00494240-c1a4-4e35-9cc0-716ca758f357 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:16.399940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00494240-c1a4-4e35-9cc0-716ca758f357 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:16.405864 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 256/514] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:16.406698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d8fc-2008-4ea2-97fb-743ab7105481 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:16.414787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 259/515] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:16.415694 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00494240-c1a4-4e35-9cc0-716ca758f357 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:16.444339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:16.449391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:16.522200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10d8fc-2008-4ea2-97fb-743ab7105481 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:16.528767 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00494240-c1a4-4e35-9cc0-716ca758f357 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:16.561612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed51a8-fdeb-41a7-80e2-11eb627772d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:16.562262 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed51a8-fdeb-41a7-80e2-11eb627772d5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:16.562540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed51a8-fdeb-41a7-80e2-11eb627772d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:16.562813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed51a8-fdeb-41a7-80e2-11eb627772d5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:16.568034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85308b3-8db4-4afc-abcd-c84f68f992e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:16.568862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85308b3-8db4-4afc-abcd-c84f68f992e3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:16.569094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85308b3-8db4-4afc-abcd-c84f68f992e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:16.569559 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85308b3-8db4-4afc-abcd-c84f68f992e3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:16.571202 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed51a8-fdeb-41a7-80e2-11eb627772d5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:16.572680 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed51a8-fdeb-41a7-80e2-11eb627772d5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:16.577712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85308b3-8db4-4afc-abcd-c84f68f992e3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:16.579207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85308b3-8db4-4afc-abcd-c84f68f992e3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-00ed51a8-fdeb-41a7-80e2-11eb627772d5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:16.585700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:16.586610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:16.587498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:16.587498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:16.587498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:16.587498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:16.587498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:16.587498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:16.587498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:16.587498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:16.587498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 02:32:16.587498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:16.587498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 257/516] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:16.588918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed51a8-fdeb-41a7-80e2-11eb627772d5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c85308b3-8db4-4afc-abcd-c84f68f992e3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:16.595054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:16.595931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:16.596836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:16.596836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:16.596836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:16.596836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:16.596836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:16.596836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:16.596836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:16.596836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:16.596836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 02:32:16.596836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:16.596836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 260/517] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:16.598126 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85308b3-8db4-4afc-abcd-c84f68f992e3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:16.697222 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:16.702769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:16.708830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed51a8-fdeb-41a7-80e2-11eb627772d5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:16.712719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85308b3-8db4-4afc-abcd-c84f68f992e3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:16.748266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185021bb-7fe4-4be6-b99d-57eef6dafb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:16.748913 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185021bb-7fe4-4be6-b99d-57eef6dafb14 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:16.749193 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185021bb-7fe4-4be6-b99d-57eef6dafb14 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:16.749309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1798b47-5409-46af-b148-afde23351e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:16.749516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185021bb-7fe4-4be6-b99d-57eef6dafb14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:16.750032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1798b47-5409-46af-b148-afde23351e67 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:16.750133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1798b47-5409-46af-b148-afde23351e67 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:16.750410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1798b47-5409-46af-b148-afde23351e67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:16.757557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185021bb-7fe4-4be6-b99d-57eef6dafb14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:16.759175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185021bb-7fe4-4be6-b99d-57eef6dafb14 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-185021bb-7fe4-4be6-b99d-57eef6dafb14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:16.772789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:16.773714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:16.774553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:16.774553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:16.774553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:16.774553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:16.774553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:16.774553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:16.774553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:16.774553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:16.774553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 261/518] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:16.775017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185021bb-7fe4-4be6-b99d-57eef6dafb14 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:16.826062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1798b47-5409-46af-b148-afde23351e67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:16.827882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1798b47-5409-46af-b148-afde23351e67 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:16.883404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185021bb-7fe4-4be6-b99d-57eef6dafb14 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:16.918974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeacb01-eb48-4533-97e4-9784d4ea64c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:16.919601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeacb01-eb48-4533-97e4-9784d4ea64c6 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:16.919872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeacb01-eb48-4533-97e4-9784d4ea64c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:16.920138 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeacb01-eb48-4533-97e4-9784d4ea64c6 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:16.920818 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeacb01-eb48-4533-97e4-9784d4ea64c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:16.922465 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeacb01-eb48-4533-97e4-9784d4ea64c6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:16.926844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:16.940384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 258/519] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:16.941531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1798b47-5409-46af-b148-afde23351e67 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:16.953564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 262/520] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:32:16 2022] POST /identity/v3/users => generated 247 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:32:16.953564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeacb01-eb48-4533-97e4-9784d4ea64c6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:16.965975 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:17.066630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1798b47-5409-46af-b148-afde23351e67 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:17.104477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeacb01-eb48-4533-97e4-9784d4ea64c6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:17.109713 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb881ff-bfe1-47a0-8e6d-001655cfd7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:17.110357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb881ff-bfe1-47a0-8e6d-001655cfd7a0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:17.110635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb881ff-bfe1-47a0-8e6d-001655cfd7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:17.110908 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb881ff-bfe1-47a0-8e6d-001655cfd7a0 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:17.111717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb881ff-bfe1-47a0-8e6d-001655cfd7a0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:17.112022 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb881ff-bfe1-47a0-8e6d-001655cfd7a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:17.113502 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb881ff-bfe1-47a0-8e6d-001655cfd7a0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:17.135565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 259/521] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Jul 26 02:32:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:17.136418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb881ff-bfe1-47a0-8e6d-001655cfd7a0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:17.164491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039ecf1-ea09-4440-ae9a-a9f33c3eb817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:17.164769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ecf1-ea09-4440-ae9a-a9f33c3eb817 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:17.165143 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ecf1-ea09-4440-ae9a-a9f33c3eb817 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:17.165624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039ecf1-ea09-4440-ae9a-a9f33c3eb817 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:17.168237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039ecf1-ea09-4440-ae9a-a9f33c3eb817 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:17.168237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039ecf1-ea09-4440-ae9a-a9f33c3eb817 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:17.173195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039ecf1-ea09-4440-ae9a-a9f33c3eb817 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:17.198113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 263/522] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Jul 26 02:32:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:17.198789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039ecf1-ea09-4440-ae9a-a9f33c3eb817 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:17.215028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:17.284661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb881ff-bfe1-47a0-8e6d-001655cfd7a0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:17.295796 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:17.336255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d904ed5-818a-4388-8381-57d9759d3d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:17.337013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904ed5-818a-4388-8381-57d9759d3d7f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:17.337204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904ed5-818a-4388-8381-57d9759d3d7f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:17.337634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d904ed5-818a-4388-8381-57d9759d3d7f None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:17.338386 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d904ed5-818a-4388-8381-57d9759d3d7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:17.338700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d904ed5-818a-4388-8381-57d9759d3d7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:17.340484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d904ed5-818a-4388-8381-57d9759d3d7f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:17.340596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039ecf1-ea09-4440-ae9a-a9f33c3eb817 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:17.365100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 260/523] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:17.365998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d904ed5-818a-4388-8381-57d9759d3d7f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:17.386433 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ba0a9-59cd-4e3d-aff7-bd00e9125425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:17.387726 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ba0a9-59cd-4e3d-aff7-bd00e9125425 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:17.388212 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ba0a9-59cd-4e3d-aff7-bd00e9125425 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:17.388846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ba0a9-59cd-4e3d-aff7-bd00e9125425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:17.401352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ba0a9-59cd-4e3d-aff7-bd00e9125425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:17.405356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ba0a9-59cd-4e3d-aff7-bd00e9125425 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b92ba0a9-59cd-4e3d-aff7-bd00e9125425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:17.426709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:17.427738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:17.428578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:17.428578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:17.428578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:17.428578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:17.428578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 264/524] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:17.429561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ba0a9-59cd-4e3d-aff7-bd00e9125425 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:17.513906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d904ed5-818a-4388-8381-57d9759d3d7f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:17.539171 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:17.575318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ba0a9-59cd-4e3d-aff7-bd00e9125425 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:17.576882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3224e7c-adf8-470b-9d71-1fbed55c76e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:17.578582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224e7c-adf8-470b-9d71-1fbed55c76e4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:17.579084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224e7c-adf8-470b-9d71-1fbed55c76e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:17.579551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3224e7c-adf8-470b-9d71-1fbed55c76e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:17.594081 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:17.617761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205f722-4b6f-4f38-ad37-d490017baadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:17.618400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205f722-4b6f-4f38-ad37-d490017baadb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:17.618682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205f722-4b6f-4f38-ad37-d490017baadb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:17.618956 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205f722-4b6f-4f38-ad37-d490017baadb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:17.683101 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3224e7c-adf8-470b-9d71-1fbed55c76e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:17.684752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3224e7c-adf8-470b-9d71-1fbed55c76e4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:17.720628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205f722-4b6f-4f38-ad37-d490017baadb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:17.722310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205f722-4b6f-4f38-ad37-d490017baadb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:17.835269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 261/525] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:17.835269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3224e7c-adf8-470b-9d71-1fbed55c76e4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:17.837426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 265/526] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:17.838788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205f722-4b6f-4f38-ad37-d490017baadb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:17.852149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:17.867480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:17.960535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3224e7c-adf8-470b-9d71-1fbed55c76e4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:17.980188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205f722-4b6f-4f38-ad37-d490017baadb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:18.005943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f877513-10e0-433a-abb0-a4b6adf835f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:18.006564 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f877513-10e0-433a-abb0-a4b6adf835f9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:18.006838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f877513-10e0-433a-abb0-a4b6adf835f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:18.007115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f877513-10e0-433a-abb0-a4b6adf835f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:18.007885 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f877513-10e0-433a-abb0-a4b6adf835f9 None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=338b2744014940ca96c08d4e9262697b) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:18.008204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f877513-10e0-433a-abb0-a4b6adf835f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:18.009662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f877513-10e0-433a-abb0-a4b6adf835f9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:18.015394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 262/527] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:17 2022] GET /identity/v3/role_assignments?user.id=338b2744014940ca96c08d4e9262697b&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:18.015962 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f877513-10e0-433a-abb0-a4b6adf835f9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:18.030687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe294e-5d02-4265-8cf8-db4786cd54f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:18.031990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe294e-5d02-4265-8cf8-db4786cd54f1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:18.032472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe294e-5d02-4265-8cf8-db4786cd54f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:18.033118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe294e-5d02-4265-8cf8-db4786cd54f1 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:18.034547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe294e-5d02-4265-8cf8-db4786cd54f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:18.035388 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe294e-5d02-4265-8cf8-db4786cd54f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:18.037378 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe294e-5d02-4265-8cf8-db4786cd54f1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:18.054518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 266/528] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:18.055763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe294e-5d02-4265-8cf8-db4786cd54f1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:18.138856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:18.169496 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:18.200096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe294e-5d02-4265-8cf8-db4786cd54f1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:18.207358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f877513-10e0-433a-abb0-a4b6adf835f9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:18.266318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90487fff-864e-4247-aa61-4ad918218edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:18.268143 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90487fff-864e-4247-aa61-4ad918218edf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:18.268422 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90487fff-864e-4247-aa61-4ad918218edf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:18.269315 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90487fff-864e-4247-aa61-4ad918218edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:18.269843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c4791-ec80-4c9b-9d90-c8d9ca87bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:18.271408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c4791-ec80-4c9b-9d90-c8d9ca87bb83 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:18.271408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c4791-ec80-4c9b-9d90-c8d9ca87bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:18.271408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c4791-ec80-4c9b-9d90-c8d9ca87bb83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:18.292052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90487fff-864e-4247-aa61-4ad918218edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:18.293674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90487fff-864e-4247-aa61-4ad918218edf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:18.295125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c4791-ec80-4c9b-9d90-c8d9ca87bb83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:18.296569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c4791-ec80-4c9b-9d90-c8d9ca87bb83 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d03c4791-ec80-4c9b-9d90-c8d9ca87bb83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:18.320230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:18.321127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:18.322092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:18.322092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:18.322092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:18.322092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-90487fff-864e-4247-aa61-4ad918218edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:18.332317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:18.333167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:18.334096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:18.334096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:18.334096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:18.334096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:18.334315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 263/529] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:18.334871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c4791-ec80-4c9b-9d90-c8d9ca87bb83 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:18.335263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 267/530] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:18.336016 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90487fff-864e-4247-aa61-4ad918218edf None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:18.511386 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c4791-ec80-4c9b-9d90-c8d9ca87bb83 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:18.549093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90487fff-864e-4247-aa61-4ad918218edf None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:18.564433 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:18.582055 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baf41a-49d7-48cc-91e9-7dc585bea94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:18.582711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf41a-49d7-48cc-91e9-7dc585bea94e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:18.582993 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf41a-49d7-48cc-91e9-7dc585bea94e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:18.583272 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baf41a-49d7-48cc-91e9-7dc585bea94e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:18.593121 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baf41a-49d7-48cc-91e9-7dc585bea94e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:18.594602 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baf41a-49d7-48cc-91e9-7dc585bea94e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:18.602852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:18.618183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b82d59-db28-4641-bc48-b90803ae2045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-c4baf41a-49d7-48cc-91e9-7dc585bea94e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:18.619183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:18.620041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:18.620877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:18.620877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:18.620877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:18.620877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:18.620877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:18.620877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:18.620877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:18.620877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:18.625863 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b82d59-db28-4641-bc48-b90803ae2045 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:18.626143 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b82d59-db28-4641-bc48-b90803ae2045 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:18.626412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b82d59-db28-4641-bc48-b90803ae2045 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:18.627126 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b82d59-db28-4641-bc48-b90803ae2045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:18.627427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b82d59-db28-4641-bc48-b90803ae2045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:18.628821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b82d59-db28-4641-bc48-b90803ae2045 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:18.633684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 264/531] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:18.633684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baf41a-49d7-48cc-91e9-7dc585bea94e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:18.655511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 268/532] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:18.662302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b82d59-db28-4641-bc48-b90803ae2045 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:18.846358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baf41a-49d7-48cc-91e9-7dc585bea94e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:18.867734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b82d59-db28-4641-bc48-b90803ae2045 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:18.914862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05648f71-2042-4529-a162-face886c8ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:18.915488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05648f71-2042-4529-a162-face886c8ff5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:18.915767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05648f71-2042-4529-a162-face886c8ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:18.916035 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05648f71-2042-4529-a162-face886c8ff5 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:18.916730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05648f71-2042-4529-a162-face886c8ff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:18.917045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05648f71-2042-4529-a162-face886c8ff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:18.918569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05648f71-2042-4529-a162-face886c8ff5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:18.938162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3794b5-550d-4c5c-abf6-9db35fc54ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:18.938727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3794b5-550d-4c5c-abf6-9db35fc54ca1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:18.939008 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3794b5-550d-4c5c-abf6-9db35fc54ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:18.939274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3794b5-550d-4c5c-abf6-9db35fc54ca1 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:18.940028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3794b5-550d-4c5c-abf6-9db35fc54ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:18.940331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3794b5-550d-4c5c-abf6-9db35fc54ca1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:18.941782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3794b5-550d-4c5c-abf6-9db35fc54ca1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:18.948385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 265/533] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:18.949367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05648f71-2042-4529-a162-face886c8ff5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:18.981005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 269/534] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:18.990002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3794b5-550d-4c5c-abf6-9db35fc54ca1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:19.038471 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:19.064695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:19.131733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05648f71-2042-4529-a162-face886c8ff5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:19.136469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3794b5-550d-4c5c-abf6-9db35fc54ca1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:19.181068 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00a8d2-d8d0-40c2-a2ab-4bd0916500de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00a8d2-d8d0-40c2-a2ab-4bd0916500de None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:19.182911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00a8d2-d8d0-40c2-a2ab-4bd0916500de None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:19.183513 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00a8d2-d8d0-40c2-a2ab-4bd0916500de None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:19.191948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00a8d2-d8d0-40c2-a2ab-4bd0916500de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:19.193471 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb00a8d2-d8d0-40c2-a2ab-4bd0916500de None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:19.201396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a77d73-3700-4043-a8d7-0668768b792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:19.205016 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a77d73-3700-4043-a8d7-0668768b792b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-bb00a8d2-d8d0-40c2-a2ab-4bd0916500de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:19.206267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:19.207264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:19.208154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:19.208154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:19.208154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:19.208154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:19.208154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:19.208154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:19.208154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:19.208154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:19.208154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 266/535] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:19.208618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00a8d2-d8d0-40c2-a2ab-4bd0916500de None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:19.208832 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a77d73-3700-4043-a8d7-0668768b792b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:19.209251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a77d73-3700-4043-a8d7-0668768b792b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:19.224411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a77d73-3700-4043-a8d7-0668768b792b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:19.226317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a77d73-3700-4043-a8d7-0668768b792b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-60a77d73-3700-4043-a8d7-0668768b792b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:19.241824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:19.242689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:19.243529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:19.243529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:19.243529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:19.243529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:19.243529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:19.243529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:19.243529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:19.243529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:19.250715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 270/536] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:19.252013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba09f-6926-4a8b-a5cf-54ece7156dc4 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:19.252301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba09f-6926-4a8b-a5cf-54ece7156dc4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:19.252572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ba09f-6926-4a8b-a5cf-54ece7156dc4 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:19.254037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 271/537] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:19.254576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba09f-6926-4a8b-a5cf-54ece7156dc4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:19.319338 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00a8d2-d8d0-40c2-a2ab-4bd0916500de None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:19.326808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:19.362624 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f70b-cca6-4f5a-a3be-37d1def3feae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:19.363720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f70b-cca6-4f5a-a3be-37d1def3feae None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:19.364250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f70b-cca6-4f5a-a3be-37d1def3feae None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:19.364671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778f70b-cca6-4f5a-a3be-37d1def3feae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:19.365674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778f70b-cca6-4f5a-a3be-37d1def3feae None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=2402339784b34d98a4670db912617331) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:19.366134 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778f70b-cca6-4f5a-a3be-37d1def3feae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:19.367578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778f70b-cca6-4f5a-a3be-37d1def3feae None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:19.381312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 267/538] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:19 2022] GET /identity/v3/role_assignments?user.id=2402339784b34d98a4670db912617331&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:19.381312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f70b-cca6-4f5a-a3be-37d1def3feae None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:19.383372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ba09f-6926-4a8b-a5cf-54ece7156dc4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:19.395716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:19.427812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b696d-68a1-4b47-bb57-74469583efe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:19.428443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b696d-68a1-4b47-bb57-74469583efe5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:19.428719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b696d-68a1-4b47-bb57-74469583efe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:19.428986 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b696d-68a1-4b47-bb57-74469583efe5 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:19.430290 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b696d-68a1-4b47-bb57-74469583efe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:19.430593 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b696d-68a1-4b47-bb57-74469583efe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:19.432561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b696d-68a1-4b47-bb57-74469583efe5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:19.447121 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 272/539] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:19.448862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8511cc-c661-4cba-8d92-fba6842b298b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:19.449435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8511cc-c661-4cba-8d92-fba6842b298b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:19.449904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8511cc-c661-4cba-8d92-fba6842b298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:19.471598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7c8511cc-c661-4cba-8d92-fba6842b298b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:19.473238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7c8511cc-c661-4cba-8d92-fba6842b298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:19.501755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778f70b-cca6-4f5a-a3be-37d1def3feae None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:19.543099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2697c53-f590-4a09-8e3f-c473897788d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:19.543749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2697c53-f590-4a09-8e3f-c473897788d9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:19.544032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2697c53-f590-4a09-8e3f-c473897788d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:19.544306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2697c53-f590-4a09-8e3f-c473897788d9 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:19.545079 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2697c53-f590-4a09-8e3f-c473897788d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:19.545491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2697c53-f590-4a09-8e3f-c473897788d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:19.546992 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2697c53-f590-4a09-8e3f-c473897788d9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:19.560112 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 268/540] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:19.560963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2697c53-f590-4a09-8e3f-c473897788d9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:19.569499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 273/541] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:19.571037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8511cc-c661-4cba-8d92-fba6842b298b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:19.600701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:19.683583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2697c53-f590-4a09-8e3f-c473897788d9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:19.695574 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:19.699209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8511cc-c661-4cba-8d92-fba6842b298b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:19.723768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83413ce4-67a0-41d2-89f1-8b842e3d67d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:19.724811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83413ce4-67a0-41d2-89f1-8b842e3d67d0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:19.725234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83413ce4-67a0-41d2-89f1-8b842e3d67d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:19.725704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83413ce4-67a0-41d2-89f1-8b842e3d67d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:19.726632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83413ce4-67a0-41d2-89f1-8b842e3d67d0 None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=ba1305d4e5914f1182dc7436a2d53965) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:19.727084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83413ce4-67a0-41d2-89f1-8b842e3d67d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:19.729238 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83413ce4-67a0-41d2-89f1-8b842e3d67d0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:19.736031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 269/542] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:19 2022] GET /identity/v3/role_assignments?user.id=ba1305d4e5914f1182dc7436a2d53965&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:19.737009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83413ce4-67a0-41d2-89f1-8b842e3d67d0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:19.740731 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9011063-dcc4-464c-a4cf-2b98cb9cb83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:19.742623 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9011063-dcc4-464c-a4cf-2b98cb9cb83e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:19.743019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9011063-dcc4-464c-a4cf-2b98cb9cb83e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:19.743385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9011063-dcc4-464c-a4cf-2b98cb9cb83e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:19.744319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9011063-dcc4-464c-a4cf-2b98cb9cb83e None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=fe228871a7fd4a9bb15645955ff365c8) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:19.744735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9011063-dcc4-464c-a4cf-2b98cb9cb83e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:19.746424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9011063-dcc4-464c-a4cf-2b98cb9cb83e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:19.761330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 274/543] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:19 2022] GET /identity/v3/role_assignments?user.id=fe228871a7fd4a9bb15645955ff365c8&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:19.853245 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:19.861207 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83413ce4-67a0-41d2-89f1-8b842e3d67d0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:19.900734 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c03f4-2ef4-4b99-aeec-5a9b5da782db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:19.901330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c03f4-2ef4-4b99-aeec-5a9b5da782db None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:19.901616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c03f4-2ef4-4b99-aeec-5a9b5da782db None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:19.901888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c03f4-2ef4-4b99-aeec-5a9b5da782db None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:19.914334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c03f4-2ef4-4b99-aeec-5a9b5da782db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-cd5c03f4-2ef4-4b99-aeec-5a9b5da782db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:19.920075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:19.921029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:19.921859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:19.921859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:19.921859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:19.921859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:19.921859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:19.921859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:19.921859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:19.921859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:19.921859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:19.921859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:19.921859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:19.921859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:19.925424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 270/544] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:19.927939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9011063-dcc4-464c-a4cf-2b98cb9cb83e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:20.037850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9011063-dcc4-464c-a4cf-2b98cb9cb83e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:20.076114 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628b163-7893-4b99-954f-f06333ad01bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:20.077109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628b163-7893-4b99-954f-f06333ad01bb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:20.077647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628b163-7893-4b99-954f-f06333ad01bb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:20.078130 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628b163-7893-4b99-954f-f06333ad01bb None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:20.079048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628b163-7893-4b99-954f-f06333ad01bb None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:20.079547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628b163-7893-4b99-954f-f06333ad01bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:20.081107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628b163-7893-4b99-954f-f06333ad01bb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:20.090627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 275/545] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:20.096091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c03f4-2ef4-4b99-aeec-5a9b5da782db None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:20.124012 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f164d9e-be8e-4bb6-b0fc-d92bb89ddd61 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:20.124630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f164d9e-be8e-4bb6-b0fc-d92bb89ddd61 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:20.125173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f164d9e-be8e-4bb6-b0fc-d92bb89ddd61 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:20.127101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 276/546] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:20.132489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6793ecf-fa8e-45fa-a49d-d43b4c7e07dd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:20.133116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6793ecf-fa8e-45fa-a49d-d43b4c7e07dd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:20.133621 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6793ecf-fa8e-45fa-a49d-d43b4c7e07dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:20.162733 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a6793ecf-fa8e-45fa-a49d-d43b4c7e07dd None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:20.164366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a6793ecf-fa8e-45fa-a49d-d43b4c7e07dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:20.198888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c03f4-2ef4-4b99-aeec-5a9b5da782db None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:20.209461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:20.235610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37187215-15c9-4900-bda3-1e36ac318ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:20.236265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37187215-15c9-4900-bda3-1e36ac318ff1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:20.236543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37187215-15c9-4900-bda3-1e36ac318ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:20.236817 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37187215-15c9-4900-bda3-1e36ac318ff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:20.247781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37187215-15c9-4900-bda3-1e36ac318ff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:20.249271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37187215-15c9-4900-bda3-1e36ac318ff1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-37187215-15c9-4900-bda3-1e36ac318ff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:20.268173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:20.269099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:20.269984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:20.269984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:20.269984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:20.269984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:20.274108 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 271/547] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:20.277727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37187215-15c9-4900-bda3-1e36ac318ff1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:20.291486 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:20.350450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 277/548] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:32:20.381544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6793ecf-fa8e-45fa-a49d-d43b4c7e07dd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:20.403535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37187215-15c9-4900-bda3-1e36ac318ff1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:20.441751 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1896e-9d64-4b8f-9592-0b85deaf3cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:20.442304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1896e-9d64-4b8f-9592-0b85deaf3cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:20.442584 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1896e-9d64-4b8f-9592-0b85deaf3cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:20.442854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1896e-9d64-4b8f-9592-0b85deaf3cc1 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:20.443556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1896e-9d64-4b8f-9592-0b85deaf3cc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:20.443859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1896e-9d64-4b8f-9592-0b85deaf3cc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:20.445240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1896e-9d64-4b8f-9592-0b85deaf3cc1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:20.461675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 272/549] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:20.463962 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1896e-9d64-4b8f-9592-0b85deaf3cc1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:20.537867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:20.577417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1896e-9d64-4b8f-9592-0b85deaf3cc1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:20.615572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f0385-9836-424d-9b98-6ce659dee639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:20.621310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f0385-9836-424d-9b98-6ce659dee639 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:20.621310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f0385-9836-424d-9b98-6ce659dee639 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:20.621310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f0385-9836-424d-9b98-6ce659dee639 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:20.630024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f0385-9836-424d-9b98-6ce659dee639 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:20.637393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f0385-9836-424d-9b98-6ce659dee639 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:20.637533 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6793ecf-fa8e-45fa-a49d-d43b4c7e07dd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-4c0f0385-9836-424d-9b98-6ce659dee639 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:20.659385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:20.660779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:20.662240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:20.662240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:20.662240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:20.662240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:20.662240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:20.662240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:20.662240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:20.662240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:20.662240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 02:32:20.662240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:20.665302 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 273/550] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:20.667164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f0385-9836-424d-9b98-6ce659dee639 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:20.746175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921fe4b-54f6-4f88-b938-8f06fdd6d011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:20.746769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921fe4b-54f6-4f88-b938-8f06fdd6d011 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:20.748499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921fe4b-54f6-4f88-b938-8f06fdd6d011 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:20.748499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921fe4b-54f6-4f88-b938-8f06fdd6d011 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:20.767856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921fe4b-54f6-4f88-b938-8f06fdd6d011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0921fe4b-54f6-4f88-b938-8f06fdd6d011 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:20.781011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:20.781974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:20.782787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:20.782787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:20.782787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:20.782787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:20.782787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:20.782787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:20.782787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:20.782787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:20.782787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:20.782787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:20.782787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:20.782787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:20.782787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 278/551] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:20.789996 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921fe4b-54f6-4f88-b938-8f06fdd6d011 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:20.809435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f0385-9836-424d-9b98-6ce659dee639 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:20.836552 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:20.849655 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:20.864170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6685ef5-a6f4-46e5-b9c4-b1362a328227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:20.867652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6685ef5-a6f4-46e5-b9c4-b1362a328227 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:20.869012 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6685ef5-a6f4-46e5-b9c4-b1362a328227 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:20.871853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6685ef5-a6f4-46e5-b9c4-b1362a328227 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:20.873234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6685ef5-a6f4-46e5-b9c4-b1362a328227 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:20.873970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6685ef5-a6f4-46e5-b9c4-b1362a328227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:20.878050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6685ef5-a6f4-46e5-b9c4-b1362a328227 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:20.919060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 274/552] 10.222.0.39 () {56 vars in 1135 bytes} [Tue Jul 26 02:32:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:20.923937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6685ef5-a6f4-46e5-b9c4-b1362a328227 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:21.033125 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921fe4b-54f6-4f88-b938-8f06fdd6d011 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:21.101327 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cec843-c50b-41d2-b3d5-f8b9827fb711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:21.102723 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cec843-c50b-41d2-b3d5-f8b9827fb711 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:21.103217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cec843-c50b-41d2-b3d5-f8b9827fb711 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:21.103755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cec843-c50b-41d2-b3d5-f8b9827fb711 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:21.104666 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cec843-c50b-41d2-b3d5-f8b9827fb711 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:21.106173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cec843-c50b-41d2-b3d5-f8b9827fb711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:21.108942 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cec843-c50b-41d2-b3d5-f8b9827fb711 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:21.113906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6685ef5-a6f4-46e5-b9c4-b1362a328227 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:21.129747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 279/553] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:21.134993 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cec843-c50b-41d2-b3d5-f8b9827fb711 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:21.186521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a681d73-3318-4458-86a7-0784ddf8df3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:21.188702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a681d73-3318-4458-86a7-0784ddf8df3d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:21.190402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a681d73-3318-4458-86a7-0784ddf8df3d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:21.190880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a681d73-3318-4458-86a7-0784ddf8df3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:21.255867 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:21.296872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cec843-c50b-41d2-b3d5-f8b9827fb711 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:21.300226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:21.330612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a681d73-3318-4458-86a7-0784ddf8df3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:21.332905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a681d73-3318-4458-86a7-0784ddf8df3d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:21.346312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429421ec-8f1d-444c-a994-6e6ba316fcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:21.347761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429421ec-8f1d-444c-a994-6e6ba316fcec None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:21.348637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429421ec-8f1d-444c-a994-6e6ba316fcec None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:21.349128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429421ec-8f1d-444c-a994-6e6ba316fcec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:21.374766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429421ec-8f1d-444c-a994-6e6ba316fcec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:21.377438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429421ec-8f1d-444c-a994-6e6ba316fcec None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-429421ec-8f1d-444c-a994-6e6ba316fcec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:21.407537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:21.408483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:21.409380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:21.409380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:21.409380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:21.409380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:21.416413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 280/554] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:21.421964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429421ec-8f1d-444c-a994-6e6ba316fcec None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:21.505351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 275/555] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:21.507290 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a681d73-3318-4458-86a7-0784ddf8df3d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:21.624481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429421ec-8f1d-444c-a994-6e6ba316fcec None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:21.654475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:21.660882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:21.673909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a681d73-3318-4458-86a7-0784ddf8df3d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:21.686819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb8b45-b8d2-4496-a9f5-4af014e6112f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:21.687466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb8b45-b8d2-4496-a9f5-4af014e6112f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:21.687747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb8b45-b8d2-4496-a9f5-4af014e6112f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:21.688013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb8b45-b8d2-4496-a9f5-4af014e6112f None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:21.688717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb8b45-b8d2-4496-a9f5-4af014e6112f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:21.689017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb8b45-b8d2-4496-a9f5-4af014e6112f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:21.690420 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb8b45-b8d2-4496-a9f5-4af014e6112f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:21.712949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b4947-71e0-43b4-bbc2-2e17ced8599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:21.713638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b4947-71e0-43b4-bbc2-2e17ced8599f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:21.713917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b4947-71e0-43b4-bbc2-2e17ced8599f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:21.714236 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b4947-71e0-43b4-bbc2-2e17ced8599f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:21.716937 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 281/556] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:21.726288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb8b45-b8d2-4496-a9f5-4af014e6112f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:21.726480 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b4947-71e0-43b4-bbc2-2e17ced8599f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:21.728413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b4947-71e0-43b4-bbc2-2e17ced8599f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-f81b4947-71e0-43b4-bbc2-2e17ced8599f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:21.744156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:21.745580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:21.746586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:21.746586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:21.746586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:21.746586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:21.749426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 276/557] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:21.751506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b4947-71e0-43b4-bbc2-2e17ced8599f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:21.858381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b4947-71e0-43b4-bbc2-2e17ced8599f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:21.883499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb8b45-b8d2-4496-a9f5-4af014e6112f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:21.893809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ad7d2-924f-4c14-b75f-f7df3a1e86c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:21.894425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ad7d2-924f-4c14-b75f-f7df3a1e86c1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:21.894707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ad7d2-924f-4c14-b75f-f7df3a1e86c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:21.894981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ad7d2-924f-4c14-b75f-f7df3a1e86c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:21.895681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ad7d2-924f-4c14-b75f-f7df3a1e86c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:21.895998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ad7d2-924f-4c14-b75f-f7df3a1e86c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:21.897401 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ad7d2-924f-4c14-b75f-f7df3a1e86c1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:21.899892 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:21.917502 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 277/558] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:21.919489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a4f9e-a195-4a9f-9ce4-f47c328e0182 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:21.919789 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a4f9e-a195-4a9f-9ce4-f47c328e0182 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:21.920063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a4f9e-a195-4a9f-9ce4-f47c328e0182 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:21.925477 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 278/559] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:21.925477 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a4f9e-a195-4a9f-9ce4-f47c328e0182 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:21.927383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f2eaa-ff8c-4c4a-bf5d-6562a50ac907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:21.928286 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f2eaa-ff8c-4c4a-bf5d-6562a50ac907 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:21.928761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f2eaa-ff8c-4c4a-bf5d-6562a50ac907 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:21.929228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f2eaa-ff8c-4c4a-bf5d-6562a50ac907 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:21.937343 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f2eaa-ff8c-4c4a-bf5d-6562a50ac907 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:21.939046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f2eaa-ff8c-4c4a-bf5d-6562a50ac907 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-423f2eaa-ff8c-4c4a-bf5d-6562a50ac907 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:21.951317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:21.952356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:21.953365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:21.953365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:21.953365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:21.953365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:21.953365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:21.953365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:21.953365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:21.953365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:21.953365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:32:21.953365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:21.955886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 282/560] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 02:32:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:21.957246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622cb02-a5b0-4ea7-8a64-d588ad6e6280 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:21.957771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622cb02-a5b0-4ea7-8a64-d588ad6e6280 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:21.958246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622cb02-a5b0-4ea7-8a64-d588ad6e6280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:21.979221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4622cb02-a5b0-4ea7-8a64-d588ad6e6280 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:21.981765 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4622cb02-a5b0-4ea7-8a64-d588ad6e6280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:22.031952 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a4f9e-a195-4a9f-9ce4-f47c328e0182 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:22.040650 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:22.073737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 283/561] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:22.073737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622cb02-a5b0-4ea7-8a64-d588ad6e6280 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:22.076218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80a6d8-ddc7-4339-b5f1-5bbbbc1993ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:22.076936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80a6d8-ddc7-4339-b5f1-5bbbbc1993ee None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.077216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80a6d8-ddc7-4339-b5f1-5bbbbc1993ee None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.077512 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80a6d8-ddc7-4339-b5f1-5bbbbc1993ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.090911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80a6d8-ddc7-4339-b5f1-5bbbbc1993ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:22.092469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80a6d8-ddc7-4339-b5f1-5bbbbc1993ee None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-3a80a6d8-ddc7-4339-b5f1-5bbbbc1993ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:22.109798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:22.110828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:22.111733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:22.111733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:22.111733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:22.111733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:22.111733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:22.111733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:22.111733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:22.111733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:22.118747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 279/562] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:22.118747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80a6d8-ddc7-4339-b5f1-5bbbbc1993ee None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:22.177758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:22.197748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622cb02-a5b0-4ea7-8a64-d588ad6e6280 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:22.225774 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80a6d8-ddc7-4339-b5f1-5bbbbc1993ee None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:22.234289 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfabd8-d689-4701-b965-69d4cda535ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:22.234911 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfabd8-d689-4701-b965-69d4cda535ab None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.235188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfabd8-d689-4701-b965-69d4cda535ab None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.235453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfabd8-d689-4701-b965-69d4cda535ab None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.236259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfabd8-d689-4701-b965-69d4cda535ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:22.236563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfabd8-d689-4701-b965-69d4cda535ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:22.238061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfabd8-d689-4701-b965-69d4cda535ab None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:22.256245 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 284/563] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 02:32:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:22.256245 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfabd8-d689-4701-b965-69d4cda535ab None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:22.263891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d703ee-f6ce-4525-acfd-11bb027fb09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:22.264722 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d703ee-f6ce-4525-acfd-11bb027fb09a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.265145 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d703ee-f6ce-4525-acfd-11bb027fb09a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.265641 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d703ee-f6ce-4525-acfd-11bb027fb09a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.276447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d703ee-f6ce-4525-acfd-11bb027fb09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-f2d703ee-f6ce-4525-acfd-11bb027fb09a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:22.282125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:22.283070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:22.283891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:22.283891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:22.283891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:22.283891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:22.283891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:22.283891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:22.283891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:22.283891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:22.283891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:22.283891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:22.283891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:22.283891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:22.283891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 280/564] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:22.284588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a25f5f-6e64-4283-9688-3a0e687c8666 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.284999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a25f5f-6e64-4283-9688-3a0e687c8666 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.285089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a25f5f-6e64-4283-9688-3a0e687c8666 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.287045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 281/565] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:22.287814 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a25f5f-6e64-4283-9688-3a0e687c8666 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:22.305977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:22.365550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfabd8-d689-4701-b965-69d4cda535ab None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:22.391990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a25f5f-6e64-4283-9688-3a0e687c8666 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:22.398372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8375cfb2-a26f-477a-9bb5-ee6aeb26b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:22.398991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375cfb2-a26f-477a-9bb5-ee6aeb26b891 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.399253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375cfb2-a26f-477a-9bb5-ee6aeb26b891 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.399522 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375cfb2-a26f-477a-9bb5-ee6aeb26b891 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.400273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375cfb2-a26f-477a-9bb5-ee6aeb26b891 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:22.400576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375cfb2-a26f-477a-9bb5-ee6aeb26b891 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:22.402034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8375cfb2-a26f-477a-9bb5-ee6aeb26b891 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:22.408346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:22.414014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 285/566] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:22.415202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018b4e8-bbd9-4618-a4d1-1d7402014369 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.415484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018b4e8-bbd9-4618-a4d1-1d7402014369 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.415755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018b4e8-bbd9-4618-a4d1-1d7402014369 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.417068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 286/567] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:22.417650 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018b4e8-bbd9-4618-a4d1-1d7402014369 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:22.431892 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa096e8-e634-4852-a073-da3b30229a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:22.432476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa096e8-e634-4852-a073-da3b30229a92 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.432765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa096e8-e634-4852-a073-da3b30229a92 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.433038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa096e8-e634-4852-a073-da3b30229a92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.443825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa096e8-e634-4852-a073-da3b30229a92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:22.445271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa096e8-e634-4852-a073-da3b30229a92 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-faa096e8-e634-4852-a073-da3b30229a92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:22.461615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:22.462600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:22.463482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:22.463482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:22.463482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:22.463482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:22.463482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 282/568] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:22.464287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882c06e-3130-48c6-95aa-860beceb04f9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.464287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882c06e-3130-48c6-95aa-860beceb04f9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.464530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882c06e-3130-48c6-95aa-860beceb04f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.482970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f882c06e-3130-48c6-95aa-860beceb04f9 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:22.484187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f882c06e-3130-48c6-95aa-860beceb04f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:22.512694 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:22.517982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018b4e8-bbd9-4618-a4d1-1d7402014369 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:22.556041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 283/569] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:22.556041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882c06e-3130-48c6-95aa-860beceb04f9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:22.557800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdb2b3-1090-437b-9c88-ca44438d964e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:22.558470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdb2b3-1090-437b-9c88-ca44438d964e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.558798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdb2b3-1090-437b-9c88-ca44438d964e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.559065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdb2b3-1090-437b-9c88-ca44438d964e None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.559804 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdb2b3-1090-437b-9c88-ca44438d964e None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:22.560105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdb2b3-1090-437b-9c88-ca44438d964e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:22.561479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdb2b3-1090-437b-9c88-ca44438d964e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:22.569812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 287/570] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:22.570811 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2506d-39f3-4e2e-9df8-45b38fe196b3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.571094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2506d-39f3-4e2e-9df8-45b38fe196b3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.571364 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2506d-39f3-4e2e-9df8-45b38fe196b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.589386 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-58d2506d-39f3-4e2e-9df8-45b38fe196b3 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:22.590650 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-58d2506d-39f3-4e2e-9df8-45b38fe196b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:22.651553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:22.655577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882c06e-3130-48c6-95aa-860beceb04f9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:22.656919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 288/571] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:22.657784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2506d-39f3-4e2e-9df8-45b38fe196b3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:22.703295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804302a-9f13-485e-9607-fa0427a395e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:22.703866 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804302a-9f13-485e-9607-fa0427a395e4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.704116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804302a-9f13-485e-9607-fa0427a395e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.704415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804302a-9f13-485e-9607-fa0427a395e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.705192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804302a-9f13-485e-9607-fa0427a395e4 None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=f2365526802146088fcaa4afc2e03a35) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:22.705538 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804302a-9f13-485e-9607-fa0427a395e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:22.707016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0804302a-9f13-485e-9607-fa0427a395e4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:22.712424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 284/572] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:22 2022] GET /identity/v3/role_assignments?user.id=f2365526802146088fcaa4afc2e03a35&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:22.713311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804302a-9f13-485e-9607-fa0427a395e4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:22.766981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:22.779448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2506d-39f3-4e2e-9df8-45b38fe196b3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:22.816303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66572572-281f-456c-a5a5-e272bf32b5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:22.816943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66572572-281f-456c-a5a5-e272bf32b5f5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.817222 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66572572-281f-456c-a5a5-e272bf32b5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.817526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66572572-281f-456c-a5a5-e272bf32b5f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.818225 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66572572-281f-456c-a5a5-e272bf32b5f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:22.818537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66572572-281f-456c-a5a5-e272bf32b5f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:22.819943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66572572-281f-456c-a5a5-e272bf32b5f5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:22.828704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804302a-9f13-485e-9607-fa0427a395e4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:22.832383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 289/573] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:22.833347 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66572572-281f-456c-a5a5-e272bf32b5f5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:22.867696 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a74aa4-6519-4615-82f5-c535bbe3e4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:22.868342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a74aa4-6519-4615-82f5-c535bbe3e4a0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.868614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a74aa4-6519-4615-82f5-c535bbe3e4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.868876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a74aa4-6519-4615-82f5-c535bbe3e4a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.880935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a74aa4-6519-4615-82f5-c535bbe3e4a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-18a74aa4-6519-4615-82f5-c535bbe3e4a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:22.885895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:22.887173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 285/574] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:22.888023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a74aa4-6519-4615-82f5-c535bbe3e4a0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:22.915856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:22.958480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66572572-281f-456c-a5a5-e272bf32b5f5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:22.992906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c18a0-c871-4c2c-9865-0daede4a5e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:22.993865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c18a0-c871-4c2c-9865-0daede4a5e1e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:22.994149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c18a0-c871-4c2c-9865-0daede4a5e1e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:22.994419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c18a0-c871-4c2c-9865-0daede4a5e1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:22.995544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a74aa4-6519-4615-82f5-c535bbe3e4a0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:23.005137 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c18a0-c871-4c2c-9865-0daede4a5e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:23.006634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c18a0-c871-4c2c-9865-0daede4a5e1e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b81c18a0-c871-4c2c-9865-0daede4a5e1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:23.020841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:23.021852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:23.022788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:23.022788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:23.022788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:23.022788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:23.022788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 290/575] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:23.023237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c18a0-c871-4c2c-9865-0daede4a5e1e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:23.026035 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:23.041235 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b100cbc-897a-4c92-9b49-6af8d8e820a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:23.041775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b100cbc-897a-4c92-9b49-6af8d8e820a1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:23.041986 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b100cbc-897a-4c92-9b49-6af8d8e820a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:23.042258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b100cbc-897a-4c92-9b49-6af8d8e820a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:23.053759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b100cbc-897a-4c92-9b49-6af8d8e820a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-7b100cbc-897a-4c92-9b49-6af8d8e820a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:23.059436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:23.060371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:23.061208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:23.061208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:23.061208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:23.061208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:23.061208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:23.061208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:23.061208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:23.061208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:23.061208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:23.061208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:23.061208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:23.061208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:23.065692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 286/576] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:23.066562 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b100cbc-897a-4c92-9b49-6af8d8e820a1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:23.122326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c18a0-c871-4c2c-9865-0daede4a5e1e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:23.152930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:23.160487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a35e6-90d3-40ad-a23a-82a0b204a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:23.161127 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a35e6-90d3-40ad-a23a-82a0b204a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:23.161454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a35e6-90d3-40ad-a23a-82a0b204a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:23.161743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a35e6-90d3-40ad-a23a-82a0b204a9c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:23.169068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a35e6-90d3-40ad-a23a-82a0b204a9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:23.170538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a35e6-90d3-40ad-a23a-82a0b204a9c0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:23.176772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b100cbc-897a-4c92-9b49-6af8d8e820a1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-543a35e6-90d3-40ad-a23a-82a0b204a9c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:23.182268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:23.183157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:23.184113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:23.184113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:23.184113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:23.184113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:23.184113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:23.184113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:23.184113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:23.184113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:23.184113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 291/577] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:23.184647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a35e6-90d3-40ad-a23a-82a0b204a9c0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:23.217895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f57b6-e618-4099-8e8f-1615189e48a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:23.218441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f57b6-e618-4099-8e8f-1615189e48a3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:23.218719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f57b6-e618-4099-8e8f-1615189e48a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:23.218991 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f57b6-e618-4099-8e8f-1615189e48a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:23.219709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f57b6-e618-4099-8e8f-1615189e48a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:23.220016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f57b6-e618-4099-8e8f-1615189e48a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:23.221429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f57b6-e618-4099-8e8f-1615189e48a3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:23.234481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 287/578] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:23.234481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f57b6-e618-4099-8e8f-1615189e48a3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:23.252159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:23.291680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a35e6-90d3-40ad-a23a-82a0b204a9c0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:23.330286 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4407515-41f4-479b-b84a-b81cfe083c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:23.330905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4407515-41f4-479b-b84a-b81cfe083c14 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:23.331183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4407515-41f4-479b-b84a-b81cfe083c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:23.331467 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4407515-41f4-479b-b84a-b81cfe083c14 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:23.332136 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4407515-41f4-479b-b84a-b81cfe083c14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:23.332435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4407515-41f4-479b-b84a-b81cfe083c14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:23.333833 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4407515-41f4-479b-b84a-b81cfe083c14 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:23.345754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 292/579] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:23.346216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f57b6-e618-4099-8e8f-1615189e48a3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:23.346544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4407515-41f4-479b-b84a-b81cfe083c14 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:23.383849 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08f282-7981-4a3d-adc7-5c3a40fc143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:23.384474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08f282-7981-4a3d-adc7-5c3a40fc143a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:23.384752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08f282-7981-4a3d-adc7-5c3a40fc143a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:23.385100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08f282-7981-4a3d-adc7-5c3a40fc143a None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:23.385861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08f282-7981-4a3d-adc7-5c3a40fc143a None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:23.386162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08f282-7981-4a3d-adc7-5c3a40fc143a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:23.387566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08f282-7981-4a3d-adc7-5c3a40fc143a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:23.396089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 288/580] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:23.396898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08f282-7981-4a3d-adc7-5c3a40fc143a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:23.410519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:23.460215 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4407515-41f4-479b-b84a-b81cfe083c14 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:23.484175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:23.496269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb20c04-832f-4ec9-a71c-d9c1f642255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:23.496885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb20c04-832f-4ec9-a71c-d9c1f642255f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:23.497158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb20c04-832f-4ec9-a71c-d9c1f642255f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:23.497465 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb20c04-832f-4ec9-a71c-d9c1f642255f None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:23.498232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb20c04-832f-4ec9-a71c-d9c1f642255f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:23.498544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb20c04-832f-4ec9-a71c-d9c1f642255f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:23.499982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb20c04-832f-4ec9-a71c-d9c1f642255f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:23.508503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08f282-7981-4a3d-adc7-5c3a40fc143a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:23.512403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 293/581] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:23.513391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb20c04-832f-4ec9-a71c-d9c1f642255f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:23.542413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d93e4-3910-41e7-8f07-33a7706fd74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:23.543108 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d93e4-3910-41e7-8f07-33a7706fd74a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:23.543388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d93e4-3910-41e7-8f07-33a7706fd74a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:23.543659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d93e4-3910-41e7-8f07-33a7706fd74a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:23.554857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d93e4-3910-41e7-8f07-33a7706fd74a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:23.556325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d93e4-3910-41e7-8f07-33a7706fd74a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a40d93e4-3910-41e7-8f07-33a7706fd74a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:23.571069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:23.572082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:23.573490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:23.573490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:23.573490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:23.573490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:23.573490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 289/582] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:23.573490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d93e4-3910-41e7-8f07-33a7706fd74a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:23.627912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb20c04-832f-4ec9-a71c-d9c1f642255f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:23.634067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:23.671061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fb5d4-6c7b-43bf-9d61-8b1353c76b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:23.671801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fb5d4-6c7b-43bf-9d61-8b1353c76b3d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:23.672143 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fb5d4-6c7b-43bf-9d61-8b1353c76b3d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:23.672477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fb5d4-6c7b-43bf-9d61-8b1353c76b3d None admin] PATH_INFO: `/v3/users/glance` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:23.677860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d93e4-3910-41e7-8f07-33a7706fd74a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:23.681827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fb5d4-6c7b-43bf-9d61-8b1353c76b3d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:23.683367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fb5d4-6c7b-43bf-9d61-8b1353c76b3d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c10fb5d4-6c7b-43bf-9d61-8b1353c76b3d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:23.695007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:23.695999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:23.696980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:23.696980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:23.696980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:23.696980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:23.696980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:23.696980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:23.696980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:23.696980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:23.696980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 02:32:23.696980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:23.696980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 294/583] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:23.696980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fb5d4-6c7b-43bf-9d61-8b1353c76b3d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:23.720701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7a753-7980-4d98-9bc9-9e6686ddd3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:23.721691 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7a753-7980-4d98-9bc9-9e6686ddd3bd None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:23.722187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7a753-7980-4d98-9bc9-9e6686ddd3bd None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:23.722597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7a753-7980-4d98-9bc9-9e6686ddd3bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:23.736401 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7a753-7980-4d98-9bc9-9e6686ddd3bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:23.738860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7a753-7980-4d98-9bc9-9e6686ddd3bd None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:23.746767 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-78c7a753-7980-4d98-9bc9-9e6686ddd3bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:23.754975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:23.755958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:23.757017 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:23.757017 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:23.757017 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:23.757017 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:23.758643 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 290/584] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:23.759563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7a753-7980-4d98-9bc9-9e6686ddd3bd None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:23.814850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fb5d4-6c7b-43bf-9d61-8b1353c76b3d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:23.849990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd913594-0567-41c4-8607-24718d4a0714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:23.850827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd913594-0567-41c4-8607-24718d4a0714 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:23.851202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd913594-0567-41c4-8607-24718d4a0714 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:23.851567 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd913594-0567-41c4-8607-24718d4a0714 None admin] PATH_INFO: `/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/338b2744014940ca96c08d4e9262697b/roles/4afb03ef7ba64a1fabaf9b59249d9a15` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:23.866247 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd913594-0567-41c4-8607-24718d4a0714 None admin] RBAC: Authorizing `identity:create_grant(project_id=b017927d64b44db8a1611f20e6e3b6f5, user_id=338b2744014940ca96c08d4e9262697b, role_id=4afb03ef7ba64a1fabaf9b59249d9a15)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:23.867867 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd913594-0567-41c4-8607-24718d4a0714 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:23.871030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7a753-7980-4d98-9bc9-9e6686ddd3bd None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:23.893318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 295/585] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:32:23 2022] PUT /identity/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/338b2744014940ca96c08d4e9262697b/roles/4afb03ef7ba64a1fabaf9b59249d9a15 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:32:23.893318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd913594-0567-41c4-8607-24718d4a0714 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:23.895121 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:23.923177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb444752-6ada-4308-9c75-bf79d7a0a84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:23.923926 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb444752-6ada-4308-9c75-bf79d7a0a84a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:23.924381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb444752-6ada-4308-9c75-bf79d7a0a84a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:23.924766 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb444752-6ada-4308-9c75-bf79d7a0a84a None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:23.925683 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb444752-6ada-4308-9c75-bf79d7a0a84a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:23.926053 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb444752-6ada-4308-9c75-bf79d7a0a84a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:23.927687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb444752-6ada-4308-9c75-bf79d7a0a84a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:23.946759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 291/586] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:23.947969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb444752-6ada-4308-9c75-bf79d7a0a84a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:23.993933 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:24.009022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd913594-0567-41c4-8607-24718d4a0714 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:24.055528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e568b39-80ab-4999-a3cf-c68a13383190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:24.056876 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e568b39-80ab-4999-a3cf-c68a13383190 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:24.057306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e568b39-80ab-4999-a3cf-c68a13383190 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:24.058039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e568b39-80ab-4999-a3cf-c68a13383190 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:24.058995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e568b39-80ab-4999-a3cf-c68a13383190 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:24.059532 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e568b39-80ab-4999-a3cf-c68a13383190 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:24.061768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e568b39-80ab-4999-a3cf-c68a13383190 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:24.070236 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb444752-6ada-4308-9c75-bf79d7a0a84a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:24.088046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 296/587] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Jul 26 02:32:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:24.089193 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e568b39-80ab-4999-a3cf-c68a13383190 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:24.123817 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92271f5-9cf9-43a9-9e4d-528c62ff0c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:24.124448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92271f5-9cf9-43a9-9e4d-528c62ff0c26 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:24.124729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92271f5-9cf9-43a9-9e4d-528c62ff0c26 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:24.125001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92271f5-9cf9-43a9-9e4d-528c62ff0c26 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:24.125732 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92271f5-9cf9-43a9-9e4d-528c62ff0c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:24.126036 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92271f5-9cf9-43a9-9e4d-528c62ff0c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:24.127421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92271f5-9cf9-43a9-9e4d-528c62ff0c26 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:24.145748 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 292/588] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:24.146717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92271f5-9cf9-43a9-9e4d-528c62ff0c26 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:24.178639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:24.214089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e568b39-80ab-4999-a3cf-c68a13383190 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:24.261051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73fc0-cd92-4220-b70b-7f28496815b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:24.262336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73fc0-cd92-4220-b70b-7f28496815b1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:24.262790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73fc0-cd92-4220-b70b-7f28496815b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:24.263228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73fc0-cd92-4220-b70b-7f28496815b1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:24.263550 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92271f5-9cf9-43a9-9e4d-528c62ff0c26 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:24.273572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a73fc0-cd92-4220-b70b-7f28496815b1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:24.275932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a73fc0-cd92-4220-b70b-7f28496815b1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a7a73fc0-cd92-4220-b70b-7f28496815b1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:24.293262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:24.294686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:24.295608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:24.295608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:24.295608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:24.295608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:24.295608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:24.295608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:24.295608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:24.295608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:24.295608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 02:32:24.295608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:24.298615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 297/589] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:24.299655 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73fc0-cd92-4220-b70b-7f28496815b1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:24.306923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc41d27-530a-448f-9635-f946f274f03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:24.307587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc41d27-530a-448f-9635-f946f274f03e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:24.307868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc41d27-530a-448f-9635-f946f274f03e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:24.308139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc41d27-530a-448f-9635-f946f274f03e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:24.314820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:24.320183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc41d27-530a-448f-9635-f946f274f03e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:24.321704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc41d27-530a-448f-9635-f946f274f03e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-ecc41d27-530a-448f-9635-f946f274f03e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:24.338747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:24.339943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:24.341000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:24.341000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:24.341000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:24.341000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:24.342809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 293/590] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:24.343922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc41d27-530a-448f-9635-f946f274f03e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:24.431711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73fc0-cd92-4220-b70b-7f28496815b1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:24.434569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:24.454123 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc41d27-530a-448f-9635-f946f274f03e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:24.472535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b342bbd-dbc8-4e54-932a-51929663bb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:24.473186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342bbd-dbc8-4e54-932a-51929663bb8d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:24.473496 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342bbd-dbc8-4e54-932a-51929663bb8d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:24.473768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342bbd-dbc8-4e54-932a-51929663bb8d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:24.486974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b342bbd-dbc8-4e54-932a-51929663bb8d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:24.488632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b342bbd-dbc8-4e54-932a-51929663bb8d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:24.498588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e0b37-8194-480b-b444-ee328fe4ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:24.499531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e0b37-8194-480b-b444-ee328fe4ff87 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:24.500027 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e0b37-8194-480b-b444-ee328fe4ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:24.500504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e0b37-8194-480b-b444-ee328fe4ff87 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:24.501531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e0b37-8194-480b-b444-ee328fe4ff87 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-1b342bbd-dbc8-4e54-932a-51929663bb8d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:24.501638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:24.502503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:24.504150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:24.504150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:24.504150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:24.504150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:24.504150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:24.504150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:24.504150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:24.504150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:24.504150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 02:32:24.504150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:24.504150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 298/591] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:24.504150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b342bbd-dbc8-4e54-932a-51929663bb8d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:24.505399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e0b37-8194-480b-b444-ee328fe4ff87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:24.507333 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e0b37-8194-480b-b444-ee328fe4ff87 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:24.532132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 294/592] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Jul 26 02:32:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:24.532132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e0b37-8194-480b-b444-ee328fe4ff87 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:24.592848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:24.632405 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b342bbd-dbc8-4e54-932a-51929663bb8d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:24.641021 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e0b37-8194-480b-b444-ee328fe4ff87 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:24.667989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71652e9-ede1-4996-a2d4-2bd188157406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:24.668725 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71652e9-ede1-4996-a2d4-2bd188157406 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:24.669077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71652e9-ede1-4996-a2d4-2bd188157406 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:24.669623 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71652e9-ede1-4996-a2d4-2bd188157406 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:24.670274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71652e9-ede1-4996-a2d4-2bd188157406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:24.670687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71652e9-ede1-4996-a2d4-2bd188157406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:24.672262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71652e9-ede1-4996-a2d4-2bd188157406 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:24.678194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02d615-aa24-4f00-8472-9611de0a4897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:24.679050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02d615-aa24-4f00-8472-9611de0a4897 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:24.679506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02d615-aa24-4f00-8472-9611de0a4897 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:24.679949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02d615-aa24-4f00-8472-9611de0a4897 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:24.680945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02d615-aa24-4f00-8472-9611de0a4897 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:24.681469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02d615-aa24-4f00-8472-9611de0a4897 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:24.683076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02d615-aa24-4f00-8472-9611de0a4897 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:24.692954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 299/593] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:24.692954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71652e9-ede1-4996-a2d4-2bd188157406 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:24.698135 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:24.709358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 295/594] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Jul 26 02:32:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:24.709358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf43a6-14db-4ae2-a4c7-125a7a069a5c None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:24.709358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf43a6-14db-4ae2-a4c7-125a7a069a5c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:24.709640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf43a6-14db-4ae2-a4c7-125a7a069a5c None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:24.710867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 296/595] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:24.711572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf43a6-14db-4ae2-a4c7-125a7a069a5c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:24.796942 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71652e9-ede1-4996-a2d4-2bd188157406 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:24.815475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf43a6-14db-4ae2-a4c7-125a7a069a5c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:24.827312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:24.833703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ea0a0-c271-4b68-afed-6983e1d40d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:24.834448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ea0a0-c271-4b68-afed-6983e1d40d82 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:24.834627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ea0a0-c271-4b68-afed-6983e1d40d82 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:24.834884 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ea0a0-c271-4b68-afed-6983e1d40d82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:24.845930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ea0a0-c271-4b68-afed-6983e1d40d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:24.847383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ea0a0-c271-4b68-afed-6983e1d40d82 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:24.851812 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097927c3-96b4-4fe2-bedf-42a185c8ac48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:24.852820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097927c3-96b4-4fe2-bedf-42a185c8ac48 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:24.853099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097927c3-96b4-4fe2-bedf-42a185c8ac48 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:24.853394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097927c3-96b4-4fe2-bedf-42a185c8ac48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:24.861117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097927c3-96b4-4fe2-bedf-42a185c8ac48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:24.862583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097927c3-96b4-4fe2-bedf-42a185c8ac48 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-af0ea0a0-c271-4b68-afed-6983e1d40d82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:24.863479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:24.864332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:24.865220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:24.865220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:24.865220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:24.865220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:24.865220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 300/596] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:24.866070 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ea0a0-c271-4b68-afed-6983e1d40d82 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-097927c3-96b4-4fe2-bedf-42a185c8ac48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:24.879362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:24.880252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:24.881193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:24.881193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:24.881193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:24.881193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:24.881193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:24.881193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:24.881193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:24.881193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:24.881193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 297/597] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:24.881729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c272457-ed7d-4db8-b661-d07d484e14d7 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:24.882424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c272457-ed7d-4db8-b661-d07d484e14d7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:24.882424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c272457-ed7d-4db8-b661-d07d484e14d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:24.903137 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3c272457-ed7d-4db8-b661-d07d484e14d7 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:24.904633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3c272457-ed7d-4db8-b661-d07d484e14d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:24.960418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:24.972219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ea0a0-c271-4b68-afed-6983e1d40d82 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:24.974994 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 298/598] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:24.976009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c272457-ed7d-4db8-b661-d07d484e14d7 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:25.026079 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b920fc0-26c6-451d-9aaa-2e94e768e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:25.027401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b920fc0-26c6-451d-9aaa-2e94e768e256 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:25.028321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b920fc0-26c6-451d-9aaa-2e94e768e256 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:25.028939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b920fc0-26c6-451d-9aaa-2e94e768e256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:25.040063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b920fc0-26c6-451d-9aaa-2e94e768e256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:25.041546 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b920fc0-26c6-451d-9aaa-2e94e768e256 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6b920fc0-26c6-451d-9aaa-2e94e768e256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:25.056188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:25.057516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:25.058469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:25.058469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:25.058469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:25.058469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:25.058469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 301/599] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:25.058469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b920fc0-26c6-451d-9aaa-2e94e768e256 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:25.088600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c272457-ed7d-4db8-b661-d07d484e14d7 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:25.093469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:25.125536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8cf03-8e5c-47bc-bc66-59ec48ecfa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:25.126158 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8cf03-8e5c-47bc-bc66-59ec48ecfa54 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:25.126432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8cf03-8e5c-47bc-bc66-59ec48ecfa54 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:25.126698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8cf03-8e5c-47bc-bc66-59ec48ecfa54 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:25.127387 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8cf03-8e5c-47bc-bc66-59ec48ecfa54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:25.127684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8cf03-8e5c-47bc-bc66-59ec48ecfa54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:25.129068 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8cf03-8e5c-47bc-bc66-59ec48ecfa54 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:25.146113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 299/600] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:25.146113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8cf03-8e5c-47bc-bc66-59ec48ecfa54 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:25.171963 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b920fc0-26c6-451d-9aaa-2e94e768e256 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:25.192814 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:25.209385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9acc3-59c1-4955-b610-9b977554fa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:25.210015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9acc3-59c1-4955-b610-9b977554fa25 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:25.210296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9acc3-59c1-4955-b610-9b977554fa25 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:25.210571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d9acc3-59c1-4955-b610-9b977554fa25 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:25.211320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9acc3-59c1-4955-b610-9b977554fa25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:25.211627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9acc3-59c1-4955-b610-9b977554fa25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:25.213060 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d9acc3-59c1-4955-b610-9b977554fa25 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:25.226613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 302/601] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:25.227859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9acc3-59c1-4955-b610-9b977554fa25 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:25.250350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8cf03-8e5c-47bc-bc66-59ec48ecfa54 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:25.283776 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3150d0-aeab-482d-9736-87200f86da0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:25.284417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3150d0-aeab-482d-9736-87200f86da0c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:25.284696 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3150d0-aeab-482d-9736-87200f86da0c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:25.284966 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3150d0-aeab-482d-9736-87200f86da0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:25.295794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3150d0-aeab-482d-9736-87200f86da0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-ad3150d0-aeab-482d-9736-87200f86da0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:25.301189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:25.302339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 300/602] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:25.303179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3150d0-aeab-482d-9736-87200f86da0c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:25.328616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:25.336918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d9acc3-59c1-4955-b610-9b977554fa25 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:25.379112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ffd23-8679-4a95-89d1-812a731a4c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:25.379729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ffd23-8679-4a95-89d1-812a731a4c73 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:25.380003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ffd23-8679-4a95-89d1-812a731a4c73 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:25.380269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ffd23-8679-4a95-89d1-812a731a4c73 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:25.380951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ffd23-8679-4a95-89d1-812a731a4c73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:25.381245 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ffd23-8679-4a95-89d1-812a731a4c73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:25.382657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ffd23-8679-4a95-89d1-812a731a4c73 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:25.399537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 303/603] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:25.399537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ffd23-8679-4a95-89d1-812a731a4c73 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:25.413018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3150d0-aeab-482d-9736-87200f86da0c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:25.423681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:25.452145 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496afd-8b43-43d8-80d7-9117112be03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:25.452795 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496afd-8b43-43d8-80d7-9117112be03a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:25.453077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496afd-8b43-43d8-80d7-9117112be03a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:25.453384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496afd-8b43-43d8-80d7-9117112be03a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:25.461150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce496afd-8b43-43d8-80d7-9117112be03a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:25.462658 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce496afd-8b43-43d8-80d7-9117112be03a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-ce496afd-8b43-43d8-80d7-9117112be03a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:25.474911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:25.475811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:25.476688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:25.476688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:25.476688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:25.476688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:25.476688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:25.476688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:25.476688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:25.476688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:25.476688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 301/604] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:25.478158 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496afd-8b43-43d8-80d7-9117112be03a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:25.503357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ffd23-8679-4a95-89d1-812a731a4c73 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:25.541896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3639451-e498-4c59-b3a3-1d5fe4d9ea55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:25.542713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3639451-e498-4c59-b3a3-1d5fe4d9ea55 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:25.542997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3639451-e498-4c59-b3a3-1d5fe4d9ea55 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:25.543273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3639451-e498-4c59-b3a3-1d5fe4d9ea55 None admin] PATH_INFO: `/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/2402339784b34d98a4670db912617331/roles/4afb03ef7ba64a1fabaf9b59249d9a15` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:25.558142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3639451-e498-4c59-b3a3-1d5fe4d9ea55 None admin] RBAC: Authorizing `identity:create_grant(project_id=b017927d64b44db8a1611f20e6e3b6f5, user_id=2402339784b34d98a4670db912617331, role_id=4afb03ef7ba64a1fabaf9b59249d9a15)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:25.559755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3639451-e498-4c59-b3a3-1d5fe4d9ea55 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:25.573525 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 304/605] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:32:25 2022] PUT /identity/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/2402339784b34d98a4670db912617331/roles/4afb03ef7ba64a1fabaf9b59249d9a15 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:32:25.574111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3639451-e498-4c59-b3a3-1d5fe4d9ea55 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:25.577481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:25.599819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496afd-8b43-43d8-80d7-9117112be03a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:25.661130 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b1397-d051-4403-a319-fb9b3751ef91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:25.663331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b1397-d051-4403-a319-fb9b3751ef91 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:25.663893 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b1397-d051-4403-a319-fb9b3751ef91 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:25.664343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b1397-d051-4403-a319-fb9b3751ef91 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:25.665736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b1397-d051-4403-a319-fb9b3751ef91 None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:25.666271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b1397-d051-4403-a319-fb9b3751ef91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:25.668966 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b1397-d051-4403-a319-fb9b3751ef91 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:25.682184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 302/606] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:25.683761 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b1397-d051-4403-a319-fb9b3751ef91 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:25.704096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3639451-e498-4c59-b3a3-1d5fe4d9ea55 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:25.730789 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:25.752689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a5a7e-7819-41a9-b1ff-a1fbf8473c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:25.753533 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a5a7e-7819-41a9-b1ff-a1fbf8473c3d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:25.753951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a5a7e-7819-41a9-b1ff-a1fbf8473c3d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:25.754227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a5a7e-7819-41a9-b1ff-a1fbf8473c3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:25.761491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a5a7e-7819-41a9-b1ff-a1fbf8473c3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:25.762944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a5a7e-7819-41a9-b1ff-a1fbf8473c3d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-388a5a7e-7819-41a9-b1ff-a1fbf8473c3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:25.775397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:25.776297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:25.777228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:25.777228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:25.777228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:25.777228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:25.777228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:25.777228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:25.777228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:25.777228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:25.781395 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 305/607] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:25.782427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a5a7e-7819-41a9-b1ff-a1fbf8473c3d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:25.815859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b1397-d051-4403-a319-fb9b3751ef91 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:25.849551 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:25.858714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc8040-44a6-4083-8031-cd4159a7bdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:25.859800 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc8040-44a6-4083-8031-cd4159a7bdec None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:25.860280 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc8040-44a6-4083-8031-cd4159a7bdec None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:25.860748 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc8040-44a6-4083-8031-cd4159a7bdec None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:25.861748 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc8040-44a6-4083-8031-cd4159a7bdec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:25.862290 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc8040-44a6-4083-8031-cd4159a7bdec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:25.864064 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc8040-44a6-4083-8031-cd4159a7bdec None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:25.877167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 303/608] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:25.878366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc8040-44a6-4083-8031-cd4159a7bdec None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:25.889973 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a5a7e-7819-41a9-b1ff-a1fbf8473c3d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:25.926070 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c820db-b5df-497b-8fb4-a47a93411abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:25.926722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c820db-b5df-497b-8fb4-a47a93411abd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:25.927002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c820db-b5df-497b-8fb4-a47a93411abd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:25.927269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c820db-b5df-497b-8fb4-a47a93411abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:25.939100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c820db-b5df-497b-8fb4-a47a93411abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:25.940777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c820db-b5df-497b-8fb4-a47a93411abd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-16c820db-b5df-497b-8fb4-a47a93411abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:25.956717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:25.957676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:25.958561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:25.958561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:25.958561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:25.958561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:25.961425 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 306/609] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:25.962277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c820db-b5df-497b-8fb4-a47a93411abd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:25.980618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:25.991561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc8040-44a6-4083-8031-cd4159a7bdec None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:26.031442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96356c-a5ff-4979-9c5e-6fde49badfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:26.032066 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96356c-a5ff-4979-9c5e-6fde49badfa1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:26.032345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96356c-a5ff-4979-9c5e-6fde49badfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:26.032616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96356c-a5ff-4979-9c5e-6fde49badfa1 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:26.033397 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96356c-a5ff-4979-9c5e-6fde49badfa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:26.033703 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96356c-a5ff-4979-9c5e-6fde49badfa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:26.035141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96356c-a5ff-4979-9c5e-6fde49badfa1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:26.053368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 304/610] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:26.054313 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96356c-a5ff-4979-9c5e-6fde49badfa1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:26.090430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c820db-b5df-497b-8fb4-a47a93411abd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:26.109110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:26.127620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef919c-e37d-4c3c-b056-b0e3160948e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:26.128515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef919c-e37d-4c3c-b056-b0e3160948e4 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:26.128801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef919c-e37d-4c3c-b056-b0e3160948e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:26.129078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef919c-e37d-4c3c-b056-b0e3160948e4 None admin] PATH_INFO: `/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/fe228871a7fd4a9bb15645955ff365c8/roles/4afb03ef7ba64a1fabaf9b59249d9a15` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:26.144037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef919c-e37d-4c3c-b056-b0e3160948e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b017927d64b44db8a1611f20e6e3b6f5, user_id=fe228871a7fd4a9bb15645955ff365c8, role_id=4afb03ef7ba64a1fabaf9b59249d9a15)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:26.145547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef919c-e37d-4c3c-b056-b0e3160948e4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:26.160862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 307/611] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:32:25 2022] PUT /identity/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/fe228871a7fd4a9bb15645955ff365c8/roles/4afb03ef7ba64a1fabaf9b59249d9a15 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:32:26.161871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96356c-a5ff-4979-9c5e-6fde49badfa1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:26.162127 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e747c-1703-4f3a-b16b-a61ba1b4f46e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:26.162413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e747c-1703-4f3a-b16b-a61ba1b4f46e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:26.162687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e747c-1703-4f3a-b16b-a61ba1b4f46e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:26.164260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 308/612] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:26.164966 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e747c-1703-4f3a-b16b-a61ba1b4f46e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:26.212262 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26228647-8e08-46ed-aa92-4f706e0b92d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:26.213327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26228647-8e08-46ed-aa92-4f706e0b92d1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:26.213825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26228647-8e08-46ed-aa92-4f706e0b92d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:26.214290 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26228647-8e08-46ed-aa92-4f706e0b92d1 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:26.215295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26228647-8e08-46ed-aa92-4f706e0b92d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:26.215819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26228647-8e08-46ed-aa92-4f706e0b92d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:26.218319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26228647-8e08-46ed-aa92-4f706e0b92d1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:26.243395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 305/613] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:26.243395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b23e2c-1e03-4cd0-b54b-b74cbbd811ab None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:26.243395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b23e2c-1e03-4cd0-b54b-b74cbbd811ab None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:26.243395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b23e2c-1e03-4cd0-b54b-b74cbbd811ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:26.261837 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-61b23e2c-1e03-4cd0-b54b-b74cbbd811ab None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:26.262752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-61b23e2c-1e03-4cd0-b54b-b74cbbd811ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:26.266136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:26.309510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e747c-1703-4f3a-b16b-a61ba1b4f46e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:26.346221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 306/614] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:26.347980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b23e2c-1e03-4cd0-b54b-b74cbbd811ab None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:26.361469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7e6d5-1982-4b4b-b690-ca22086d2a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:26.362131 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7e6d5-1982-4b4b-b690-ca22086d2a5e None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:26.362344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7e6d5-1982-4b4b-b690-ca22086d2a5e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:26.362613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7e6d5-1982-4b4b-b690-ca22086d2a5e None admin] PATH_INFO: `/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/ba1305d4e5914f1182dc7436a2d53965/roles/4afb03ef7ba64a1fabaf9b59249d9a15` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:26.380502 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7e6d5-1982-4b4b-b690-ca22086d2a5e None admin] RBAC: Authorizing `identity:create_grant(project_id=b017927d64b44db8a1611f20e6e3b6f5, user_id=ba1305d4e5914f1182dc7436a2d53965, role_id=4afb03ef7ba64a1fabaf9b59249d9a15)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:26.381997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7e6d5-1982-4b4b-b690-ca22086d2a5e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:26.398457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 309/615] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:32:26 2022] PUT /identity/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/ba1305d4e5914f1182dc7436a2d53965/roles/4afb03ef7ba64a1fabaf9b59249d9a15 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:32:26.399695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7e6d5-1982-4b4b-b690-ca22086d2a5e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:26.423250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:26.474254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b23e2c-1e03-4cd0-b54b-b74cbbd811ab None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:26.511040 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7e6d5-1982-4b4b-b690-ca22086d2a5e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:26.513992 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba288936-8920-40c6-9576-f44277077064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:26.514998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288936-8920-40c6-9576-f44277077064 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:26.515498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288936-8920-40c6-9576-f44277077064 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:26.515977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba288936-8920-40c6-9576-f44277077064 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:26.524839 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba288936-8920-40c6-9576-f44277077064 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:26.526896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba288936-8920-40c6-9576-f44277077064 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:26.530705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-ba288936-8920-40c6-9576-f44277077064 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:26.551140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:26.552173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:26.553098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:26.553098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:26.553098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:26.553098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:26.553098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:26.553098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:26.553098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:26.553098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:26.553098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 02:32:26.553098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:26.553658 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 307/616] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:26.560908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9ea29-d3b7-4159-80ef-2164602ae07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:26.561616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9ea29-d3b7-4159-80ef-2164602ae07a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:26.561898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9ea29-d3b7-4159-80ef-2164602ae07a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:26.562180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9ea29-d3b7-4159-80ef-2164602ae07a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:26.563749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba288936-8920-40c6-9576-f44277077064 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:26.590101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9ea29-d3b7-4159-80ef-2164602ae07a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-d2d9ea29-d3b7-4159-80ef-2164602ae07a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:26.599044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:26.600039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:26.600865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:26.600865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:26.600865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:26.600865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:26.600865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:26.600865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:26.600865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:26.600865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:26.600865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:26.600865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:26.600865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:26.600865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:26.602786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 310/617] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:26.612201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9ea29-d3b7-4159-80ef-2164602ae07a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:26.720961 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:26.737159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba288936-8920-40c6-9576-f44277077064 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:26.746860 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9ea29-d3b7-4159-80ef-2164602ae07a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:26.775173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2177fa6-573e-459f-8683-d3386ffa6909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:26.775930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2177fa6-573e-459f-8683-d3386ffa6909 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:26.776218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2177fa6-573e-459f-8683-d3386ffa6909 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:26.776488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2177fa6-573e-459f-8683-d3386ffa6909 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:26.777393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2177fa6-573e-459f-8683-d3386ffa6909 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:26.777806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2177fa6-573e-459f-8683-d3386ffa6909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:26.779387 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2177fa6-573e-459f-8683-d3386ffa6909 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:26.784109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2bf1-1098-47b6-84f3-2c3d55042299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:26.784741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2bf1-1098-47b6-84f3-2c3d55042299 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:26.785022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2bf1-1098-47b6-84f3-2c3d55042299 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:26.785310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2bf1-1098-47b6-84f3-2c3d55042299 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:26.786257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2bf1-1098-47b6-84f3-2c3d55042299 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:26.786563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2bf1-1098-47b6-84f3-2c3d55042299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:26.787990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2bf1-1098-47b6-84f3-2c3d55042299 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:26.799671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 311/618] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:26.805723 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2bf1-1098-47b6-84f3-2c3d55042299 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:26.807240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 308/619] 10.222.0.39 () {56 vars in 1135 bytes} [Tue Jul 26 02:32:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:26.815041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2177fa6-573e-459f-8683-d3386ffa6909 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:26.925596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2bf1-1098-47b6-84f3-2c3d55042299 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:26.929660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:26.963421 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d4a3a-2f75-41db-8182-8e4540289e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:26.964379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d4a3a-2f75-41db-8182-8e4540289e32 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:26.964733 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d4a3a-2f75-41db-8182-8e4540289e32 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:26.965009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d4a3a-2f75-41db-8182-8e4540289e32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:26.972900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:26.982820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d4a3a-2f75-41db-8182-8e4540289e32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:26.984312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d4a3a-2f75-41db-8182-8e4540289e32 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:27.008758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2177fa6-573e-459f-8683-d3386ffa6909 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-514d4a3a-2f75-41db-8182-8e4540289e32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:27.015089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:27.017178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:27.019630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:27.019630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:27.019630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:27.019630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:27.019630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 312/620] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:27.030641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d4a3a-2f75-41db-8182-8e4540289e32 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:27.063539 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf0f5c-d96e-4a6a-9251-e563b9722428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:27.064198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf0f5c-d96e-4a6a-9251-e563b9722428 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:27.064482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf0f5c-d96e-4a6a-9251-e563b9722428 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:27.064752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf0f5c-d96e-4a6a-9251-e563b9722428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:27.082461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf0f5c-d96e-4a6a-9251-e563b9722428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:27.086058 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf0f5c-d96e-4a6a-9251-e563b9722428 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-daaf0f5c-d96e-4a6a-9251-e563b9722428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:27.105662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:27.106589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:27.107504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:27.107504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:27.107504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:27.107504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:27.107504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 309/621] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:27.117035 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf0f5c-d96e-4a6a-9251-e563b9722428 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:27.168118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d4a3a-2f75-41db-8182-8e4540289e32 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:27.202357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333224e-c559-47bc-8f9e-c04013c68c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:27.202898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333224e-c559-47bc-8f9e-c04013c68c2d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:27.203180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333224e-c559-47bc-8f9e-c04013c68c2d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:27.203455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333224e-c559-47bc-8f9e-c04013c68c2d None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:27.204237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333224e-c559-47bc-8f9e-c04013c68c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:27.204541 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333224e-c559-47bc-8f9e-c04013c68c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:27.205938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333224e-c559-47bc-8f9e-c04013c68c2d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:27.218464 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 313/622] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:27.226372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333224e-c559-47bc-8f9e-c04013c68c2d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:27.297669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:27.306874 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf0f5c-d96e-4a6a-9251-e563b9722428 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:27.330911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:27.345512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333224e-c559-47bc-8f9e-c04013c68c2d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:27.381535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bd523-0495-4804-96b4-237ca43ba393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:27.382193 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd523-0495-4804-96b4-237ca43ba393 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:27.382449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd523-0495-4804-96b4-237ca43ba393 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:27.382722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bd523-0495-4804-96b4-237ca43ba393 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:27.391528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bd523-0495-4804-96b4-237ca43ba393 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:27.392969 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bd523-0495-4804-96b4-237ca43ba393 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0f5bd523-0495-4804-96b4-237ca43ba393 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:27.405624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:27.406616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:27.407576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:27.407576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:27.407576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:27.407576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:27.407576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:27.407576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:27.407576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:27.407576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:27.407576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:32:27.407576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:27.407576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 314/623] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 02:32:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:27.412491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bd523-0495-4804-96b4-237ca43ba393 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:27.418738 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d02149-cfa0-44b3-ba7a-c3fe2006ec80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:27.419385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d02149-cfa0-44b3-ba7a-c3fe2006ec80 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:27.419665 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d02149-cfa0-44b3-ba7a-c3fe2006ec80 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:27.419938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d02149-cfa0-44b3-ba7a-c3fe2006ec80 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:27.420654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d02149-cfa0-44b3-ba7a-c3fe2006ec80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:27.420957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d02149-cfa0-44b3-ba7a-c3fe2006ec80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:27.427267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d02149-cfa0-44b3-ba7a-c3fe2006ec80 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:27.448120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 310/624] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:27.458302 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d02149-cfa0-44b3-ba7a-c3fe2006ec80 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:27.544331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bd523-0495-4804-96b4-237ca43ba393 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:27.557731 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:27.595296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a86fa-bb7e-4ab7-ba05-f73fe739801b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:27.595921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a86fa-bb7e-4ab7-ba05-f73fe739801b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:27.596197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a86fa-bb7e-4ab7-ba05-f73fe739801b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:27.596464 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a86fa-bb7e-4ab7-ba05-f73fe739801b None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:27.597262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a86fa-bb7e-4ab7-ba05-f73fe739801b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:27.597580 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a86fa-bb7e-4ab7-ba05-f73fe739801b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:27.599021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a86fa-bb7e-4ab7-ba05-f73fe739801b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:27.636165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 315/625] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 02:32:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:27.639494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d02149-cfa0-44b3-ba7a-c3fe2006ec80 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:27.642070 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a86fa-bb7e-4ab7-ba05-f73fe739801b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:27.680730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb17f44-5dc4-42df-9c0e-db80ef713672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:27.681394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb17f44-5dc4-42df-9c0e-db80ef713672 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:27.681670 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb17f44-5dc4-42df-9c0e-db80ef713672 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:27.681933 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb17f44-5dc4-42df-9c0e-db80ef713672 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:27.689094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb17f44-5dc4-42df-9c0e-db80ef713672 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:27.690681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb17f44-5dc4-42df-9c0e-db80ef713672 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-afb17f44-5dc4-42df-9c0e-db80ef713672 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:27.709269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:27.710220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:27.711095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:27.711095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:27.711095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:27.711095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:27.711095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:27.711095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:27.711095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:27.711095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:27.715285 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 311/626] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:27.716731 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb17f44-5dc4-42df-9c0e-db80ef713672 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:27.766193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:27.818775 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a86fa-bb7e-4ab7-ba05-f73fe739801b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:27.869313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec00b9f-dfac-428e-8301-826a6cfd2e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:27.869313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec00b9f-dfac-428e-8301-826a6cfd2e13 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:27.869313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec00b9f-dfac-428e-8301-826a6cfd2e13 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:27.869313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec00b9f-dfac-428e-8301-826a6cfd2e13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:27.916070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb17f44-5dc4-42df-9c0e-db80ef713672 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:27.933804 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:27.971307 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed0232b-ff04-40b9-a9c1-4a679edeccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:27.971844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0232b-ff04-40b9-a9c1-4a679edeccac None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:27.972124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0232b-ff04-40b9-a9c1-4a679edeccac None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:27.972481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed0232b-ff04-40b9-a9c1-4a679edeccac None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:27.973381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0232b-ff04-40b9-a9c1-4a679edeccac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:27.973695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0232b-ff04-40b9-a9c1-4a679edeccac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:27.975146 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed0232b-ff04-40b9-a9c1-4a679edeccac None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:27.980462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec00b9f-dfac-428e-8301-826a6cfd2e13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:27.981970 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec00b9f-dfac-428e-8301-826a6cfd2e13 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:27.993529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 312/627] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:27.994847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ebf46-941f-4c7d-9dec-2da96b990d06 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:27.995137 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ebf46-941f-4c7d-9dec-2da96b990d06 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:27.995411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ebf46-941f-4c7d-9dec-2da96b990d06 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:27.997906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 313/628] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:27.999182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ebf46-941f-4c7d-9dec-2da96b990d06 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:28.096337 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 316/629] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:28.097714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c9721-0199-4f62-9be2-b33efb862002 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:28.098004 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c9721-0199-4f62-9be2-b33efb862002 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:28.098279 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c9721-0199-4f62-9be2-b33efb862002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:28.101795 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:28.113752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ebf46-941f-4c7d-9dec-2da96b990d06 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:28.117751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c95c9721-0199-4f62-9be2-b33efb862002 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:28.118955 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c95c9721-0199-4f62-9be2-b33efb862002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:28.151725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d65b2-d06d-45ab-8b17-cc543eaa7a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:28.152529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d65b2-d06d-45ab-8b17-cc543eaa7a14 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:28.152835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d65b2-d06d-45ab-8b17-cc543eaa7a14 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:28.153125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d65b2-d06d-45ab-8b17-cc543eaa7a14 None admin] PATH_INFO: `/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/f2365526802146088fcaa4afc2e03a35/roles/4afb03ef7ba64a1fabaf9b59249d9a15` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:28.169717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d65b2-d06d-45ab-8b17-cc543eaa7a14 None admin] RBAC: Authorizing `identity:create_grant(project_id=b017927d64b44db8a1611f20e6e3b6f5, user_id=f2365526802146088fcaa4afc2e03a35, role_id=4afb03ef7ba64a1fabaf9b59249d9a15)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:28.172383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d65b2-d06d-45ab-8b17-cc543eaa7a14 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:28.183159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:28.196862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 314/631] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:32:27 2022] PUT /identity/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/f2365526802146088fcaa4afc2e03a35/roles/4afb03ef7ba64a1fabaf9b59249d9a15 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:32:28.197584 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 317/631] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:28.198020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d65b2-d06d-45ab-8b17-cc543eaa7a14 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:28.229358 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c9721-0199-4f62-9be2-b33efb862002 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:28.332247 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d65b2-d06d-45ab-8b17-cc543eaa7a14 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:28.369610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cc537-0757-4054-8810-033dc5ea04b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:28.370270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cc537-0757-4054-8810-033dc5ea04b8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:28.370548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cc537-0757-4054-8810-033dc5ea04b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:28.370909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cc537-0757-4054-8810-033dc5ea04b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:28.381882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cc537-0757-4054-8810-033dc5ea04b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:28.383456 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cc537-0757-4054-8810-033dc5ea04b8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:28.385707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-7c9cc537-0757-4054-8810-033dc5ea04b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:28.400660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:28.402851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:28.405156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:28.405156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:28.405156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:28.405156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:28.405156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 315/632] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:28.408471 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cc537-0757-4054-8810-033dc5ea04b8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:28.410897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c9721-0199-4f62-9be2-b33efb862002 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:28.478087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7e352-384d-4755-b794-97f6ba6cdc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:28.478805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7e352-384d-4755-b794-97f6ba6cdc32 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:28.479086 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7e352-384d-4755-b794-97f6ba6cdc32 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:28.479413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7e352-384d-4755-b794-97f6ba6cdc32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:28.499689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7e352-384d-4755-b794-97f6ba6cdc32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-d2f7e352-384d-4755-b794-97f6ba6cdc32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:28.511288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:28.513495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:28.515493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:28.515493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:28.515493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:28.515493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:28.515493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:28.515493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:28.515493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:28.515493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:28.515493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:28.515493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:28.515493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:28.515493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:28.515493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 318/633] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:28.517045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cc537-0757-4054-8810-033dc5ea04b8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:28.522532 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7e352-384d-4755-b794-97f6ba6cdc32 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:28.549817 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a566ba-c362-4624-9320-70e42ab46ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:28.550322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a566ba-c362-4624-9320-70e42ab46ed3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:28.550601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a566ba-c362-4624-9320-70e42ab46ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:28.550873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a566ba-c362-4624-9320-70e42ab46ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:28.551571 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a566ba-c362-4624-9320-70e42ab46ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:28.551873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a566ba-c362-4624-9320-70e42ab46ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:28.553276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a566ba-c362-4624-9320-70e42ab46ed3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:28.567485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 316/634] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:28.568885 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c3548-0b00-495a-8f04-7ec1cb589ec1 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:28.569175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c3548-0b00-495a-8f04-7ec1cb589ec1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:28.574286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c3548-0b00-495a-8f04-7ec1cb589ec1 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:28.576059 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 317/635] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:28.581322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c3548-0b00-495a-8f04-7ec1cb589ec1 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:28.627792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:28.647630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:28.679961 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7e352-384d-4755-b794-97f6ba6cdc32 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:28.698456 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c3548-0b00-495a-8f04-7ec1cb589ec1 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:28.728989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052e1a5-cbdb-4049-ad8c-fb9d168d70a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:28.730490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052e1a5-cbdb-4049-ad8c-fb9d168d70a6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:28.730711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052e1a5-cbdb-4049-ad8c-fb9d168d70a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:28.730985 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052e1a5-cbdb-4049-ad8c-fb9d168d70a6 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:28.731721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052e1a5-cbdb-4049-ad8c-fb9d168d70a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:28.732026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052e1a5-cbdb-4049-ad8c-fb9d168d70a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:28.733457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052e1a5-cbdb-4049-ad8c-fb9d168d70a6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:28.741049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff5515-9da5-4deb-b04f-bf08a58a9021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:28.742095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff5515-9da5-4deb-b04f-bf08a58a9021 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:28.742610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff5515-9da5-4deb-b04f-bf08a58a9021 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:28.743080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff5515-9da5-4deb-b04f-bf08a58a9021 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:28.743304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 319/636] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:28.744648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8976a8-4b91-4ac2-af6c-dbbd5bb70e9e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:28.744935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8976a8-4b91-4ac2-af6c-dbbd5bb70e9e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:28.745207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8976a8-4b91-4ac2-af6c-dbbd5bb70e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:28.751958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff5515-9da5-4deb-b04f-bf08a58a9021 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:28.753944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff5515-9da5-4deb-b04f-bf08a58a9021 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:28.766322 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3e8976a8-4b91-4ac2-af6c-dbbd5bb70e9e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-c9ff5515-9da5-4deb-b04f-bf08a58a9021 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:28.766631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:28.767868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:28.768783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:28.768783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:28.768783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:28.768783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:28.768783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:28.768783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:28.768783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:28.768783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:28.769250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3e8976a8-4b91-4ac2-af6c-dbbd5bb70e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:28.769360 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 318/637] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:28.769360 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff5515-9da5-4deb-b04f-bf08a58a9021 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:28.842775 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 320/638] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:28.844417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80e0cb-36db-4a07-83a2-254231bb300a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:28.844701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80e0cb-36db-4a07-83a2-254231bb300a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:28.844974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80e0cb-36db-4a07-83a2-254231bb300a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:28.846435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 321/639] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:28.850906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80e0cb-36db-4a07-83a2-254231bb300a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:28.891976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff5515-9da5-4deb-b04f-bf08a58a9021 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:28.905098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:28.911801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:28.927579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79255171-1471-40ec-aedd-015419a26648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:28.929483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79255171-1471-40ec-aedd-015419a26648 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:28.929483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79255171-1471-40ec-aedd-015419a26648 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:28.929483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79255171-1471-40ec-aedd-015419a26648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:28.944727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79255171-1471-40ec-aedd-015419a26648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:28.946227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79255171-1471-40ec-aedd-015419a26648 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-79255171-1471-40ec-aedd-015419a26648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:28.962195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:28.963314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:28.964212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:28.964212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:28.964212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:28.964212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:28.964212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 319/640] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:28.965005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720326c-c797-4fea-9e5d-894e744ce232 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:28.965309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720326c-c797-4fea-9e5d-894e744ce232 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:28.965582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720326c-c797-4fea-9e5d-894e744ce232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:28.971059 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80e0cb-36db-4a07-83a2-254231bb300a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:28.983823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0720326c-c797-4fea-9e5d-894e744ce232 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:28.984962 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0720326c-c797-4fea-9e5d-894e744ce232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:29.009822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a79936-f19b-451a-b329-b1aa53efe1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:29.010449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a79936-f19b-451a-b329-b1aa53efe1bd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:29.010732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a79936-f19b-451a-b329-b1aa53efe1bd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:29.011005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a79936-f19b-451a-b329-b1aa53efe1bd None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:29.011828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a79936-f19b-451a-b329-b1aa53efe1bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:29.012133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a79936-f19b-451a-b329-b1aa53efe1bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:29.013589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a79936-f19b-451a-b329-b1aa53efe1bd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:29.025829 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 322/641] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:29.026955 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a79936-f19b-451a-b329-b1aa53efe1bd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:29.054892 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 320/642] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:29.056161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720326c-c797-4fea-9e5d-894e744ce232 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:29.155023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a79936-f19b-451a-b329-b1aa53efe1bd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:29.164867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:29.167809 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:29.172178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720326c-c797-4fea-9e5d-894e744ce232 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:29.194684 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5238b-069c-4e51-9c8d-7dffc2e7a166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:29.195360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5238b-069c-4e51-9c8d-7dffc2e7a166 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:29.195643 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5238b-069c-4e51-9c8d-7dffc2e7a166 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:29.195924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5238b-069c-4e51-9c8d-7dffc2e7a166 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:29.206727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5238b-069c-4e51-9c8d-7dffc2e7a166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:29.206975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfce332-5cdf-40d1-a95c-868caf49c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:29.207578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfce332-5cdf-40d1-a95c-868caf49c1aa None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:29.207862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfce332-5cdf-40d1-a95c-868caf49c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:29.208137 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfce332-5cdf-40d1-a95c-868caf49c1aa None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:29.208841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfce332-5cdf-40d1-a95c-868caf49c1aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:29.209149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfce332-5cdf-40d1-a95c-868caf49c1aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:29.210596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfce332-5cdf-40d1-a95c-868caf49c1aa None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e2a5238b-069c-4e51-9c8d-7dffc2e7a166 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:29.212235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:29.213205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 323/643] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:29.219409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5238b-069c-4e51-9c8d-7dffc2e7a166 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:29.223247 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 321/644] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:29.223586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfce332-5cdf-40d1-a95c-868caf49c1aa None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:29.325421 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5238b-069c-4e51-9c8d-7dffc2e7a166 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:29.326984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfce332-5cdf-40d1-a95c-868caf49c1aa None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:29.359908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a7c3c-84ac-4546-a71f-30ab4b4e84d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:29.360523 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a7c3c-84ac-4546-a71f-30ab4b4e84d6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:29.360851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a7c3c-84ac-4546-a71f-30ab4b4e84d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:29.361075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a7c3c-84ac-4546-a71f-30ab4b4e84d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:29.361901 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a7c3c-84ac-4546-a71f-30ab4b4e84d6 None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=338b2744014940ca96c08d4e9262697b) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:29.362211 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a7c3c-84ac-4546-a71f-30ab4b4e84d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:29.362786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee52c7b-f119-4381-9a6f-d88ccf767462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:29.363421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee52c7b-f119-4381-9a6f-d88ccf767462 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:29.363636 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a7c3c-84ac-4546-a71f-30ab4b4e84d6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:29.363738 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee52c7b-f119-4381-9a6f-d88ccf767462 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:29.363960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee52c7b-f119-4381-9a6f-d88ccf767462 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:29.370107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 324/645] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:29 2022] GET /identity/v3/role_assignments?user.id=338b2744014940ca96c08d4e9262697b&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:29.370963 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a7c3c-84ac-4546-a71f-30ab4b4e84d6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:29.387809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee52c7b-f119-4381-9a6f-d88ccf767462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-5ee52c7b-f119-4381-9a6f-d88ccf767462 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:29.395633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:29.396701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:29.397735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:29.397735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:29.397735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:29.397735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:29.397735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:29.397735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:29.397735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:29.397735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:29.397735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:29.397735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:29.397735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:29.397735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:29.400232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 322/646] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:29.401268 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee52c7b-f119-4381-9a6f-d88ccf767462 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:29.424236 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:29.431319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:29.527865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a7c3c-84ac-4546-a71f-30ab4b4e84d6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:29.534659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee52c7b-f119-4381-9a6f-d88ccf767462 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:29.572618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5c227-7911-48b4-8d0a-6a9d6ccc9f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:29.573366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5c227-7911-48b4-8d0a-6a9d6ccc9f2b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:29.573646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5c227-7911-48b4-8d0a-6a9d6ccc9f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:29.573875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa95bbe-a1c0-476c-ac73-b058dcc3188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:29.573993 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5c227-7911-48b4-8d0a-6a9d6ccc9f2b None admin] PATH_INFO: `/v3/users/glance` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:29.574766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa95bbe-a1c0-476c-ac73-b058dcc3188b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:29.575212 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa95bbe-a1c0-476c-ac73-b058dcc3188b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:29.575696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa95bbe-a1c0-476c-ac73-b058dcc3188b None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:29.576595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa95bbe-a1c0-476c-ac73-b058dcc3188b None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:29.577356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa95bbe-a1c0-476c-ac73-b058dcc3188b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:29.579587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa95bbe-a1c0-476c-ac73-b058dcc3188b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:29.583617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5c227-7911-48b4-8d0a-6a9d6ccc9f2b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:29.585094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5c227-7911-48b4-8d0a-6a9d6ccc9f2b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:29.591128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 325/647] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:29.592168 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa95bbe-a1c0-476c-ac73-b058dcc3188b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-e9d5c227-7911-48b4-8d0a-6a9d6ccc9f2b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:29.599928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:29.600930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:29.602393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:29.602393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:29.602393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:29.602393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:29.602393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:29.602393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:29.602393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:29.602393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:29.602393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 02:32:29.602393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:29.602943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 323/648] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:29.603326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5c227-7911-48b4-8d0a-6a9d6ccc9f2b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:29.703300 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:29.721506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:29.730303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa95bbe-a1c0-476c-ac73-b058dcc3188b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:29.730812 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5c227-7911-48b4-8d0a-6a9d6ccc9f2b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:29.765488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c108e2-ec79-4b30-ade3-865c61857193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:29.766134 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c108e2-ec79-4b30-ade3-865c61857193 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:29.766417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c108e2-ec79-4b30-ade3-865c61857193 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:29.766691 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c108e2-ec79-4b30-ade3-865c61857193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:29.773514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ca9f9-980e-4c0c-8f08-fe4c3668672a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:29.774649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ca9f9-980e-4c0c-8f08-fe4c3668672a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:29.774932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ca9f9-980e-4c0c-8f08-fe4c3668672a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:29.775208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ca9f9-980e-4c0c-8f08-fe4c3668672a None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:29.776420 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ca9f9-980e-4c0c-8f08-fe4c3668672a None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:29.776937 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ca9f9-980e-4c0c-8f08-fe4c3668672a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:29.777774 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c108e2-ec79-4b30-ade3-865c61857193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:29.778482 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87ca9f9-980e-4c0c-8f08-fe4c3668672a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:29.779349 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c108e2-ec79-4b30-ade3-865c61857193 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:29.788860 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 326/649] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:29.794224 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ca9f9-980e-4c0c-8f08-fe4c3668672a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-22c108e2-ec79-4b30-ade3-865c61857193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:29.796298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:29.797367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:29.798256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:29.798256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:29.798256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:29.798256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:29.798256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 324/650] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:29.799023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c108e2-ec79-4b30-ade3-865c61857193 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:29.918426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ca9f9-980e-4c0c-8f08-fe4c3668672a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:29.923970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c108e2-ec79-4b30-ade3-865c61857193 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:29.950724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:29.961975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be76eb7-b223-47a6-90a8-c4dd3959fe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:29.963312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be76eb7-b223-47a6-90a8-c4dd3959fe93 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:29.963741 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be76eb7-b223-47a6-90a8-c4dd3959fe93 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:29.964157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be76eb7-b223-47a6-90a8-c4dd3959fe93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:29.964280 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27733ee0-8218-4f3a-915c-4b7f05adbbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:29.964978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27733ee0-8218-4f3a-915c-4b7f05adbbe7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:29.965501 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27733ee0-8218-4f3a-915c-4b7f05adbbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:29.965861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27733ee0-8218-4f3a-915c-4b7f05adbbe7 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:29.966734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27733ee0-8218-4f3a-915c-4b7f05adbbe7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:29.967101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27733ee0-8218-4f3a-915c-4b7f05adbbe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:29.968616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27733ee0-8218-4f3a-915c-4b7f05adbbe7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:29.979891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be76eb7-b223-47a6-90a8-c4dd3959fe93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:29.981752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be76eb7-b223-47a6-90a8-c4dd3959fe93 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:29.992976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 327/651] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Jul 26 02:32:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:29.994015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27733ee0-8218-4f3a-915c-4b7f05adbbe7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-6be76eb7-b223-47a6-90a8-c4dd3959fe93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:30.001752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:30.002659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:30.003547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:30.003547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:30.003547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:30.003547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:30.005897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 325/652] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:30.006923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be76eb7-b223-47a6-90a8-c4dd3959fe93 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:30.019071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:30.106158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27733ee0-8218-4f3a-915c-4b7f05adbbe7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:30.142559 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745dfd2-8ea2-40df-8a5c-93f6d1159430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:30.143461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745dfd2-8ea2-40df-8a5c-93f6d1159430 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:30.143844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745dfd2-8ea2-40df-8a5c-93f6d1159430 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:30.144216 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745dfd2-8ea2-40df-8a5c-93f6d1159430 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:30.145017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745dfd2-8ea2-40df-8a5c-93f6d1159430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:30.145467 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745dfd2-8ea2-40df-8a5c-93f6d1159430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:30.146918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be76eb7-b223-47a6-90a8-c4dd3959fe93 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:30.147043 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745dfd2-8ea2-40df-8a5c-93f6d1159430 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:30.164851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 328/653] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:30.166134 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745dfd2-8ea2-40df-8a5c-93f6d1159430 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:30.191181 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b151c14-799b-4579-8d75-f260d0c232a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:30.192329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b151c14-799b-4579-8d75-f260d0c232a6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:30.192757 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b151c14-799b-4579-8d75-f260d0c232a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:30.193172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b151c14-799b-4579-8d75-f260d0c232a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:30.248950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:30.264581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:30.276749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b151c14-799b-4579-8d75-f260d0c232a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:30.278442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b151c14-799b-4579-8d75-f260d0c232a6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:30.296479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745dfd2-8ea2-40df-8a5c-93f6d1159430 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:30.331780 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ff183-261d-4d7e-9cce-5bcbf150f1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:30.332461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ff183-261d-4d7e-9cce-5bcbf150f1bf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:30.332758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ff183-261d-4d7e-9cce-5bcbf150f1bf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:30.333016 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ff183-261d-4d7e-9cce-5bcbf150f1bf None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:30.333778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ff183-261d-4d7e-9cce-5bcbf150f1bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:30.334078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ff183-261d-4d7e-9cce-5bcbf150f1bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:30.335516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ff183-261d-4d7e-9cce-5bcbf150f1bf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:30.353905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 329/654] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:30.354853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ff183-261d-4d7e-9cce-5bcbf150f1bf None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:30.402218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 326/655] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:30.402869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b151c14-799b-4579-8d75-f260d0c232a6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:30.473820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ff183-261d-4d7e-9cce-5bcbf150f1bf None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:30.488538 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:30.511750 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b151c14-799b-4579-8d75-f260d0c232a6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:30.514154 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2d061-fefe-4de2-8129-0ec879ba2e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:30.514795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2d061-fefe-4de2-8129-0ec879ba2e3f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:30.515079 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2d061-fefe-4de2-8129-0ec879ba2e3f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:30.515348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2d061-fefe-4de2-8129-0ec879ba2e3f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:30.518797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:30.524374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2d061-fefe-4de2-8129-0ec879ba2e3f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:30.526273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada2d061-fefe-4de2-8129-0ec879ba2e3f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ada2d061-fefe-4de2-8129-0ec879ba2e3f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:30.539033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:30.540172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:30.541357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:30.541357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:30.541357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:30.541357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:30.541357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:30.541357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:30.541357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:30.541357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:30.541357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 02:32:30.541357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:30.541357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 330/656] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:30.541357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2d061-fefe-4de2-8129-0ec879ba2e3f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:30.553592 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e58133-edfa-4431-bb3c-bee359e23e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:30.554441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e58133-edfa-4431-bb3c-bee359e23e55 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:30.554888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e58133-edfa-4431-bb3c-bee359e23e55 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:30.555435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e58133-edfa-4431-bb3c-bee359e23e55 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:30.563830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e58133-edfa-4431-bb3c-bee359e23e55 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:30.565414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e58133-edfa-4431-bb3c-bee359e23e55 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-72e58133-edfa-4431-bb3c-bee359e23e55 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:30.578482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:30.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:30.580541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:30.580541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:30.580541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:30.580541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:30.580541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:30.580541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:30.580541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:30.580541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:30.580541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 02:32:30.580541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:30.580541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 327/657] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:30.581146 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570771b4-d7b0-4882-ae07-e0efe0d6434f None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:30.581787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570771b4-d7b0-4882-ae07-e0efe0d6434f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:30.581787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570771b4-d7b0-4882-ae07-e0efe0d6434f None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:30.585322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 328/658] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:30.585322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570771b4-d7b0-4882-ae07-e0efe0d6434f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:30.664509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada2d061-fefe-4de2-8129-0ec879ba2e3f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:30.696530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570771b4-d7b0-4882-ae07-e0efe0d6434f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:30.699630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34166c-0880-432b-b1e9-265e1de91281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:30.700284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34166c-0880-432b-b1e9-265e1de91281 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:30.700563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34166c-0880-432b-b1e9-265e1de91281 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:30.700841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34166c-0880-432b-b1e9-265e1de91281 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:30.711367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34166c-0880-432b-b1e9-265e1de91281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:30.712839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34166c-0880-432b-b1e9-265e1de91281 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ee34166c-0880-432b-b1e9-265e1de91281 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:30.727513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:30.728380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:30.729258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:30.729258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:30.729258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:30.729258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:30.733846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 331/659] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:30.734198 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34166c-0880-432b-b1e9-265e1de91281 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:30.735557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184148b1-ba53-4ae6-a630-135e11e4957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:30.736182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184148b1-ba53-4ae6-a630-135e11e4957a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:30.736461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184148b1-ba53-4ae6-a630-135e11e4957a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:30.736893 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184148b1-ba53-4ae6-a630-135e11e4957a None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:30.738556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184148b1-ba53-4ae6-a630-135e11e4957a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:30.738868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184148b1-ba53-4ae6-a630-135e11e4957a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:30.740324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184148b1-ba53-4ae6-a630-135e11e4957a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:30.750672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:30.767320 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 329/660] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Jul 26 02:32:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:30.767320 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeeead-2411-4d5e-adaf-66611429fd96 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:30.767320 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeeead-2411-4d5e-adaf-66611429fd96 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:30.767320 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeeead-2411-4d5e-adaf-66611429fd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:30.783290 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:30.785914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ebdeeead-2411-4d5e-adaf-66611429fd96 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:30.787097 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ebdeeead-2411-4d5e-adaf-66611429fd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:30.836368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34166c-0880-432b-b1e9-265e1de91281 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:30.857497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 330/661] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:30.858408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeeead-2411-4d5e-adaf-66611429fd96 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:30.887149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379218ba-7080-443b-b4ff-bf6d61bfe120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:30.888328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379218ba-7080-443b-b4ff-bf6d61bfe120 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:30.888792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379218ba-7080-443b-b4ff-bf6d61bfe120 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:30.889513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379218ba-7080-443b-b4ff-bf6d61bfe120 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:30.891233 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379218ba-7080-443b-b4ff-bf6d61bfe120 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:30.891714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379218ba-7080-443b-b4ff-bf6d61bfe120 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:30.893590 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379218ba-7080-443b-b4ff-bf6d61bfe120 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:30.916567 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 332/662] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Jul 26 02:32:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:30.917987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379218ba-7080-443b-b4ff-bf6d61bfe120 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:30.963638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeeead-2411-4d5e-adaf-66611429fd96 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:30.994274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:31.004316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a2025-aaf7-4cfc-883b-c55de1317f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:31.004937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a2025-aaf7-4cfc-883b-c55de1317f12 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:31.005217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a2025-aaf7-4cfc-883b-c55de1317f12 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:31.005771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a2025-aaf7-4cfc-883b-c55de1317f12 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:31.006270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a2025-aaf7-4cfc-883b-c55de1317f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:31.006573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a2025-aaf7-4cfc-883b-c55de1317f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:31.008000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a2025-aaf7-4cfc-883b-c55de1317f12 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:31.019019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379218ba-7080-443b-b4ff-bf6d61bfe120 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:31.024140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 331/663] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:31.024140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a2025-aaf7-4cfc-883b-c55de1317f12 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:31.032196 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:31.060932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f394e-1402-4528-8db0-64846f0f3cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:31.061593 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f394e-1402-4528-8db0-64846f0f3cd8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:31.061869 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f394e-1402-4528-8db0-64846f0f3cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:31.062134 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f394e-1402-4528-8db0-64846f0f3cd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:31.124364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a2025-aaf7-4cfc-883b-c55de1317f12 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:31.129577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f394e-1402-4528-8db0-64846f0f3cd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:31.131083 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f394e-1402-4528-8db0-64846f0f3cd8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:31.158289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df73617-6c04-4a6a-b028-38ea8bb623e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:31.158925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df73617-6c04-4a6a-b028-38ea8bb623e2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:31.159201 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df73617-6c04-4a6a-b028-38ea8bb623e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:31.159469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df73617-6c04-4a6a-b028-38ea8bb623e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:31.170364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df73617-6c04-4a6a-b028-38ea8bb623e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-4df73617-6c04-4a6a-b028-38ea8bb623e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:31.175848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:31.176809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 332/664] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:31.178050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df73617-6c04-4a6a-b028-38ea8bb623e2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:31.226465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:31.241377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 333/665] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:31.242234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f394e-1402-4528-8db0-64846f0f3cd8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:31.250516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:31.287340 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df73617-6c04-4a6a-b028-38ea8bb623e2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:31.325902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3cdc2-a532-4445-9e18-f473c8d8e344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:31.326944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3cdc2-a532-4445-9e18-f473c8d8e344 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:31.327742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3cdc2-a532-4445-9e18-f473c8d8e344 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:31.328477 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3cdc2-a532-4445-9e18-f473c8d8e344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:31.346398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f394e-1402-4528-8db0-64846f0f3cd8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:31.380624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc2cc2-1a1b-449c-a758-2466f2896d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:31.381262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc2cc2-1a1b-449c-a758-2466f2896d86 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:31.381566 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc2cc2-1a1b-449c-a758-2466f2896d86 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:31.381834 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc2cc2-1a1b-449c-a758-2466f2896d86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:31.388663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc2cc2-1a1b-449c-a758-2466f2896d86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:31.390167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc2cc2-1a1b-449c-a758-2466f2896d86 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:31.399014 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3cdc2-a532-4445-9e18-f473c8d8e344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:31.400471 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3cdc2-a532-4445-9e18-f473c8d8e344 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6bbc2cc2-1a1b-449c-a758-2466f2896d86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:31.402150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:31.403029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:31.403957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:31.403957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:31.403957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:31.403957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:31.403957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:31.403957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:31.403957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:31.403957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:31.403957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 334/666] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:31.405186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc2cc2-1a1b-449c-a758-2466f2896d86 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:31.452737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:31.472669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:31.508231 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc2cc2-1a1b-449c-a758-2466f2896d86 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:31.511884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 333/667] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:31.516963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3cdc2-a532-4445-9e18-f473c8d8e344 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:31.543244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c9cdf-c4e4-483c-8141-6e4cbc7b22d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:31.543967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c9cdf-c4e4-483c-8141-6e4cbc7b22d7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:31.544254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c9cdf-c4e4-483c-8141-6e4cbc7b22d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:31.544526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c9cdf-c4e4-483c-8141-6e4cbc7b22d7 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:31.545254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c9cdf-c4e4-483c-8141-6e4cbc7b22d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:31.545586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c9cdf-c4e4-483c-8141-6e4cbc7b22d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:31.547025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c9cdf-c4e4-483c-8141-6e4cbc7b22d7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:31.554975 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 335/668] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:31.555750 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c9cdf-c4e4-483c-8141-6e4cbc7b22d7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:31.621569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3cdc2-a532-4445-9e18-f473c8d8e344 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:31.656752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c9cdf-c4e4-483c-8141-6e4cbc7b22d7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:31.658364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64cd33-2b1d-4e3e-9bbc-a712ad77fb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:31.659038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64cd33-2b1d-4e3e-9bbc-a712ad77fb71 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:31.659315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64cd33-2b1d-4e3e-9bbc-a712ad77fb71 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:31.659584 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64cd33-2b1d-4e3e-9bbc-a712ad77fb71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:31.669441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64cd33-2b1d-4e3e-9bbc-a712ad77fb71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:31.670871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64cd33-2b1d-4e3e-9bbc-a712ad77fb71 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:31.677819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:31.683061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-ef64cd33-2b1d-4e3e-9bbc-a712ad77fb71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:31.687226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:31.688109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:31.689010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:31.689010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:31.689010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:31.689010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:31.689010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 334/669] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:31.689325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64cd33-2b1d-4e3e-9bbc-a712ad77fb71 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:31.695723 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283effda-765c-4daa-aa5b-c080b9f69e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:31.696353 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283effda-765c-4daa-aa5b-c080b9f69e19 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:31.696633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283effda-765c-4daa-aa5b-c080b9f69e19 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:31.696906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283effda-765c-4daa-aa5b-c080b9f69e19 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:31.697695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283effda-765c-4daa-aa5b-c080b9f69e19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:31.698005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283effda-765c-4daa-aa5b-c080b9f69e19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:31.699543 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283effda-765c-4daa-aa5b-c080b9f69e19 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:31.712232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 336/670] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:31.713452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1725f7-11dc-48e7-834e-c8a259262562 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:31.713742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1725f7-11dc-48e7-834e-c8a259262562 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:31.714020 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1725f7-11dc-48e7-834e-c8a259262562 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:31.715415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 337/671] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:31.715918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1725f7-11dc-48e7-834e-c8a259262562 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:31.801698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64cd33-2b1d-4e3e-9bbc-a712ad77fb71 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:31.814527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1725f7-11dc-48e7-834e-c8a259262562 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:31.836380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5251fda-2269-4e90-b7e4-8a044c7fa53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:31.837439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5251fda-2269-4e90-b7e4-8a044c7fa53a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:31.837728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5251fda-2269-4e90-b7e4-8a044c7fa53a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:31.838001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5251fda-2269-4e90-b7e4-8a044c7fa53a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:31.848526 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5251fda-2269-4e90-b7e4-8a044c7fa53a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:31.850006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5251fda-2269-4e90-b7e4-8a044c7fa53a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:31.850249 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548c8eb-5517-48f6-b3c6-99d0f4d0f1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:31.850899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548c8eb-5517-48f6-b3c6-99d0f4d0f1a0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:31.851184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548c8eb-5517-48f6-b3c6-99d0f4d0f1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:31.851455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548c8eb-5517-48f6-b3c6-99d0f4d0f1a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:31.862292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548c8eb-5517-48f6-b3c6-99d0f4d0f1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:31.863727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548c8eb-5517-48f6-b3c6-99d0f4d0f1a0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a5251fda-2269-4e90-b7e4-8a044c7fa53a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:31.864975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:31.865918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:31.871654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:31.871654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:31.871654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:31.871654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:31.871654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 335/672] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:31.871654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5251fda-2269-4e90-b7e4-8a044c7fa53a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f548c8eb-5517-48f6-b3c6-99d0f4d0f1a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:31.879319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:31.880202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:31.881069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:31.881069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:31.881069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:31.881069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:31.881069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 338/673] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:31.881381 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548c8eb-5517-48f6-b3c6-99d0f4d0f1a0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:31.919155 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:31.923341 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:31.968612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5251fda-2269-4e90-b7e4-8a044c7fa53a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:31.980811 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548c8eb-5517-48f6-b3c6-99d0f4d0f1a0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:32.002430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651d1a2-eb3c-48f0-9130-2c2f9bad2638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:32.003049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651d1a2-eb3c-48f0-9130-2c2f9bad2638 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:32.003328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651d1a2-eb3c-48f0-9130-2c2f9bad2638 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:32.003590 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651d1a2-eb3c-48f0-9130-2c2f9bad2638 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:32.004286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651d1a2-eb3c-48f0-9130-2c2f9bad2638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:32.004599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651d1a2-eb3c-48f0-9130-2c2f9bad2638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:32.006037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651d1a2-eb3c-48f0-9130-2c2f9bad2638 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:32.013898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82c2ae-7cba-46e6-9143-611092ed94b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:32.014513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82c2ae-7cba-46e6-9143-611092ed94b8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:32.014795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82c2ae-7cba-46e6-9143-611092ed94b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:32.015048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82c2ae-7cba-46e6-9143-611092ed94b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:32.015840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82c2ae-7cba-46e6-9143-611092ed94b8 None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=2402339784b34d98a4670db912617331) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:32.016148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82c2ae-7cba-46e6-9143-611092ed94b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:32.017590 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82c2ae-7cba-46e6-9143-611092ed94b8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:32.018120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 336/674] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:32.019369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f86e8-7427-4b38-b7cd-518538dbdcbf None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:32.019657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f86e8-7427-4b38-b7cd-518538dbdcbf None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:32.019929 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f86e8-7427-4b38-b7cd-518538dbdcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:32.034094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 339/675] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:31 2022] GET /identity/v3/role_assignments?user.id=2402339784b34d98a4670db912617331&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:32.034094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82c2ae-7cba-46e6-9143-611092ed94b8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:32.038357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f33f86e8-7427-4b38-b7cd-518538dbdcbf None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:32.039610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f33f86e8-7427-4b38-b7cd-518538dbdcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:32.129309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 337/676] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:32.129309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f86e8-7427-4b38-b7cd-518538dbdcbf None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:32.146303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82c2ae-7cba-46e6-9143-611092ed94b8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:32.151010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:32.184379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:32.193268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c651ce1-5ff6-40ee-8bd6-518ccf0e4eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:32.193922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c651ce1-5ff6-40ee-8bd6-518ccf0e4eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:32.194201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c651ce1-5ff6-40ee-8bd6-518ccf0e4eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:32.194465 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c651ce1-5ff6-40ee-8bd6-518ccf0e4eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:32.195165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c651ce1-5ff6-40ee-8bd6-518ccf0e4eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:32.195463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c651ce1-5ff6-40ee-8bd6-518ccf0e4eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:32.196843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c651ce1-5ff6-40ee-8bd6-518ccf0e4eb9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:32.210667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 340/677] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:32.211782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c651ce1-5ff6-40ee-8bd6-518ccf0e4eb9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:32.256984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f86e8-7427-4b38-b7cd-518538dbdcbf None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:32.293109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89760c95-55fa-4e26-8633-837d08a14412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:32.293775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89760c95-55fa-4e26-8633-837d08a14412 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:32.294131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89760c95-55fa-4e26-8633-837d08a14412 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:32.294410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89760c95-55fa-4e26-8633-837d08a14412 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:32.295113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89760c95-55fa-4e26-8633-837d08a14412 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:32.295416 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89760c95-55fa-4e26-8633-837d08a14412 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:32.296826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89760c95-55fa-4e26-8633-837d08a14412 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:32.308086 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 338/678] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:32.308901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89760c95-55fa-4e26-8633-837d08a14412 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:32.328278 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c651ce1-5ff6-40ee-8bd6-518ccf0e4eb9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:32.368136 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a7f81-0bbd-4a29-8bef-6bfc10287aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:32.369077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a7f81-0bbd-4a29-8bef-6bfc10287aa9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:32.369559 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a7f81-0bbd-4a29-8bef-6bfc10287aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:32.370129 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a7f81-0bbd-4a29-8bef-6bfc10287aa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:32.377463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a7f81-0bbd-4a29-8bef-6bfc10287aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:32.379203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a7f81-0bbd-4a29-8bef-6bfc10287aa9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-270a7f81-0bbd-4a29-8bef-6bfc10287aa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:32.391852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:32.392749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:32.393707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:32.393707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:32.393707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:32.393707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:32.393707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:32.393707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:32.393707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:32.393707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:32.395821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 341/679] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:32.396675 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a7f81-0bbd-4a29-8bef-6bfc10287aa9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:32.413810 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:32.418028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89760c95-55fa-4e26-8633-837d08a14412 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:32.425139 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:32.454035 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a0fd0-9d62-42bb-8d80-c6e6ef200782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:32.454786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a0fd0-9d62-42bb-8d80-c6e6ef200782 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:32.455057 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a0fd0-9d62-42bb-8d80-c6e6ef200782 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:32.455330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a0fd0-9d62-42bb-8d80-c6e6ef200782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:32.466161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a0fd0-9d62-42bb-8d80-c6e6ef200782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-860a0fd0-9d62-42bb-8d80-c6e6ef200782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:32.472299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:32.473258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:32.474394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:32.474394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:32.474394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:32.474394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:32.474394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:32.474394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:32.474394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:32.474394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:32.474394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:32.474394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:32.474394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:32.474394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:32.479251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 339/680] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:32.480095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a0fd0-9d62-42bb-8d80-c6e6ef200782 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:32.502072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a7f81-0bbd-4a29-8bef-6bfc10287aa9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:32.536020 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a592-d2ad-465c-b336-99b5b8105e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:32.536710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a592-d2ad-465c-b336-99b5b8105e01 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:32.536929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a592-d2ad-465c-b336-99b5b8105e01 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:32.537194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a592-d2ad-465c-b336-99b5b8105e01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:32.545314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164a592-d2ad-465c-b336-99b5b8105e01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:32.546811 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b164a592-d2ad-465c-b336-99b5b8105e01 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b164a592-d2ad-465c-b336-99b5b8105e01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:32.558150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:32.559071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:32.559972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:32.559972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:32.559972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:32.559972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:32.559972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:32.559972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:32.559972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:32.559972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:32.559972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 342/681] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:32.560975 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a592-d2ad-465c-b336-99b5b8105e01 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:32.592258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a0fd0-9d62-42bb-8d80-c6e6ef200782 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:32.635788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad6ad7-cb9e-42b2-a5e5-3dc429975453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:32.636559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad6ad7-cb9e-42b2-a5e5-3dc429975453 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:32.636840 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad6ad7-cb9e-42b2-a5e5-3dc429975453 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:32.637317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad6ad7-cb9e-42b2-a5e5-3dc429975453 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:32.645151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad6ad7-cb9e-42b2-a5e5-3dc429975453 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:32.646589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad6ad7-cb9e-42b2-a5e5-3dc429975453 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:32.652324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-0cad6ad7-cb9e-42b2-a5e5-3dc429975453 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:32.658073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:32.658995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:32.659936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:32.659936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:32.659936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:32.659936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:32.659936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:32.659936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:32.659936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:32.659936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:32.659936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 02:32:32.659936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:32.659936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 340/682] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:32.660881 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad6ad7-cb9e-42b2-a5e5-3dc429975453 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:32.674484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a592-d2ad-465c-b336-99b5b8105e01 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:32.683579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:32.714893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b726cc9-406e-49cd-aae1-52f992ff8ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:32.715501 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b726cc9-406e-49cd-aae1-52f992ff8ca5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:32.715784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b726cc9-406e-49cd-aae1-52f992ff8ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:32.716055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b726cc9-406e-49cd-aae1-52f992ff8ca5 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:32.716812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b726cc9-406e-49cd-aae1-52f992ff8ca5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:32.717110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b726cc9-406e-49cd-aae1-52f992ff8ca5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:32.718579 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b726cc9-406e-49cd-aae1-52f992ff8ca5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:32.731539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 343/683] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:32.732353 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b726cc9-406e-49cd-aae1-52f992ff8ca5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:32.776573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad6ad7-cb9e-42b2-a5e5-3dc429975453 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:32.815783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd6171-e82a-4486-80fa-2caf8741820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:32.816428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd6171-e82a-4486-80fa-2caf8741820d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:32.816675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd6171-e82a-4486-80fa-2caf8741820d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:32.817161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd6171-e82a-4486-80fa-2caf8741820d None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:32.817757 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd6171-e82a-4486-80fa-2caf8741820d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:32.818441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd6171-e82a-4486-80fa-2caf8741820d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:32.819381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd6171-e82a-4486-80fa-2caf8741820d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:32.832587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 341/684] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:32.832587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd6171-e82a-4486-80fa-2caf8741820d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:32.854984 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b726cc9-406e-49cd-aae1-52f992ff8ca5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:32.895280 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767c63a-fea2-470e-9f5f-c66bda962ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:32.896087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767c63a-fea2-470e-9f5f-c66bda962ad4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:32.896366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767c63a-fea2-470e-9f5f-c66bda962ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:32.896636 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767c63a-fea2-470e-9f5f-c66bda962ad4 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:32.897889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767c63a-fea2-470e-9f5f-c66bda962ad4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:32.898199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767c63a-fea2-470e-9f5f-c66bda962ad4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:32.899784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767c63a-fea2-470e-9f5f-c66bda962ad4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:32.911476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 344/685] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:32.912055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767c63a-fea2-470e-9f5f-c66bda962ad4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:32.916354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:32.930336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:32.952573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd6171-e82a-4486-80fa-2caf8741820d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:32.987239 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363c7e1-fea2-4283-a112-277bbc499f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:32.987857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363c7e1-fea2-4283-a112-277bbc499f0e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:32.988136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363c7e1-fea2-4283-a112-277bbc499f0e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:32.988404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363c7e1-fea2-4283-a112-277bbc499f0e None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:32.989197 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363c7e1-fea2-4283-a112-277bbc499f0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:32.989525 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363c7e1-fea2-4283-a112-277bbc499f0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:32.990954 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363c7e1-fea2-4283-a112-277bbc499f0e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:33.008386 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 342/686] 10.222.0.39 () {56 vars in 1135 bytes} [Tue Jul 26 02:32:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:33.009045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363c7e1-fea2-4283-a112-277bbc499f0e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:33.023446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767c63a-fea2-470e-9f5f-c66bda962ad4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:33.058310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ade9ac-d9b3-4f58-86ef-2ab0f025524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:33.058912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ade9ac-d9b3-4f58-86ef-2ab0f025524f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:33.059190 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ade9ac-d9b3-4f58-86ef-2ab0f025524f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:33.059457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ade9ac-d9b3-4f58-86ef-2ab0f025524f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:33.060235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ade9ac-d9b3-4f58-86ef-2ab0f025524f None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=fe228871a7fd4a9bb15645955ff365c8) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:33.060648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ade9ac-d9b3-4f58-86ef-2ab0f025524f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:33.062085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ade9ac-d9b3-4f58-86ef-2ab0f025524f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:33.068107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 345/687] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:32 2022] GET /identity/v3/role_assignments?user.id=fe228871a7fd4a9bb15645955ff365c8&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:33.078687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ade9ac-d9b3-4f58-86ef-2ab0f025524f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:33.124452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363c7e1-fea2-4283-a112-277bbc499f0e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:33.173113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:33.173457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb365-59e3-4b5b-8e6d-c7ba48cfbd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:33.174316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb365-59e3-4b5b-8e6d-c7ba48cfbd0e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:33.174316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb365-59e3-4b5b-8e6d-c7ba48cfbd0e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:33.174491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbb365-59e3-4b5b-8e6d-c7ba48cfbd0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:33.186797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:33.189476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbb365-59e3-4b5b-8e6d-c7ba48cfbd0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:33.191435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbb365-59e3-4b5b-8e6d-c7ba48cfbd0e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-85fbb365-59e3-4b5b-8e6d-c7ba48cfbd0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:33.208802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:33.209851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:33.210796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:33.210796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:33.210796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:33.210796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:33.215226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 343/688] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:33.216274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb365-59e3-4b5b-8e6d-c7ba48cfbd0e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:33.230228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ade9ac-d9b3-4f58-86ef-2ab0f025524f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:33.266918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09438e91-7600-4821-8c04-304773b0bb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:33.267631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09438e91-7600-4821-8c04-304773b0bb00 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:33.267981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09438e91-7600-4821-8c04-304773b0bb00 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:33.268317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09438e91-7600-4821-8c04-304773b0bb00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:33.269180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09438e91-7600-4821-8c04-304773b0bb00 None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=ba1305d4e5914f1182dc7436a2d53965) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:33.269586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09438e91-7600-4821-8c04-304773b0bb00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:33.272043 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09438e91-7600-4821-8c04-304773b0bb00 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:33.279479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 346/689] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:33 2022] GET /identity/v3/role_assignments?user.id=ba1305d4e5914f1182dc7436a2d53965&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:33.280318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09438e91-7600-4821-8c04-304773b0bb00 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:33.387350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbb365-59e3-4b5b-8e6d-c7ba48cfbd0e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:33.452051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09438e91-7600-4821-8c04-304773b0bb00 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:33.458276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8349150-e2e2-4c83-9248-39fdeba0557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:33.462422 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8349150-e2e2-4c83-9248-39fdeba0557f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:33.462714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8349150-e2e2-4c83-9248-39fdeba0557f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:33.462988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8349150-e2e2-4c83-9248-39fdeba0557f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:33.508187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:33.516273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7466cca-d0c8-4c12-89ba-f13e16adc44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:33.516911 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7466cca-d0c8-4c12-89ba-f13e16adc44c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:33.517192 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7466cca-d0c8-4c12-89ba-f13e16adc44c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:33.517489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7466cca-d0c8-4c12-89ba-f13e16adc44c None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:33.518185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7466cca-d0c8-4c12-89ba-f13e16adc44c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:33.518487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7466cca-d0c8-4c12-89ba-f13e16adc44c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:33.520738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7466cca-d0c8-4c12-89ba-f13e16adc44c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:33.532847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:33.535323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 347/690] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:33.541671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7466cca-d0c8-4c12-89ba-f13e16adc44c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:33.543728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8349150-e2e2-4c83-9248-39fdeba0557f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:33.545320 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8349150-e2e2-4c83-9248-39fdeba0557f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:33.664161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 344/691] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:33.671589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8349150-e2e2-4c83-9248-39fdeba0557f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:33.691411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7466cca-d0c8-4c12-89ba-f13e16adc44c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:33.749383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82b4f8-f460-4368-9f54-b8db2e8b9dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:33.754018 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82b4f8-f460-4368-9f54-b8db2e8b9dbb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:33.754305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82b4f8-f460-4368-9f54-b8db2e8b9dbb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:33.754580 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82b4f8-f460-4368-9f54-b8db2e8b9dbb None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:33.770215 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82b4f8-f460-4368-9f54-b8db2e8b9dbb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:33.771698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82b4f8-f460-4368-9f54-b8db2e8b9dbb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-1d82b4f8-f460-4368-9f54-b8db2e8b9dbb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:33.788603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:33.789900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:33.791019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:33.791019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:33.791019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:33.791019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:33.791019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:33.791019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:33.791019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:33.791019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:33.791019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:32:33.791019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:33.791019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 348/692] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 02:32:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:33.797323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82b4f8-f460-4368-9f54-b8db2e8b9dbb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:33.801764 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:33.812318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8349150-e2e2-4c83-9248-39fdeba0557f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:33.848434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e9c87-636e-4d84-a744-77e429785f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:33.849312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e9c87-636e-4d84-a744-77e429785f44 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:33.849692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e9c87-636e-4d84-a744-77e429785f44 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:33.850063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e9c87-636e-4d84-a744-77e429785f44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:33.861515 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e9c87-636e-4d84-a744-77e429785f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:33.863110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e9c87-636e-4d84-a744-77e429785f44 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-7f0e9c87-636e-4d84-a744-77e429785f44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:33.878749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:33.879829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:33.880935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:33.880935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:33.880935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:33.880935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:33.886848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 345/693] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:33.888110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e9c87-636e-4d84-a744-77e429785f44 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:33.908440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:33.979157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82b4f8-f460-4368-9f54-b8db2e8b9dbb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:34.014306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f58956-8622-4956-845d-1a44d0513144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:34.014842 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f58956-8622-4956-845d-1a44d0513144 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:34.015117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f58956-8622-4956-845d-1a44d0513144 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:34.015384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f58956-8622-4956-845d-1a44d0513144 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:34.016177 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f58956-8622-4956-845d-1a44d0513144 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:34.016477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f58956-8622-4956-845d-1a44d0513144 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:34.017939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f58956-8622-4956-845d-1a44d0513144 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:34.042407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e9c87-636e-4d84-a744-77e429785f44 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:34.138080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cdb47-fe0b-4b40-8d8e-c8eda5073614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:34.138746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cdb47-fe0b-4b40-8d8e-c8eda5073614 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:34.139032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cdb47-fe0b-4b40-8d8e-c8eda5073614 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:34.139301 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497cdb47-fe0b-4b40-8d8e-c8eda5073614 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:34.140024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cdb47-fe0b-4b40-8d8e-c8eda5073614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:34.140384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cdb47-fe0b-4b40-8d8e-c8eda5073614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:34.141833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497cdb47-fe0b-4b40-8d8e-c8eda5073614 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:34.160912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 349/694] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 02:32:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:34.167711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 346/695] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:34.168597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f58956-8622-4956-845d-1a44d0513144 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:34.173041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cdb47-fe0b-4b40-8d8e-c8eda5073614 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:34.181922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:34.299563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f58956-8622-4956-845d-1a44d0513144 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:34.311025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:34.312941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497cdb47-fe0b-4b40-8d8e-c8eda5073614 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:34.337888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29c134-ac0a-4331-a607-432dcf34effd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:34.338867 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29c134-ac0a-4331-a607-432dcf34effd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:34.339404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29c134-ac0a-4331-a607-432dcf34effd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:34.339815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29c134-ac0a-4331-a607-432dcf34effd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:34.355096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888d5ce-7c7a-46e5-84e7-733570d997e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:34.355886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888d5ce-7c7a-46e5-84e7-733570d997e2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:34.356165 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888d5ce-7c7a-46e5-84e7-733570d997e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:34.356434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888d5ce-7c7a-46e5-84e7-733570d997e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:34.364793 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888d5ce-7c7a-46e5-84e7-733570d997e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:34.366424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888d5ce-7c7a-46e5-84e7-733570d997e2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-c888d5ce-7c7a-46e5-84e7-733570d997e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:34.380283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:34.381356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:34.382255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:34.382255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:34.382255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:34.382255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:34.382255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:34.382255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:34.382255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:34.382255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:34.389340 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 347/696] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:34.390911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed055a14-bf35-477b-a6a1-871c233d777c None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:34.391373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed055a14-bf35-477b-a6a1-871c233d777c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:34.391898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed055a14-bf35-477b-a6a1-871c233d777c None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:34.397392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 348/697] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:34.398309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed055a14-bf35-477b-a6a1-871c233d777c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:34.417354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29c134-ac0a-4331-a607-432dcf34effd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:34.419085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29c134-ac0a-4331-a607-432dcf34effd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:34.470429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:34.521935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed055a14-bf35-477b-a6a1-871c233d777c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:34.539073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 350/698] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:34.540452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9e646-c01f-467c-9e95-7493d6e0ebd7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:34.540797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9e646-c01f-467c-9e95-7493d6e0ebd7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:34.541318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9e646-c01f-467c-9e95-7493d6e0ebd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:34.559913 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6eb22-023e-47c7-9ee1-c81d7d688c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:34.560854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6eb22-023e-47c7-9ee1-c81d7d688c38 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:34.561378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6eb22-023e-47c7-9ee1-c81d7d688c38 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:34.561853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6eb22-023e-47c7-9ee1-c81d7d688c38 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:34.562830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6eb22-023e-47c7-9ee1-c81d7d688c38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:34.563094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-eaa9e646-c01f-467c-9e95-7493d6e0ebd7 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:34.563876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6eb22-023e-47c7-9ee1-c81d7d688c38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:34.564396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eaa9e646-c01f-467c-9e95-7493d6e0ebd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:34.565800 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6eb22-023e-47c7-9ee1-c81d7d688c38 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:34.567431 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:34.585498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 349/699] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:34.586854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6eb22-023e-47c7-9ee1-c81d7d688c38 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:34.654029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 351/700] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:34.654620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9e646-c01f-467c-9e95-7493d6e0ebd7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:34.704144 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6eb22-023e-47c7-9ee1-c81d7d688c38 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:34.728675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:34.740921 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ed4c0-48f8-4fc0-9a14-dafa4a88c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:34.741738 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ed4c0-48f8-4fc0-9a14-dafa4a88c810 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:34.742100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ed4c0-48f8-4fc0-9a14-dafa4a88c810 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:34.742435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ed4c0-48f8-4fc0-9a14-dafa4a88c810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:34.753321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ed4c0-48f8-4fc0-9a14-dafa4a88c810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:34.754972 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ed4c0-48f8-4fc0-9a14-dafa4a88c810 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-8a0ed4c0-48f8-4fc0-9a14-dafa4a88c810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:34.770365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:34.771445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:34.772527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:34.772527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:34.772527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:34.772527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:34.774216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 350/701] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:34.775098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ed4c0-48f8-4fc0-9a14-dafa4a88c810 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:34.783581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9e646-c01f-467c-9e95-7493d6e0ebd7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:34.820096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46cc41-a3c8-4814-a441-57ade000ad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:34.820947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46cc41-a3c8-4814-a441-57ade000ad0f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:34.821474 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46cc41-a3c8-4814-a441-57ade000ad0f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:34.821879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46cc41-a3c8-4814-a441-57ade000ad0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:34.822926 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46cc41-a3c8-4814-a441-57ade000ad0f None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=f2365526802146088fcaa4afc2e03a35) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:34.823467 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46cc41-a3c8-4814-a441-57ade000ad0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:34.825230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46cc41-a3c8-4814-a441-57ade000ad0f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:34.831957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 352/702] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:34 2022] GET /identity/v3/role_assignments?user.id=f2365526802146088fcaa4afc2e03a35&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:34.832894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46cc41-a3c8-4814-a441-57ade000ad0f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:34.836458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:34.916901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ed4c0-48f8-4fc0-9a14-dafa4a88c810 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:34.944847 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46cc41-a3c8-4814-a441-57ade000ad0f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:34.982571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5353def-ef89-4984-94fb-ebd56a71b619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:34.983583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5353def-ef89-4984-94fb-ebd56a71b619 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:34.983690 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f7d1-8e84-4cb0-a4ea-775022ec5f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:34.984173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5353def-ef89-4984-94fb-ebd56a71b619 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:34.984420 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f7d1-8e84-4cb0-a4ea-775022ec5f3f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:34.984773 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f7d1-8e84-4cb0-a4ea-775022ec5f3f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:34.984972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5353def-ef89-4984-94fb-ebd56a71b619 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:34.985116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f7d1-8e84-4cb0-a4ea-775022ec5f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:34.986095 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5353def-ef89-4984-94fb-ebd56a71b619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:34.986574 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5353def-ef89-4984-94fb-ebd56a71b619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:34.988296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5353def-ef89-4984-94fb-ebd56a71b619 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:35.002530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 353/703] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:35.004717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6f7d1-8e84-4cb0-a4ea-775022ec5f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:35.006504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6f7d1-8e84-4cb0-a4ea-775022ec5f3f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:35.008177 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5353def-ef89-4984-94fb-ebd56a71b619 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a8f6f7d1-8e84-4cb0-a4ea-775022ec5f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:35.038323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:35.039286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:35.040185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:35.040185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:35.040185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:35.040185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:35.047961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 351/704] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:35.063391 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f7d1-8e84-4cb0-a4ea-775022ec5f3f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:35.118098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:35.125958 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:35.181403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5353def-ef89-4984-94fb-ebd56a71b619 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:35.214735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f7d1-8e84-4cb0-a4ea-775022ec5f3f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:35.224676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caad08-2fb9-45c1-8b05-4cacbe008779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:35.225341 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caad08-2fb9-45c1-8b05-4cacbe008779 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:35.225620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caad08-2fb9-45c1-8b05-4cacbe008779 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:35.225889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caad08-2fb9-45c1-8b05-4cacbe008779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:35.233984 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caad08-2fb9-45c1-8b05-4cacbe008779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:35.235424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caad08-2fb9-45c1-8b05-4cacbe008779 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-99caad08-2fb9-45c1-8b05-4cacbe008779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:35.248418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:35.249383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:35.250284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:35.250284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:35.250284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:35.250284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:35.250284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:35.250284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:35.250284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:35.250284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:35.250947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 354/705] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:35.256906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caad08-2fb9-45c1-8b05-4cacbe008779 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:35.262268 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467803e-8aea-4180-9dc9-9081cc5b2a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:35.262897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467803e-8aea-4180-9dc9-9081cc5b2a75 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:35.263170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467803e-8aea-4180-9dc9-9081cc5b2a75 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:35.263437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467803e-8aea-4180-9dc9-9081cc5b2a75 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:35.264193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467803e-8aea-4180-9dc9-9081cc5b2a75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:35.264495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467803e-8aea-4180-9dc9-9081cc5b2a75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:35.265913 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467803e-8aea-4180-9dc9-9081cc5b2a75 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:35.279271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 352/706] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:35.286089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467803e-8aea-4180-9dc9-9081cc5b2a75 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:35.378678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caad08-2fb9-45c1-8b05-4cacbe008779 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:35.401246 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:35.409063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:35.416243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467803e-8aea-4180-9dc9-9081cc5b2a75 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:35.422875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b3c62-cb1c-40eb-9aa9-198783155574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:35.423622 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3c62-cb1c-40eb-9aa9-198783155574 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:35.424013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3c62-cb1c-40eb-9aa9-198783155574 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:35.424374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b3c62-cb1c-40eb-9aa9-198783155574 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:35.425462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b3c62-cb1c-40eb-9aa9-198783155574 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:35.425794 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b3c62-cb1c-40eb-9aa9-198783155574 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:35.427320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b3c62-cb1c-40eb-9aa9-198783155574 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:35.442063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 355/707] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:35.443510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35971ca5-63d8-4d79-839d-fabe60c8afac None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:35.443887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35971ca5-63d8-4d79-839d-fabe60c8afac None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:35.444248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35971ca5-63d8-4d79-839d-fabe60c8afac None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:35.445814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 356/708] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:35.449005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35971ca5-63d8-4d79-839d-fabe60c8afac None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:35.455300 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3cead5-598b-4490-9ceb-8051abd823a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:35.456165 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cead5-598b-4490-9ceb-8051abd823a1 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:35.456598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cead5-598b-4490-9ceb-8051abd823a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:35.457007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3cead5-598b-4490-9ceb-8051abd823a1 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:35.457873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cead5-598b-4490-9ceb-8051abd823a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:35.459942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3cead5-598b-4490-9ceb-8051abd823a1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:35.489106 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 353/709] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:32:35 2022] POST /identity/v3/users => generated 254 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:32:35.490911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792ed5d-30a8-4742-b4b8-164b846ac9c1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:35.492297 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792ed5d-30a8-4742-b4b8-164b846ac9c1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:35.492739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792ed5d-30a8-4742-b4b8-164b846ac9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:35.517315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6792ed5d-30a8-4742-b4b8-164b846ac9c1 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:35.519032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6792ed5d-30a8-4742-b4b8-164b846ac9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:35.614384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35971ca5-63d8-4d79-839d-fabe60c8afac None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:35.655420 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 354/710] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:35.663808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d0213-b5f6-46ff-ae6e-ebda6d8eb861 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:35.664094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d0213-b5f6-46ff-ae6e-ebda6d8eb861 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:35.664342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d0213-b5f6-46ff-ae6e-ebda6d8eb861 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:35.669038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 355/711] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:35.678902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf23ebb-5b93-41ab-b862-1c6038996ec4 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:35.679326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf23ebb-5b93-41ab-b862-1c6038996ec4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:35.679703 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf23ebb-5b93-41ab-b862-1c6038996ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:35.696169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85ad2e-3e92-4fe3-a8e0-e53afcae5460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:35.697626 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85ad2e-3e92-4fe3-a8e0-e53afcae5460 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:35.699670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85ad2e-3e92-4fe3-a8e0-e53afcae5460 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:35.701000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85ad2e-3e92-4fe3-a8e0-e53afcae5460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:35.702547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85ad2e-3e92-4fe3-a8e0-e53afcae5460 None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=338b2744014940ca96c08d4e9262697b) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:35.704051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85ad2e-3e92-4fe3-a8e0-e53afcae5460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:35.707236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85ad2e-3e92-4fe3-a8e0-e53afcae5460 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:35.720881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 357/712] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:35 2022] GET /identity/v3/role_assignments?user.id=338b2744014940ca96c08d4e9262697b&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:35.722000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85ad2e-3e92-4fe3-a8e0-e53afcae5460 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:35.723231 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-dbf23ebb-5b93-41ab-b862-1c6038996ec4 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:35.727218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-dbf23ebb-5b93-41ab-b862-1c6038996ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:35.830109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:35.852861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 356/713] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:35.889690 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf23ebb-5b93-41ab-b862-1c6038996ec4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:35.893521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:35.932275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85ad2e-3e92-4fe3-a8e0-e53afcae5460 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:35.988360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a794dd-c68e-4d9a-861b-6e6e5e00ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:35.989669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a794dd-c68e-4d9a-861b-6e6e5e00ba71 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:35.989955 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a794dd-c68e-4d9a-861b-6e6e5e00ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:35.990225 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a794dd-c68e-4d9a-861b-6e6e5e00ba71 None admin] PATH_INFO: `/v3/services/network` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:35.991139 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a794dd-c68e-4d9a-861b-6e6e5e00ba71 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:35.995132 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a794dd-c68e-4d9a-861b-6e6e5e00ba71 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-32a794dd-c68e-4d9a-861b-6e6e5e00ba71 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:36.025521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:36.026751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:36.027722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 358/714] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:35 2022] GET /identity/v3/services/network => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:36.034667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a794dd-c68e-4d9a-861b-6e6e5e00ba71 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:36.103481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf23ebb-5b93-41ab-b862-1c6038996ec4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:36.189091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52425979-00f8-4a4d-8ead-2e902bceff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:36.190249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52425979-00f8-4a4d-8ead-2e902bceff60 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:36.190792 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52425979-00f8-4a4d-8ead-2e902bceff60 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:36.191377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52425979-00f8-4a4d-8ead-2e902bceff60 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:36.192320 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52425979-00f8-4a4d-8ead-2e902bceff60 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:36.194234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52425979-00f8-4a4d-8ead-2e902bceff60 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-52425979-00f8-4a4d-8ead-2e902bceff60 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:36.208026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:36.209001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 02:32:36.210224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:36.212992 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 357/715] 10.222.0.39 () {56 vars in 1129 bytes} [Tue Jul 26 02:32:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:36.218828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52425979-00f8-4a4d-8ead-2e902bceff60 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:36.303261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a794dd-c68e-4d9a-861b-6e6e5e00ba71 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:36.305009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:36.331063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:36.346478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52425979-00f8-4a4d-8ead-2e902bceff60 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:36.372656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c81d70-3c5d-4f61-a2d4-424bc77191dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:36.373790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c81d70-3c5d-4f61-a2d4-424bc77191dd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:36.374545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c81d70-3c5d-4f61-a2d4-424bc77191dd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:36.375418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c81d70-3c5d-4f61-a2d4-424bc77191dd None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:36.376582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c81d70-3c5d-4f61-a2d4-424bc77191dd None admin] RBAC: Adding query filter params (name=network) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:36.377373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c81d70-3c5d-4f61-a2d4-424bc77191dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:36.379638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c81d70-3c5d-4f61-a2d4-424bc77191dd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:36.384273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76239128-e48c-4c98-9bc6-8158ef393196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:36.385360 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76239128-e48c-4c98-9bc6-8158ef393196 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:36.387513 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76239128-e48c-4c98-9bc6-8158ef393196 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:36.388009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76239128-e48c-4c98-9bc6-8158ef393196 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:36.388894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76239128-e48c-4c98-9bc6-8158ef393196 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:36.389370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 359/716] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 02:32:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:36.393819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76239128-e48c-4c98-9bc6-8158ef393196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:36.395459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76239128-e48c-4c98-9bc6-8158ef393196 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:36.401012 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 358/717] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Jul 26 02:32:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:36.403124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c81d70-3c5d-4f61-a2d4-424bc77191dd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:36.406888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76239128-e48c-4c98-9bc6-8158ef393196 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:36.590499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76239128-e48c-4c98-9bc6-8158ef393196 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:36.612907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c81d70-3c5d-4f61-a2d4-424bc77191dd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:36.622670 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:36.634904 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee2556-9674-4b8e-9e72-9d009d853ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:36.635779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee2556-9674-4b8e-9e72-9d009d853ae6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:36.636336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee2556-9674-4b8e-9e72-9d009d853ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:36.636673 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee2556-9674-4b8e-9e72-9d009d853ae6 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:36.637479 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee2556-9674-4b8e-9e72-9d009d853ae6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:36.637854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee2556-9674-4b8e-9e72-9d009d853ae6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:36.639341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee2556-9674-4b8e-9e72-9d009d853ae6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:36.645767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 359/718] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Jul 26 02:32:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:36.661070 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835ac44-3de6-4132-90be-c31ab18a94f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:36.662459 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835ac44-3de6-4132-90be-c31ab18a94f2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:36.662935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835ac44-3de6-4132-90be-c31ab18a94f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:36.663380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835ac44-3de6-4132-90be-c31ab18a94f2 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:36.664307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835ac44-3de6-4132-90be-c31ab18a94f2 None admin] RBAC: Adding query filter params (type=network) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:36.664792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835ac44-3de6-4132-90be-c31ab18a94f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:36.666423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835ac44-3de6-4132-90be-c31ab18a94f2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:36.684933 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 360/719] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 02:32:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:37.499168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aabb5-3816-4eab-a13a-6079fb130734 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:37.499744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aabb5-3816-4eab-a13a-6079fb130734 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:37.499744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aabb5-3816-4eab-a13a-6079fb130734 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:37.501403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 360/720] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:37.506160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e577418-eae2-4ace-8fa3-eea1cab76a26 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:37.506447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e577418-eae2-4ace-8fa3-eea1cab76a26 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:37.506719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e577418-eae2-4ace-8fa3-eea1cab76a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:37.529908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0e577418-eae2-4ace-8fa3-eea1cab76a26 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:37.531112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0e577418-eae2-4ace-8fa3-eea1cab76a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:37.572511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:37.618785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 361/721] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:32:37.652091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3aabb5-3816-4eab-a13a-6079fb130734 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:37.904009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3aabb5-3816-4eab-a13a-6079fb130734 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:37.950357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dba51-6c4b-4f54-81b6-7983c4dafea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:37.951008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dba51-6c4b-4f54-81b6-7983c4dafea5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:37.951287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dba51-6c4b-4f54-81b6-7983c4dafea5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:37.951559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dba51-6c4b-4f54-81b6-7983c4dafea5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:37.969627 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dba51-6c4b-4f54-81b6-7983c4dafea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b36dba51-6c4b-4f54-81b6-7983c4dafea5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:37.974615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:37.975527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:37.976347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:37.976347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:37.976347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:37.976347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:37.976347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:37.976347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:37.976347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:37.976347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:37.976347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:37.976347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:37.976347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:37.976347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:37.976347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 361/722] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:37.982514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e577418-eae2-4ace-8fa3-eea1cab76a26 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:38.083658 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e577418-eae2-4ace-8fa3-eea1cab76a26 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:38.120720 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e1b8a-1b88-4219-a88a-e297c9cb6d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:38.121374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e1b8a-1b88-4219-a88a-e297c9cb6d60 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:38.121660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e1b8a-1b88-4219-a88a-e297c9cb6d60 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:38.121937 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e1b8a-1b88-4219-a88a-e297c9cb6d60 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:38.122659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e1b8a-1b88-4219-a88a-e297c9cb6d60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:38.122963 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e1b8a-1b88-4219-a88a-e297c9cb6d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:38.124344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e1b8a-1b88-4219-a88a-e297c9cb6d60 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:38.132657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60826e7b-43b1-4f92-b4c1-45b58d863ea9 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:38.132939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60826e7b-43b1-4f92-b4c1-45b58d863ea9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:38.133196 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60826e7b-43b1-4f92-b4c1-45b58d863ea9 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:38.133540 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 362/723] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:38.134957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 362/724] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:32:38.139175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e1b8a-1b88-4219-a88a-e297c9cb6d60 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:38.166868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ddbf0-ff49-4f12-8ac1-764c6f7cad99 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:38.167220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ddbf0-ff49-4f12-8ac1-764c6f7cad99 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:38.167504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ddbf0-ff49-4f12-8ac1-764c6f7cad99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:38.175498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:38.202382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6d3ddbf0-ff49-4f12-8ac1-764c6f7cad99 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:38.203609 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6d3ddbf0-ff49-4f12-8ac1-764c6f7cad99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:38.247305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e1b8a-1b88-4219-a88a-e297c9cb6d60 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:38.280277 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:38.282820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c3d2-5bdb-4fae-80f1-bf0dd0237c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:38.283501 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c3d2-5bdb-4fae-80f1-bf0dd0237c97 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:38.283777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c3d2-5bdb-4fae-80f1-bf0dd0237c97 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:38.284048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c3d2-5bdb-4fae-80f1-bf0dd0237c97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:38.297542 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53c3d2-5bdb-4fae-80f1-bf0dd0237c97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:38.299082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53c3d2-5bdb-4fae-80f1-bf0dd0237c97 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:38.302924 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 363/725] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:32:38.304503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3987fb-f83a-49c1-8090-247e8a62bb61 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:38.305088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3987fb-f83a-49c1-8090-247e8a62bb61 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:38.305596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3987fb-f83a-49c1-8090-247e8a62bb61 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:38.307289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 364/726] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:38.313379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514cde8-fb66-4906-a182-86616e6deacd None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:38.313379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514cde8-fb66-4906-a182-86616e6deacd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:38.313379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514cde8-fb66-4906-a182-86616e6deacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9d53c3d2-5bdb-4fae-80f1-bf0dd0237c97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:38.324436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:38.325361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:38.326273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:38.326273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:38.326273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:38.326273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:38.332218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4514cde8-fb66-4906-a182-86616e6deacd None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:38.332940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 363/727] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:38.333649 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4514cde8-fb66-4906-a182-86616e6deacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:38.338887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c3d2-5bdb-4fae-80f1-bf0dd0237c97 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:38.413052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 365/728] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 02:32:38.413942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514cde8-fb66-4906-a182-86616e6deacd None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:38.432870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:38.458925 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c3d2-5bdb-4fae-80f1-bf0dd0237c97 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:38.503246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03786c9-5fbf-4824-b55e-e2a70ca998b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:38.504017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03786c9-5fbf-4824-b55e-e2a70ca998b5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:38.504469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03786c9-5fbf-4824-b55e-e2a70ca998b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:38.505603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03786c9-5fbf-4824-b55e-e2a70ca998b5 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:38.506486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03786c9-5fbf-4824-b55e-e2a70ca998b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:38.506939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03786c9-5fbf-4824-b55e-e2a70ca998b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:38.508512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03786c9-5fbf-4824-b55e-e2a70ca998b5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:38.523569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 364/729] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:38.524309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03786c9-5fbf-4824-b55e-e2a70ca998b5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:38.545125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514cde8-fb66-4906-a182-86616e6deacd None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:38.562903 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:38.582786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6ab87-b917-4ceb-a1c0-fc2b2573783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:38.583673 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6ab87-b917-4ceb-a1c0-fc2b2573783a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:38.584089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6ab87-b917-4ceb-a1c0-fc2b2573783a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:38.584541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6ab87-b917-4ceb-a1c0-fc2b2573783a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:38.596006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6ab87-b917-4ceb-a1c0-fc2b2573783a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d2b6ab87-b917-4ceb-a1c0-fc2b2573783a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:38.601151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:38.602565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:38.603402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:38.603402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:38.603402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:38.603402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:38.603402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:38.603402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:38.603402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:38.603402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:38.603402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:38.603402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:38.603402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:38.603402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:38.611241 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 366/730] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:38.612443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6ab87-b917-4ceb-a1c0-fc2b2573783a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:38.654934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03786c9-5fbf-4824-b55e-e2a70ca998b5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:38.690985 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91094c1-f543-4bbe-a269-fc0382372dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:38.691175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91094c1-f543-4bbe-a269-fc0382372dc0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:38.691400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91094c1-f543-4bbe-a269-fc0382372dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:38.691646 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91094c1-f543-4bbe-a269-fc0382372dc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:38.702547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91094c1-f543-4bbe-a269-fc0382372dc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b91094c1-f543-4bbe-a269-fc0382372dc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:38.707473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:38.708426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:38.709253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:38.709253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:38.709253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:38.709253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:38.709253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:38.709253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:38.709253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:38.709253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:38.709253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:38.709253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:38.709253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:38.709253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:38.713638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 365/731] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:38.714605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91094c1-f543-4bbe-a269-fc0382372dc0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:38.718795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:38.726481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6ab87-b917-4ceb-a1c0-fc2b2573783a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:38.763164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe47ce1-ce24-4686-84c7-e26e60444a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:38.764172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe47ce1-ce24-4686-84c7-e26e60444a4a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:38.764670 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe47ce1-ce24-4686-84c7-e26e60444a4a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:38.765151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe47ce1-ce24-4686-84c7-e26e60444a4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:38.772983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe47ce1-ce24-4686-84c7-e26e60444a4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:38.774705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe47ce1-ce24-4686-84c7-e26e60444a4a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-bbe47ce1-ce24-4686-84c7-e26e60444a4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:38.786967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:38.787957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:38.788901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:38.788901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:38.788901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:38.788901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:38.788901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:38.788901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:38.788901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:38.788901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:38.788901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 02:32:38.788901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:38.795956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 367/732] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:38.797087 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe47ce1-ce24-4686-84c7-e26e60444a4a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:38.824242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91094c1-f543-4bbe-a269-fc0382372dc0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:38.837226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:38.861188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2f78-7215-46ba-a196-da20df1d4ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:38.862137 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2f78-7215-46ba-a196-da20df1d4ff0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:38.862247 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2f78-7215-46ba-a196-da20df1d4ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:38.862477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2f78-7215-46ba-a196-da20df1d4ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:38.863206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2f78-7215-46ba-a196-da20df1d4ff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:38.863526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2f78-7215-46ba-a196-da20df1d4ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:38.864992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe2f78-7215-46ba-a196-da20df1d4ff0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:38.878660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 366/733] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:38.878660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2f78-7215-46ba-a196-da20df1d4ff0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:38.915135 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe47ce1-ce24-4686-84c7-e26e60444a4a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:38.943634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:38.953459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6320a5-0261-4f0e-9f1d-dd5bbdc47192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:38.954406 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6320a5-0261-4f0e-9f1d-dd5bbdc47192 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:38.954965 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6320a5-0261-4f0e-9f1d-dd5bbdc47192 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:38.955426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6320a5-0261-4f0e-9f1d-dd5bbdc47192 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:38.956332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6320a5-0261-4f0e-9f1d-dd5bbdc47192 None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:38.956850 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6320a5-0261-4f0e-9f1d-dd5bbdc47192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:38.958656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6320a5-0261-4f0e-9f1d-dd5bbdc47192 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:38.968155 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 368/734] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:38.969247 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6320a5-0261-4f0e-9f1d-dd5bbdc47192 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:38.986705 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2f78-7215-46ba-a196-da20df1d4ff0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:39.022951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bfdb7-6d35-4c04-8b92-2b747338966a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:39.023583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bfdb7-6d35-4c04-8b92-2b747338966a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.023867 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bfdb7-6d35-4c04-8b92-2b747338966a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.024140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bfdb7-6d35-4c04-8b92-2b747338966a None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.024939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bfdb7-6d35-4c04-8b92-2b747338966a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:39.025244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bfdb7-6d35-4c04-8b92-2b747338966a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:39.026808 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bfdb7-6d35-4c04-8b92-2b747338966a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:39.058352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 367/735] 10.222.0.39 () {56 vars in 1135 bytes} [Tue Jul 26 02:32:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:39.058352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bfdb7-6d35-4c04-8b92-2b747338966a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:39.078031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:39.082224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6320a5-0261-4f0e-9f1d-dd5bbdc47192 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:39.118198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0933c6a-aaa7-48c7-aad9-38cec9b09671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:39.119231 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0933c6a-aaa7-48c7-aad9-38cec9b09671 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.119714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0933c6a-aaa7-48c7-aad9-38cec9b09671 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.120173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0933c6a-aaa7-48c7-aad9-38cec9b09671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.132008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0933c6a-aaa7-48c7-aad9-38cec9b09671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:39.133836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0933c6a-aaa7-48c7-aad9-38cec9b09671 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d0933c6a-aaa7-48c7-aad9-38cec9b09671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:39.148867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:39.150067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:39.150979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:39.150979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:39.150979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:39.150979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:39.157419 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 369/736] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:39.158519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0933c6a-aaa7-48c7-aad9-38cec9b09671 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:39.171814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bfdb7-6d35-4c04-8b92-2b747338966a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:39.196396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:39.208043 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4644c6d-0ec5-4cfc-8621-ed3b8cb426b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:39.208694 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4644c6d-0ec5-4cfc-8621-ed3b8cb426b2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.208971 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4644c6d-0ec5-4cfc-8621-ed3b8cb426b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.209237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4644c6d-0ec5-4cfc-8621-ed3b8cb426b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.219549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4644c6d-0ec5-4cfc-8621-ed3b8cb426b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:39.220998 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4644c6d-0ec5-4cfc-8621-ed3b8cb426b2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e4644c6d-0ec5-4cfc-8621-ed3b8cb426b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:39.235831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:39.236781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:39.237870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:39.237870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:39.237870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:39.237870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:39.237870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 368/737] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:39.238183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4644c6d-0ec5-4cfc-8621-ed3b8cb426b2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:39.262273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0933c6a-aaa7-48c7-aad9-38cec9b09671 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:39.294790 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2046588-254d-4109-9cd0-bfd064109b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:39.295426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2046588-254d-4109-9cd0-bfd064109b4d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.295704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2046588-254d-4109-9cd0-bfd064109b4d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.295968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2046588-254d-4109-9cd0-bfd064109b4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.314205 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:39.340888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4644c6d-0ec5-4cfc-8621-ed3b8cb426b2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:39.365863 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2046588-254d-4109-9cd0-bfd064109b4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:39.367366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2046588-254d-4109-9cd0-bfd064109b4d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:39.374544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84d227-0bd6-4dbe-9e88-425a9a733f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:39.375166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84d227-0bd6-4dbe-9e88-425a9a733f70 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.375449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84d227-0bd6-4dbe-9e88-425a9a733f70 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.375714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84d227-0bd6-4dbe-9e88-425a9a733f70 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.376398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84d227-0bd6-4dbe-9e88-425a9a733f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:39.376697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84d227-0bd6-4dbe-9e88-425a9a733f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:39.378076 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e84d227-0bd6-4dbe-9e88-425a9a733f70 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:39.394434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 369/738] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:39.394434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503da010-3b9a-49af-b7af-a191d880ee48 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.394434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503da010-3b9a-49af-b7af-a191d880ee48 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.394434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503da010-3b9a-49af-b7af-a191d880ee48 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.394434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 370/739] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:39.394434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668633-6603-4529-88fb-8ef5e494f2f6 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.394434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668633-6603-4529-88fb-8ef5e494f2f6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.395038 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668633-6603-4529-88fb-8ef5e494f2f6 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.395615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 371/740] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:39.396188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a668633-6603-4529-88fb-8ef5e494f2f6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:39.432473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:39.474861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 370/741] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 02:32:39.475888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2046588-254d-4109-9cd0-bfd064109b4d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:39.502207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a668633-6603-4529-88fb-8ef5e494f2f6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:39.523663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:39.537376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff1ded-d8b3-4aad-bad6-7f15473070c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:39.538008 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff1ded-d8b3-4aad-bad6-7f15473070c6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.538281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff1ded-d8b3-4aad-bad6-7f15473070c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.538556 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff1ded-d8b3-4aad-bad6-7f15473070c6 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.539233 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff1ded-d8b3-4aad-bad6-7f15473070c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:39.539536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff1ded-d8b3-4aad-bad6-7f15473070c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:39.540900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff1ded-d8b3-4aad-bad6-7f15473070c6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:39.552029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 372/742] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:39.553184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51185237-b672-444b-b65b-7260e46aabf2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.553490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51185237-b672-444b-b65b-7260e46aabf2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.553762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51185237-b672-444b-b65b-7260e46aabf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.570957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-51185237-b672-444b-b65b-7260e46aabf2 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:39.572140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-51185237-b672-444b-b65b-7260e46aabf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:39.576345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2046588-254d-4109-9cd0-bfd064109b4d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:39.611549 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15f4a8-04f6-4fd3-936e-10756f2af89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:39.612196 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15f4a8-04f6-4fd3-936e-10756f2af89a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.612478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15f4a8-04f6-4fd3-936e-10756f2af89a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.612752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15f4a8-04f6-4fd3-936e-10756f2af89a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.620108 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15f4a8-04f6-4fd3-936e-10756f2af89a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:39.621663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15f4a8-04f6-4fd3-936e-10756f2af89a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-dd15f4a8-04f6-4fd3-936e-10756f2af89a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:39.633482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:39.634449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:39.635371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:39.635371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:39.635371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:39.635371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:39.635371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:39.635371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:39.635371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:39.635371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:39.635371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:32:39.635371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:39.635371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 371/743] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 02:32:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:39.635944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa2897-d1b9-4179-b6d7-f64b8e393c23 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.636146 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa2897-d1b9-4179-b6d7-f64b8e393c23 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.636408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa2897-d1b9-4179-b6d7-f64b8e393c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.645506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 373/744] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:39.646362 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51185237-b672-444b-b65b-7260e46aabf2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:39.654129 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-32fa2897-d1b9-4179-b6d7-f64b8e393c23 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:39.655345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-32fa2897-d1b9-4179-b6d7-f64b8e393c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:39.678911 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:39.723020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 372/745] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 02:32:39.723646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa2897-d1b9-4179-b6d7-f64b8e393c23 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:39.754800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51185237-b672-444b-b65b-7260e46aabf2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:39.766418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:39.787435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bc5fa-9fe4-4973-80ff-626f0709bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:39.788302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc5fa-9fe4-4973-80ff-626f0709bee6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.788576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc5fa-9fe4-4973-80ff-626f0709bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.788843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bc5fa-9fe4-4973-80ff-626f0709bee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.798661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bc5fa-9fe4-4973-80ff-626f0709bee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:39.800103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bc5fa-9fe4-4973-80ff-626f0709bee6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-eb0bc5fa-9fe4-4973-80ff-626f0709bee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:39.815208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:39.816093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:39.817061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:39.817061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:39.817061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:39.817061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:39.817061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 374/746] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:39.817495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bc5fa-9fe4-4973-80ff-626f0709bee6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:39.826722 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa2897-d1b9-4179-b6d7-f64b8e393c23 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:39.861430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3df6f9-620f-4885-b6c5-ff504e2842b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:39.862090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3df6f9-620f-4885-b6c5-ff504e2842b8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.862373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3df6f9-620f-4885-b6c5-ff504e2842b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.862637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3df6f9-620f-4885-b6c5-ff504e2842b8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.869750 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3df6f9-620f-4885-b6c5-ff504e2842b8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:39.871398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3df6f9-620f-4885-b6c5-ff504e2842b8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-eb3df6f9-620f-4885-b6c5-ff504e2842b8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:39.883660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:39.884698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:39.885651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:39.885651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:39.885651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:39.885651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:39.885651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:39.885651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:39.885651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:39.885651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:39.885651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 02:32:39.885651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:39.885651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 373/747] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 02:32:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:39.886231 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3df6f9-620f-4885-b6c5-ff504e2842b8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:39.904492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:39.926309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bc5fa-9fe4-4973-80ff-626f0709bee6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:39.958539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fee1f-fcc4-4699-b9f7-f7eb82a2288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:39.959148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fee1f-fcc4-4699-b9f7-f7eb82a2288f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:39.959423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fee1f-fcc4-4699-b9f7-f7eb82a2288f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:39.959689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fee1f-fcc4-4699-b9f7-f7eb82a2288f None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:39.960478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fee1f-fcc4-4699-b9f7-f7eb82a2288f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:39.960779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fee1f-fcc4-4699-b9f7-f7eb82a2288f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:39.962227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fee1f-fcc4-4699-b9f7-f7eb82a2288f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:39.979395 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 375/748] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 02:32:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:39.980363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fee1f-fcc4-4699-b9f7-f7eb82a2288f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:39.980512 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:39.983960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3df6f9-620f-4885-b6c5-ff504e2842b8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:40.018096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad31ade-54d0-49be-8c86-2bc3ce5e4fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:40.018596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad31ade-54d0-49be-8c86-2bc3ce5e4fa8 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:40.018877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad31ade-54d0-49be-8c86-2bc3ce5e4fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:40.019152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad31ade-54d0-49be-8c86-2bc3ce5e4fa8 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:40.019851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad31ade-54d0-49be-8c86-2bc3ce5e4fa8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:40.021237 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad31ade-54d0-49be-8c86-2bc3ce5e4fa8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:40.040437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 374/749] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:32:39 2022] POST /identity/v3/services => generated 251 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:32:40.041260 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad31ade-54d0-49be-8c86-2bc3ce5e4fa8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:40.102310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fee1f-fcc4-4699-b9f7-f7eb82a2288f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:40.158237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:40.165486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766ea18-8e7b-475e-abd0-2d8fff6b48b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:40.166105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766ea18-8e7b-475e-abd0-2d8fff6b48b4 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:40.166386 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766ea18-8e7b-475e-abd0-2d8fff6b48b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:40.166673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766ea18-8e7b-475e-abd0-2d8fff6b48b4 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:40.167448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766ea18-8e7b-475e-abd0-2d8fff6b48b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:40.168839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766ea18-8e7b-475e-abd0-2d8fff6b48b4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:40.169885 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad31ade-54d0-49be-8c86-2bc3ce5e4fa8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:40.187059 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 376/750] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:32:39 2022] POST /identity/v3/services => generated 240 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:32:40.187904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766ea18-8e7b-475e-abd0-2d8fff6b48b4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:40.237933 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ee034-62c0-4494-810c-f388edf6812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:40.238680 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ee034-62c0-4494-810c-f388edf6812f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:40.239020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ee034-62c0-4494-810c-f388edf6812f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:40.240032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ee034-62c0-4494-810c-f388edf6812f None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:40.240155 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ee034-62c0-4494-810c-f388edf6812f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:40.240481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ee034-62c0-4494-810c-f388edf6812f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:40.242038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ee034-62c0-4494-810c-f388edf6812f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:40.256651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 375/751] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:40.257853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ee034-62c0-4494-810c-f388edf6812f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:40.287198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:40.324408 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766ea18-8e7b-475e-abd0-2d8fff6b48b4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:40.370848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e0e6a-4c71-46d4-a1d9-0a2e099266d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:40.371732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e0e6a-4c71-46d4-a1d9-0a2e099266d4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:40.372282 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e0e6a-4c71-46d4-a1d9-0a2e099266d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:40.373084 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e0e6a-4c71-46d4-a1d9-0a2e099266d4 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:40.374367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e0e6a-4c71-46d4-a1d9-0a2e099266d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:40.374822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e0e6a-4c71-46d4-a1d9-0a2e099266d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:40.376854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e0e6a-4c71-46d4-a1d9-0a2e099266d4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:40.396555 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 377/752] 10.222.0.39 () {56 vars in 1149 bytes} [Tue Jul 26 02:32:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:40.397718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ee034-62c0-4494-810c-f388edf6812f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:40.398239 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e0e6a-4c71-46d4-a1d9-0a2e099266d4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:40.443955 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2de68-7949-4bc3-918f-2379e04f9e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:40.445181 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2de68-7949-4bc3-918f-2379e04f9e85 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:40.445653 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2de68-7949-4bc3-918f-2379e04f9e85 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:40.446024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2de68-7949-4bc3-918f-2379e04f9e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:40.453721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:40.461191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2de68-7949-4bc3-918f-2379e04f9e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:40.463419 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2de68-7949-4bc3-918f-2379e04f9e85 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d9a2de68-7949-4bc3-918f-2379e04f9e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:40.484848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:40.486024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:40.487062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:40.487062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:40.487062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:40.487062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:40.487062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 376/753] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:40.487407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2de68-7949-4bc3-918f-2379e04f9e85 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:40.512895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e0e6a-4c71-46d4-a1d9-0a2e099266d4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:40.549845 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e43159-ff6c-4bff-add5-8f6decf555a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:40.550575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43159-ff6c-4bff-add5-8f6decf555a8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:40.550968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43159-ff6c-4bff-add5-8f6decf555a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:40.551332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e43159-ff6c-4bff-add5-8f6decf555a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:40.559880 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e43159-ff6c-4bff-add5-8f6decf555a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:40.561345 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e43159-ff6c-4bff-add5-8f6decf555a8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c9e43159-ff6c-4bff-add5-8f6decf555a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:40.574857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:40.575793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:40.576698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:40.576698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:40.576698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:40.576698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:40.576698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:40.576698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:40.576698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:40.576698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:40.576698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 378/754] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:40.577683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e43159-ff6c-4bff-add5-8f6decf555a8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:40.581470 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:40.625634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2de68-7949-4bc3-918f-2379e04f9e85 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:40.664817 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817478ca-aacf-4429-b63f-faa67cb5b011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:40.666140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817478ca-aacf-4429-b63f-faa67cb5b011 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:40.666140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817478ca-aacf-4429-b63f-faa67cb5b011 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:40.666140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817478ca-aacf-4429-b63f-faa67cb5b011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:40.702402 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e43159-ff6c-4bff-add5-8f6decf555a8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:40.721711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:40.740517 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d594f-8b00-41f8-ac14-3dad0deb3c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:40.741316 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d594f-8b00-41f8-ac14-3dad0deb3c7f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:40.741747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d594f-8b00-41f8-ac14-3dad0deb3c7f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:40.742276 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d594f-8b00-41f8-ac14-3dad0deb3c7f None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:40.743074 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d594f-8b00-41f8-ac14-3dad0deb3c7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:40.743993 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d594f-8b00-41f8-ac14-3dad0deb3c7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:40.745905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d594f-8b00-41f8-ac14-3dad0deb3c7f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:40.746139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817478ca-aacf-4429-b63f-faa67cb5b011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:40.748000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817478ca-aacf-4429-b63f-faa67cb5b011 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:40.761071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 379/755] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:40.766085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d594f-8b00-41f8-ac14-3dad0deb3c7f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:40.833140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:40.874519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 377/756] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:32:40.875408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817478ca-aacf-4429-b63f-faa67cb5b011 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:40.882268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d594f-8b00-41f8-ac14-3dad0deb3c7f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:40.919283 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bd79f-0473-4664-8586-a287ea9b75b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:40.920296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bd79f-0473-4664-8586-a287ea9b75b4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:40.920785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bd79f-0473-4664-8586-a287ea9b75b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:40.921524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bd79f-0473-4664-8586-a287ea9b75b4 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:40.922581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bd79f-0473-4664-8586-a287ea9b75b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:40.923115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bd79f-0473-4664-8586-a287ea9b75b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:40.924853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bd79f-0473-4664-8586-a287ea9b75b4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:40.938189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 380/757] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:40.939493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bd79f-0473-4664-8586-a287ea9b75b4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:40.972055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:40.975939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817478ca-aacf-4429-b63f-faa67cb5b011 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:41.011309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917b2ad-d551-4d02-a67a-9480cdeafe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:41.012106 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b2ad-d551-4d02-a67a-9480cdeafe88 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:41.012392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b2ad-d551-4d02-a67a-9480cdeafe88 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:41.012714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917b2ad-d551-4d02-a67a-9480cdeafe88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:41.021154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917b2ad-d551-4d02-a67a-9480cdeafe88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:41.022708 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917b2ad-d551-4d02-a67a-9480cdeafe88 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-e917b2ad-d551-4d02-a67a-9480cdeafe88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:41.036005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:41.036941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:41.037868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:41.037868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:41.037868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:41.037868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:41.037868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:41.037868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:41.037868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:41.037868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:41.041924 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 378/758] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:41.042844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917b2ad-d551-4d02-a67a-9480cdeafe88 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:41.053013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bd79f-0473-4664-8586-a287ea9b75b4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:41.073219 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:41.091147 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684b5f1-4f70-461a-a4b3-030cbb895578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:41.092179 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684b5f1-4f70-461a-a4b3-030cbb895578 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:41.092751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684b5f1-4f70-461a-a4b3-030cbb895578 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:41.093214 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684b5f1-4f70-461a-a4b3-030cbb895578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:41.105158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684b5f1-4f70-461a-a4b3-030cbb895578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:41.107367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684b5f1-4f70-461a-a4b3-030cbb895578 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-8684b5f1-4f70-461a-a4b3-030cbb895578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:41.122539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:41.123478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:41.124406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:41.124406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:41.124406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:41.124406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:41.126851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 381/759] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:41.127847 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684b5f1-4f70-461a-a4b3-030cbb895578 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:41.154249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917b2ad-d551-4d02-a67a-9480cdeafe88 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:41.194307 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa34f4-a3f2-48f1-b250-06d80b64ec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:41.195015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa34f4-a3f2-48f1-b250-06d80b64ec53 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:41.195300 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa34f4-a3f2-48f1-b250-06d80b64ec53 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:41.195573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa34f4-a3f2-48f1-b250-06d80b64ec53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:41.196520 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa34f4-a3f2-48f1-b250-06d80b64ec53 None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=f2365526802146088fcaa4afc2e03a35) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:41.196830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa34f4-a3f2-48f1-b250-06d80b64ec53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:41.198437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa34f4-a3f2-48f1-b250-06d80b64ec53 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:41.204894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 379/760] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:41 2022] GET /identity/v3/role_assignments?user.id=f2365526802146088fcaa4afc2e03a35&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:41.205863 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa34f4-a3f2-48f1-b250-06d80b64ec53 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:41.233602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:41.258259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684b5f1-4f70-461a-a4b3-030cbb895578 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:41.294728 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbc0e1-56ff-4439-8a83-0dc5b055457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:41.295687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbc0e1-56ff-4439-8a83-0dc5b055457e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:41.296181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbc0e1-56ff-4439-8a83-0dc5b055457e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:41.296629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbc0e1-56ff-4439-8a83-0dc5b055457e None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:41.297625 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbc0e1-56ff-4439-8a83-0dc5b055457e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:41.298123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbc0e1-56ff-4439-8a83-0dc5b055457e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:41.299804 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbc0e1-56ff-4439-8a83-0dc5b055457e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:41.313576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 382/761] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:41.319388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:41.319855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbc0e1-56ff-4439-8a83-0dc5b055457e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:41.335097 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa34f4-a3f2-48f1-b250-06d80b64ec53 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:41.375693 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844f591-4b8e-47a3-a0ee-3774fd58bdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:41.377021 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844f591-4b8e-47a3-a0ee-3774fd58bdd0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:41.377572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844f591-4b8e-47a3-a0ee-3774fd58bdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:41.378271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844f591-4b8e-47a3-a0ee-3774fd58bdd0 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:41.379771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844f591-4b8e-47a3-a0ee-3774fd58bdd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:41.380311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844f591-4b8e-47a3-a0ee-3774fd58bdd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:41.382724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844f591-4b8e-47a3-a0ee-3774fd58bdd0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:41.398439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 380/762] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:41.405386 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844f591-4b8e-47a3-a0ee-3774fd58bdd0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:41.490293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbc0e1-56ff-4439-8a83-0dc5b055457e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:41.531012 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844f591-4b8e-47a3-a0ee-3774fd58bdd0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:41.533449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c7f0a-715b-4924-8722-4795f2f112d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:41.534777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c7f0a-715b-4924-8722-4795f2f112d6 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:41.534777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c7f0a-715b-4924-8722-4795f2f112d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:41.534777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c7f0a-715b-4924-8722-4795f2f112d6 None admin] PATH_INFO: `/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/338b2744014940ca96c08d4e9262697b/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:41.536667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c7f0a-715b-4924-8722-4795f2f112d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b017927d64b44db8a1611f20e6e3b6f5, user_id=338b2744014940ca96c08d4e9262697b, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:41.538964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c7f0a-715b-4924-8722-4795f2f112d6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:41.573333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 383/763] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:32:41 2022] PUT /identity/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/338b2744014940ca96c08d4e9262697b/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:32:41.576564 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589371e-d18e-4e37-af68-fc841a667d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:41.577481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589371e-d18e-4e37-af68-fc841a667d6a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:41.578020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589371e-d18e-4e37-af68-fc841a667d6a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:41.578484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589371e-d18e-4e37-af68-fc841a667d6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:41.587176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589371e-d18e-4e37-af68-fc841a667d6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:41.589490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589371e-d18e-4e37-af68-fc841a667d6a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-5589371e-d18e-4e37-af68-fc841a667d6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:41.602439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:41.603395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:41.604317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:41.604317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:41.604317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:41.604317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:41.604317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:41.604317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:41.604317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:41.604317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:41.606886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 381/764] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:41.614642 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c7f0a-715b-4924-8722-4795f2f112d6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:41.624821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:41.727581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c7f0a-715b-4924-8722-4795f2f112d6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:41.764616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799f354-0ae2-4a4a-a97c-d25b409a7911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:41.765261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799f354-0ae2-4a4a-a97c-d25b409a7911 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:41.765564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799f354-0ae2-4a4a-a97c-d25b409a7911 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:41.765831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799f354-0ae2-4a4a-a97c-d25b409a7911 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:41.766598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799f354-0ae2-4a4a-a97c-d25b409a7911 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:41.766907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799f354-0ae2-4a4a-a97c-d25b409a7911 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:41.768366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799f354-0ae2-4a4a-a97c-d25b409a7911 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:41.781685 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 384/765] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:41.787703 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589371e-d18e-4e37-af68-fc841a667d6a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:41.803979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:41.920037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589371e-d18e-4e37-af68-fc841a667d6a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:41.958650 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3993e4c-1f7b-4889-a82a-5e0f19d4fcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:41.959286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993e4c-1f7b-4889-a82a-5e0f19d4fcf5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:41.959563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993e4c-1f7b-4889-a82a-5e0f19d4fcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:41.959832 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3993e4c-1f7b-4889-a82a-5e0f19d4fcf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:41.960624 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3993e4c-1f7b-4889-a82a-5e0f19d4fcf5 None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=1a3ecd4bf47a4842b522ccdb575203d6) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:41.960932 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3993e4c-1f7b-4889-a82a-5e0f19d4fcf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:41.962403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3993e4c-1f7b-4889-a82a-5e0f19d4fcf5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:41.968912 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 382/766] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:41 2022] GET /identity/v3/role_assignments?user.id=1a3ecd4bf47a4842b522ccdb575203d6&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:42.207877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13856fd-b103-4519-92c9-9fd6911e896f None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:42.208372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13856fd-b103-4519-92c9-9fd6911e896f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:42.208372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13856fd-b103-4519-92c9-9fd6911e896f None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:42.209990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 385/767] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:42.215161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7759aa-4df0-4023-914a-a955133ea1c9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:42.215448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7759aa-4df0-4023-914a-a955133ea1c9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:42.215722 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7759aa-4df0-4023-914a-a955133ea1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:42.241498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-8a7759aa-4df0-4023-914a-a955133ea1c9 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:42.242690 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8a7759aa-4df0-4023-914a-a955133ea1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:42.335705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 383/768] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:32:42.358358 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13856fd-b103-4519-92c9-9fd6911e896f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:42.450118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:42.500069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13856fd-b103-4519-92c9-9fd6911e896f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:42.534690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619ed9e-f990-423c-8345-a069d006eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:42.535759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619ed9e-f990-423c-8345-a069d006eddb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:42.536270 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619ed9e-f990-423c-8345-a069d006eddb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:42.536735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619ed9e-f990-423c-8345-a069d006eddb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:42.537641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619ed9e-f990-423c-8345-a069d006eddb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:42.539233 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619ed9e-f990-423c-8345-a069d006eddb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-f619ed9e-f990-423c-8345-a069d006eddb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:42.553146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:42.554142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 02:32:42.555005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:42.557507 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 386/769] 10.222.0.39 () {56 vars in 1129 bytes} [Tue Jul 26 02:32:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:42.563354 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7759aa-4df0-4023-914a-a955133ea1c9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:42.589732 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:42.703207 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7759aa-4df0-4023-914a-a955133ea1c9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:42.718067 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba814e06-7437-4078-97eb-a6f205b88805 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:42.718682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba814e06-7437-4078-97eb-a6f205b88805 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:42.719184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba814e06-7437-4078-97eb-a6f205b88805 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:42.724499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 387/770] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:32:42.725939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51445d-baea-4633-8499-e43f903598c3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:42.726288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51445d-baea-4633-8499-e43f903598c3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:42.726993 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51445d-baea-4633-8499-e43f903598c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:42.748861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aeb20-7b95-42d3-8ad0-0f241611fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:42.749816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aeb20-7b95-42d3-8ad0-0f241611fb4d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:42.750319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aeb20-7b95-42d3-8ad0-0f241611fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:42.750754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8aeb20-7b95-42d3-8ad0-0f241611fb4d None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:42.751610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aeb20-7b95-42d3-8ad0-0f241611fb4d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:42.752094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aeb20-7b95-42d3-8ad0-0f241611fb4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:42.754824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8aeb20-7b95-42d3-8ad0-0f241611fb4d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:42.761825 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2a51445d-baea-4633-8499-e43f903598c3 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:42.764975 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2a51445d-baea-4633-8499-e43f903598c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:42.765427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 384/771] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Jul 26 02:32:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:42.769016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aeb20-7b95-42d3-8ad0-0f241611fb4d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:42.874929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 388/772] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:32:42.876775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:42.907450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51445d-baea-4633-8499-e43f903598c3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:42.907720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8aeb20-7b95-42d3-8ad0-0f241611fb4d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:42.942036 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed9c61-1ff7-4412-b5ee-985b0888c459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:42.942632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed9c61-1ff7-4412-b5ee-985b0888c459 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:42.942918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed9c61-1ff7-4412-b5ee-985b0888c459 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:42.943189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed9c61-1ff7-4412-b5ee-985b0888c459 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:42.943876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed9c61-1ff7-4412-b5ee-985b0888c459 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:42.944184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed9c61-1ff7-4412-b5ee-985b0888c459 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:42.945584 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed9c61-1ff7-4412-b5ee-985b0888c459 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:42.950778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 385/773] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Jul 26 02:32:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:42.956415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed9c61-1ff7-4412-b5ee-985b0888c459 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:43.025725 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:43.054934 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed9c61-1ff7-4412-b5ee-985b0888c459 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:43.089014 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621ce27-a7ab-451b-83ed-80f96b6cbab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:43.089679 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621ce27-a7ab-451b-83ed-80f96b6cbab3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:43.089959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621ce27-a7ab-451b-83ed-80f96b6cbab3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:43.090230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621ce27-a7ab-451b-83ed-80f96b6cbab3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:43.090996 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621ce27-a7ab-451b-83ed-80f96b6cbab3 None admin] RBAC: Adding query filter params (interface=public, service_id=f93172b5942c4289ba522f03ed9e8074, region_id=RegionOne) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:43.091310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621ce27-a7ab-451b-83ed-80f96b6cbab3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:43.092688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621ce27-a7ab-451b-83ed-80f96b6cbab3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:43.094487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:43.101125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 386/774] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 02:32:42 2022] GET /identity/v3/endpoints?service_id=f93172b5942c4289ba522f03ed9e8074&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:43.105497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51445d-baea-4633-8499-e43f903598c3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:43.107902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621ce27-a7ab-451b-83ed-80f96b6cbab3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:43.194985 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cc16-622b-441a-8756-b72d09f060dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:43.195658 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cc16-622b-441a-8756-b72d09f060dc None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:43.195942 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cc16-622b-441a-8756-b72d09f060dc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:43.196218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cc16-622b-441a-8756-b72d09f060dc None admin] PATH_INFO: `/v3/services/network` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:43.196861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9cc16-622b-441a-8756-b72d09f060dc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:43.201320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9cc16-622b-441a-8756-b72d09f060dc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-40e9cc16-622b-441a-8756-b72d09f060dc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:43.214549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:43.215988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 02:32:43.217340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:43.226088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 389/775] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:42 2022] GET /identity/v3/services/network => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:43.227420 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cc16-622b-441a-8756-b72d09f060dc None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:43.247028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621ce27-a7ab-451b-83ed-80f96b6cbab3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:43.283388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a546c0-bc15-420b-8760-537789808946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:43.283940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a546c0-bc15-420b-8760-537789808946 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:43.284227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a546c0-bc15-420b-8760-537789808946 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:43.284508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a546c0-bc15-420b-8760-537789808946 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:43.285175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a546c0-bc15-420b-8760-537789808946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:43.286810 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a546c0-bc15-420b-8760-537789808946 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:43.293806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 387/776] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 02:32:43 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:43.427461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cc16-622b-441a-8756-b72d09f060dc None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:43.456939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:43.475051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64504c77-e752-403d-8299-8b4fc82c6916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:43.476036 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64504c77-e752-403d-8299-8b4fc82c6916 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:43.476873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64504c77-e752-403d-8299-8b4fc82c6916 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:43.477394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64504c77-e752-403d-8299-8b4fc82c6916 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:43.478281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64504c77-e752-403d-8299-8b4fc82c6916 None admin] RBAC: Adding query filter params (name=network) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:43.478780 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64504c77-e752-403d-8299-8b4fc82c6916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:43.480384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64504c77-e752-403d-8299-8b4fc82c6916 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:43.486125 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 390/777] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 02:32:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:43.491884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a546c0-bc15-420b-8760-537789808946 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:43.565848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:43.608602 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a546c0-bc15-420b-8760-537789808946 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:43.640049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a46d3-98d0-425c-b9f2-e5999ee1411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:43.640690 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a46d3-98d0-425c-b9f2-e5999ee1411d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:43.641006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a46d3-98d0-425c-b9f2-e5999ee1411d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:43.641323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a46d3-98d0-425c-b9f2-e5999ee1411d None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:43.641993 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a46d3-98d0-425c-b9f2-e5999ee1411d None admin] RBAC: Adding query filter params (type=network) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:43.642348 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a46d3-98d0-425c-b9f2-e5999ee1411d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:43.643741 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a46d3-98d0-425c-b9f2-e5999ee1411d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:43.650589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 388/778] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 02:32:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:43.656194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64504c77-e752-403d-8299-8b4fc82c6916 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:43.722961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee0c2-16c3-484e-950f-1c6600e35d1b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:43.723283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee0c2-16c3-484e-950f-1c6600e35d1b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:43.723510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee0c2-16c3-484e-950f-1c6600e35d1b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:43.725158 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 389/779] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:32:43.730598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a79ce5-72a2-4070-a43c-f32b1b1e11f2 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:43.730876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a79ce5-72a2-4070-a43c-f32b1b1e11f2 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:43.731142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a79ce5-72a2-4070-a43c-f32b1b1e11f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:43.765999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-09a79ce5-72a2-4070-a43c-f32b1b1e11f2 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:43.767192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-09a79ce5-72a2-4070-a43c-f32b1b1e11f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:43.806450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64504c77-e752-403d-8299-8b4fc82c6916 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:43.867692 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1185-15a7-4f0e-ba59-2ce33b048b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:43.868318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1185-15a7-4f0e-ba59-2ce33b048b43 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:43.868592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1185-15a7-4f0e-ba59-2ce33b048b43 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:43.868854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c1185-15a7-4f0e-ba59-2ce33b048b43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:43.869636 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c1185-15a7-4f0e-ba59-2ce33b048b43 None admin] RBAC: Adding query filter params (interface=public, service_id=36ad7e9ca57d4aef9985f43fc081b2d0, region_id=RegionOne) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:43.869941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c1185-15a7-4f0e-ba59-2ce33b048b43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:43.871336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c1185-15a7-4f0e-ba59-2ce33b048b43 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:43.883913 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 391/780] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 02:32:43 2022] GET /identity/v3/endpoints?service_id=36ad7e9ca57d4aef9985f43fc081b2d0&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:43.887706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 390/781] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:32:43.888612 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1185-15a7-4f0e-ba59-2ce33b048b43 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:43.941486 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a79ce5-72a2-4070-a43c-f32b1b1e11f2 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:43.974371 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:44.018549 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:44.062504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c1185-15a7-4f0e-ba59-2ce33b048b43 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:44.067079 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a79ce5-72a2-4070-a43c-f32b1b1e11f2 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:44.105577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f9a3a-33cb-4da8-b672-3655f348b244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:44.106232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f9a3a-33cb-4da8-b672-3655f348b244 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:44.106507 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f9a3a-33cb-4da8-b672-3655f348b244 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:44.106776 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f9a3a-33cb-4da8-b672-3655f348b244 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:44.121076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f9a3a-33cb-4da8-b672-3655f348b244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:44.125438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568f13a-c16b-4067-ba01-b1a9383ef821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:44.126074 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568f13a-c16b-4067-ba01-b1a9383ef821 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:44.126361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568f13a-c16b-4067-ba01-b1a9383ef821 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:44.126632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568f13a-c16b-4067-ba01-b1a9383ef821 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:44.127299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568f13a-c16b-4067-ba01-b1a9383ef821 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:44.128676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568f13a-c16b-4067-ba01-b1a9383ef821 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-5a1f9a3a-33cb-4da8-b672-3655f348b244 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:44.134345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:44.135816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:44.136909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:44.136909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:44.136909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:44.136909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:44.136909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:44.136909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:44.136909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:44.136909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:44.136909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:44.136909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:44.136909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:44.136909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:44.137752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 392/782] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 02:32:43 2022] GET /identity/v3/services => generated 772 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:44.137840 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 391/783] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:44.141796 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568f13a-c16b-4067-ba01-b1a9383ef821 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:44.253312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568f13a-c16b-4067-ba01-b1a9383ef821 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:44.267108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:44.271542 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355d2a9-d92a-4ad6-99db-2dd709b87e78 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:44.272654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355d2a9-d92a-4ad6-99db-2dd709b87e78 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:44.272933 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355d2a9-d92a-4ad6-99db-2dd709b87e78 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:44.274668 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 392/784] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:44.280544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acc24a-0381-4e9a-95c2-43aa591d7260 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:44.280847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acc24a-0381-4e9a-95c2-43aa591d7260 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:44.281085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acc24a-0381-4e9a-95c2-43aa591d7260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:44.313319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-61acc24a-0381-4e9a-95c2-43aa591d7260 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:44.314036 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44818c99-43a8-4ef1-983a-069d01149337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:44.314682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44818c99-43a8-4ef1-983a-069d01149337 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:44.314955 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44818c99-43a8-4ef1-983a-069d01149337 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:44.315220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44818c99-43a8-4ef1-983a-069d01149337 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:44.315954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44818c99-43a8-4ef1-983a-069d01149337 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:44.316256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44818c99-43a8-4ef1-983a-069d01149337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:44.317672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44818c99-43a8-4ef1-983a-069d01149337 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:44.320533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-61acc24a-0381-4e9a-95c2-43aa591d7260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:44.336977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 393/785] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:44.343181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44818c99-43a8-4ef1-983a-069d01149337 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:44.425813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 393/786] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:32:44.454574 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acc24a-0381-4e9a-95c2-43aa591d7260 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:44.470881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44818c99-43a8-4ef1-983a-069d01149337 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:44.509642 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7bdc8-e092-4232-976f-6edf8eab92f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:44.510297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7bdc8-e092-4232-976f-6edf8eab92f3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:44.510582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7bdc8-e092-4232-976f-6edf8eab92f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:44.510917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7bdc8-e092-4232-976f-6edf8eab92f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:44.521700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:44.522070 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7bdc8-e092-4232-976f-6edf8eab92f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:44.523595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7bdc8-e092-4232-976f-6edf8eab92f3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-10b7bdc8-e092-4232-976f-6edf8eab92f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:44.540259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:44.542497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:44.544577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:44.544577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:44.544577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:44.544577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:44.544577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 394/787] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:44.544577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3dbb0-8ce9-4a3a-a84f-b069f922c856 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:44.544577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3dbb0-8ce9-4a3a-a84f-b069f922c856 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:44.544577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3dbb0-8ce9-4a3a-a84f-b069f922c856 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:44.549664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 395/788] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:44.550430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3dbb0-8ce9-4a3a-a84f-b069f922c856 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:44.571658 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acc24a-0381-4e9a-95c2-43aa591d7260 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:44.583159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:44.614033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b414f6e-cb13-4edb-bba5-d675c6be79b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:44.614683 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b414f6e-cb13-4edb-bba5-d675c6be79b0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:44.614961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b414f6e-cb13-4edb-bba5-d675c6be79b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:44.615228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b414f6e-cb13-4edb-bba5-d675c6be79b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:44.629318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b414f6e-cb13-4edb-bba5-d675c6be79b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-3b414f6e-cb13-4edb-bba5-d675c6be79b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:44.635568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:44.636593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:44.637762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:44.637762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:44.637762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:44.637762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:44.637762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:44.637762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:44.637762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:44.637762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:44.637762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:44.637762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:44.637762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:44.637762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:44.637762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 394/789] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:44.643652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe79ee7-9a22-4ca3-9b20-687e0b1b7405 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:44.643934 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe79ee7-9a22-4ca3-9b20-687e0b1b7405 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:44.644208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe79ee7-9a22-4ca3-9b20-687e0b1b7405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:44.666738 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2fe79ee7-9a22-4ca3-9b20-687e0b1b7405 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:44.668331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2fe79ee7-9a22-4ca3-9b20-687e0b1b7405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:44.670901 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3dbb0-8ce9-4a3a-a84f-b069f922c856 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:44.712841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50957e-a9fa-4812-9187-36060a505c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:44.713408 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50957e-a9fa-4812-9187-36060a505c2e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:44.713686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50957e-a9fa-4812-9187-36060a505c2e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:44.713991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50957e-a9fa-4812-9187-36060a505c2e None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:44.714731 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50957e-a9fa-4812-9187-36060a505c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:44.715030 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50957e-a9fa-4812-9187-36060a505c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:44.716404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50957e-a9fa-4812-9187-36060a505c2e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:44.737252 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 396/790] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:44.737252 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50957e-a9fa-4812-9187-36060a505c2e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:44.761315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 395/791] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:32:44.761315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe79ee7-9a22-4ca3-9b20-687e0b1b7405 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:44.800261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:44.851891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:44.870156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50957e-a9fa-4812-9187-36060a505c2e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:44.878932 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe79ee7-9a22-4ca3-9b20-687e0b1b7405 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:44.911446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef281730-7cfc-42bd-a4dc-dd5ec0cf66c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:44.912072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef281730-7cfc-42bd-a4dc-dd5ec0cf66c1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:44.912352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef281730-7cfc-42bd-a4dc-dd5ec0cf66c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:44.912624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef281730-7cfc-42bd-a4dc-dd5ec0cf66c1 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:44.913357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef281730-7cfc-42bd-a4dc-dd5ec0cf66c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:44.913662 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef281730-7cfc-42bd-a4dc-dd5ec0cf66c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:44.915015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef281730-7cfc-42bd-a4dc-dd5ec0cf66c1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:44.916727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50a953-dc8b-4edc-91ea-aeed46839d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:44.917742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50a953-dc8b-4edc-91ea-aeed46839d2f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:44.918221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50a953-dc8b-4edc-91ea-aeed46839d2f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:44.918702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50a953-dc8b-4edc-91ea-aeed46839d2f None admin] PATH_INFO: `/v3/users/swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:44.925368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 397/792] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:44.926465 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef281730-7cfc-42bd-a4dc-dd5ec0cf66c1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:44.930250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50a953-dc8b-4edc-91ea-aeed46839d2f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:44.932664 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50a953-dc8b-4edc-91ea-aeed46839d2f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-7c50a953-dc8b-4edc-91ea-aeed46839d2f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:44.948334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:44.949378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:44.950325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:44.950325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:44.950325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:44.950325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:44.950325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:44.950325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:44.950325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:44.950325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:44.950325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 02:32:44.950325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:44.953482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 396/793] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:44.954493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50a953-dc8b-4edc-91ea-aeed46839d2f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:45.049912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef281730-7cfc-42bd-a4dc-dd5ec0cf66c1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:45.061133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:45.069411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50a953-dc8b-4edc-91ea-aeed46839d2f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:45.090466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347d5dd-96e9-448b-824b-b272ea37aef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:45.091110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347d5dd-96e9-448b-824b-b272ea37aef4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:45.091383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347d5dd-96e9-448b-824b-b272ea37aef4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:45.091648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347d5dd-96e9-448b-824b-b272ea37aef4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:45.106591 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347d5dd-96e9-448b-824b-b272ea37aef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:45.109737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2b511-8d22-4105-907d-3c7ffcdf6d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:45.110659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2b511-8d22-4105-907d-3c7ffcdf6d4e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:45.111156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2b511-8d22-4105-907d-3c7ffcdf6d4e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:45.111627 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2b511-8d22-4105-907d-3c7ffcdf6d4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-d347d5dd-96e9-448b-824b-b272ea37aef4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:45.111856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:45.112763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:45.113640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:45.113640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:45.113640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:45.113640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:45.113640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:45.113640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:45.113640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:45.113640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:45.113640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:45.113640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:45.113640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:45.113640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:45.113640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 398/794] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:45.114334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347d5dd-96e9-448b-824b-b272ea37aef4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:45.126898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:45.132578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2b511-8d22-4105-907d-3c7ffcdf6d4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:45.134490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2b511-8d22-4105-907d-3c7ffcdf6d4e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-64c2b511-8d22-4105-907d-3c7ffcdf6d4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:45.151577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:45.152684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:45.153616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:45.153616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:45.153616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:45.153616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:45.154158 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 397/795] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:45.158078 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2b511-8d22-4105-907d-3c7ffcdf6d4e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:45.216843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347d5dd-96e9-448b-824b-b272ea37aef4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:45.251568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02c77f-26a5-4b92-b8b4-37291400d022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:45.252190 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02c77f-26a5-4b92-b8b4-37291400d022 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:45.252472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02c77f-26a5-4b92-b8b4-37291400d022 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:45.252747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02c77f-26a5-4b92-b8b4-37291400d022 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:45.253586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02c77f-26a5-4b92-b8b4-37291400d022 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:45.254185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02c77f-26a5-4b92-b8b4-37291400d022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:45.255319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02c77f-26a5-4b92-b8b4-37291400d022 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:45.264246 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2b511-8d22-4105-907d-3c7ffcdf6d4e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:45.273332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 399/796] 10.222.0.39 () {56 vars in 1135 bytes} [Tue Jul 26 02:32:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:45.274178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02c77f-26a5-4b92-b8b4-37291400d022 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:45.301855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531b8a4-8dab-4b41-ba8b-70884b19108d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:45.302404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b8a4-8dab-4b41-ba8b-70884b19108d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:45.302733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b8a4-8dab-4b41-ba8b-70884b19108d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:45.303007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b8a4-8dab-4b41-ba8b-70884b19108d None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:45.303829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531b8a4-8dab-4b41-ba8b-70884b19108d None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:45.304140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531b8a4-8dab-4b41-ba8b-70884b19108d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:45.305717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531b8a4-8dab-4b41-ba8b-70884b19108d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:45.314980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 398/797] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:45.316031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531b8a4-8dab-4b41-ba8b-70884b19108d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:45.329909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:45.344458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:45.380170 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02c77f-26a5-4b92-b8b4-37291400d022 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:45.414893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd72906-ce07-47f9-b5cd-cdbc9ff95a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:45.415523 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd72906-ce07-47f9-b5cd-cdbc9ff95a59 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:45.415807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd72906-ce07-47f9-b5cd-cdbc9ff95a59 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:45.416081 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd72906-ce07-47f9-b5cd-cdbc9ff95a59 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:45.416895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd72906-ce07-47f9-b5cd-cdbc9ff95a59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:45.417161 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd72906-ce07-47f9-b5cd-cdbc9ff95a59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:45.418616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd72906-ce07-47f9-b5cd-cdbc9ff95a59 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:45.431389 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 400/798] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:45.432206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd72906-ce07-47f9-b5cd-cdbc9ff95a59 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:45.434261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531b8a4-8dab-4b41-ba8b-70884b19108d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:45.473274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f819f-f32d-4f51-b22a-a191fdf84801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:45.474321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f819f-f32d-4f51-b22a-a191fdf84801 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:45.474748 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f819f-f32d-4f51-b22a-a191fdf84801 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:45.475198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f819f-f32d-4f51-b22a-a191fdf84801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:45.488118 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f819f-f32d-4f51-b22a-a191fdf84801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:45.489982 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f819f-f32d-4f51-b22a-a191fdf84801 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-f94f819f-f32d-4f51-b22a-a191fdf84801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:45.506052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:45.507154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:45.508143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:45.508143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:45.508143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:45.508143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:45.509998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 399/799] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:45.511181 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f819f-f32d-4f51-b22a-a191fdf84801 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:45.536855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd72906-ce07-47f9-b5cd-cdbc9ff95a59 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:45.562795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:45.572053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe41557-a516-48fc-97a7-1853611eea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:45.572873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe41557-a516-48fc-97a7-1853611eea0e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:45.573132 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe41557-a516-48fc-97a7-1853611eea0e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:45.573258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe41557-a516-48fc-97a7-1853611eea0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:45.582367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:45.584488 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe41557-a516-48fc-97a7-1853611eea0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:45.585977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe41557-a516-48fc-97a7-1853611eea0e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-bfe41557-a516-48fc-97a7-1853611eea0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:45.601005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:45.602509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:45.603439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:45.603439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:45.603439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:45.603439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:45.607363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 401/800] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:45.608287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe41557-a516-48fc-97a7-1853611eea0e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:45.629404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f819f-f32d-4f51-b22a-a191fdf84801 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:45.669930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e8eac-bc1e-4e6e-9422-42b1f9fe83a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:45.671018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e8eac-bc1e-4e6e-9422-42b1f9fe83a1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:45.671496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e8eac-bc1e-4e6e-9422-42b1f9fe83a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:45.671961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e8eac-bc1e-4e6e-9422-42b1f9fe83a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:45.680450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e8eac-bc1e-4e6e-9422-42b1f9fe83a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:45.682595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e8eac-bc1e-4e6e-9422-42b1f9fe83a1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-c66e8eac-bc1e-4e6e-9422-42b1f9fe83a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:45.695184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:45.696318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:45.697532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:45.697532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:45.697532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:45.697532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:45.697532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:45.697532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:45.697532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:45.697532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:45.697532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:32:45.697532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:45.703256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 400/801] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 02:32:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:45.703256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e8eac-bc1e-4e6e-9422-42b1f9fe83a1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:45.712058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe41557-a516-48fc-97a7-1853611eea0e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:45.749256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40b65c-12ed-4752-b0e8-20cfb39305ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:45.749909 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40b65c-12ed-4752-b0e8-20cfb39305ac None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:45.750189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40b65c-12ed-4752-b0e8-20cfb39305ac None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:45.750515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40b65c-12ed-4752-b0e8-20cfb39305ac None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:45.751165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40b65c-12ed-4752-b0e8-20cfb39305ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:45.751681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40b65c-12ed-4752-b0e8-20cfb39305ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:45.752819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40b65c-12ed-4752-b0e8-20cfb39305ac None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:45.770470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 402/802] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:45.770470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff235a-90cf-41d4-ac37-e18a97299071 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:45.770470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff235a-90cf-41d4-ac37-e18a97299071 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:45.770470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff235a-90cf-41d4-ac37-e18a97299071 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:45.770470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 403/803] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:45.770470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff235a-90cf-41d4-ac37-e18a97299071 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:45.813983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:45.815153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e8eac-bc1e-4e6e-9422-42b1f9fe83a1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:45.838011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:45.850267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d85bd-a91b-4664-95a1-39486be5cd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:45.850971 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d85bd-a91b-4664-95a1-39486be5cd33 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:45.851635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d85bd-a91b-4664-95a1-39486be5cd33 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:45.851911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d85bd-a91b-4664-95a1-39486be5cd33 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:45.852596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d85bd-a91b-4664-95a1-39486be5cd33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:45.852905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d85bd-a91b-4664-95a1-39486be5cd33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:45.854352 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d85bd-a91b-4664-95a1-39486be5cd33 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:45.866942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 401/804] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:45.868004 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d85bd-a91b-4664-95a1-39486be5cd33 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:45.882010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff235a-90cf-41d4-ac37-e18a97299071 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:45.919203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68834595-610c-45a5-80ce-0d3b8b438767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:45.919929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834595-610c-45a5-80ce-0d3b8b438767 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:45.920200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834595-610c-45a5-80ce-0d3b8b438767 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:45.920469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68834595-610c-45a5-80ce-0d3b8b438767 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:45.921272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68834595-610c-45a5-80ce-0d3b8b438767 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:45.921622 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68834595-610c-45a5-80ce-0d3b8b438767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:45.923054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68834595-610c-45a5-80ce-0d3b8b438767 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:45.941393 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 404/805] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 02:32:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:45.942718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048a78e-6d23-4a1a-9b46-6bce11ba7fd3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:45.943023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048a78e-6d23-4a1a-9b46-6bce11ba7fd3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:45.943280 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048a78e-6d23-4a1a-9b46-6bce11ba7fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:45.960587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2048a78e-6d23-4a1a-9b46-6bce11ba7fd3 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:45.961803 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2048a78e-6d23-4a1a-9b46-6bce11ba7fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:45.981543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d85bd-a91b-4664-95a1-39486be5cd33 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:46.015943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93f27-b17f-4fc4-baef-6166bbdc7851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:46.016600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93f27-b17f-4fc4-baef-6166bbdc7851 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:46.016882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93f27-b17f-4fc4-baef-6166bbdc7851 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:46.017152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b93f27-b17f-4fc4-baef-6166bbdc7851 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:46.024032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b93f27-b17f-4fc4-baef-6166bbdc7851 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:46.025517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b93f27-b17f-4fc4-baef-6166bbdc7851 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:46.045595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 405/806] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:32:46.045595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048a78e-6d23-4a1a-9b46-6bce11ba7fd3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b7b93f27-b17f-4fc4-baef-6166bbdc7851 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:46.045894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:46.046905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:46.048000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:46.048000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:46.048000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:46.048000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:46.048000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:46.048000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:46.048000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:46.048000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:46.048000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 402/807] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:46.048000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93f27-b17f-4fc4-baef-6166bbdc7851 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:46.079961 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:46.096987 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:46.152237 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b93f27-b17f-4fc4-baef-6166bbdc7851 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:46.162073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048a78e-6d23-4a1a-9b46-6bce11ba7fd3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:46.189931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96837331-1a3f-4ec9-9a3b-ad5fc5121b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:46.190560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837331-1a3f-4ec9-9a3b-ad5fc5121b3d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:46.190840 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837331-1a3f-4ec9-9a3b-ad5fc5121b3d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:46.191122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837331-1a3f-4ec9-9a3b-ad5fc5121b3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:46.199448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023204a-c3d2-4489-a871-a44784a0d299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:46.200098 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023204a-c3d2-4489-a871-a44784a0d299 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:46.200644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023204a-c3d2-4489-a871-a44784a0d299 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:46.200644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0023204a-c3d2-4489-a871-a44784a0d299 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:46.208086 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023204a-c3d2-4489-a871-a44784a0d299 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:46.209568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0023204a-c3d2-4489-a871-a44784a0d299 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0023204a-c3d2-4489-a871-a44784a0d299 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:46.222145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:46.223153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:46.224140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:46.224140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:46.224140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:46.224140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:46.224140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:46.224140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:46.224140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:46.224140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:46.224140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 02:32:46.224140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:46.224140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 406/808] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 02:32:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:46.224140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023204a-c3d2-4489-a871-a44784a0d299 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:46.268442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96837331-1a3f-4ec9-9a3b-ad5fc5121b3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:46.270032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96837331-1a3f-4ec9-9a3b-ad5fc5121b3d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:46.313635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:46.316535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:46.332642 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0023204a-c3d2-4489-a871-a44784a0d299 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:46.366308 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f60de-949a-415b-b54d-f65976c10e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:46.366928 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f60de-949a-415b-b54d-f65976c10e0f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:46.367207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f60de-949a-415b-b54d-f65976c10e0f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:46.367472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f60de-949a-415b-b54d-f65976c10e0f None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:46.368226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f60de-949a-415b-b54d-f65976c10e0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:46.368527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f60de-949a-415b-b54d-f65976c10e0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:46.370090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f60de-949a-415b-b54d-f65976c10e0f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:46.373995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 403/809] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:32:46.374832 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96837331-1a3f-4ec9-9a3b-ad5fc5121b3d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:46.383878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 407/810] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:46.384706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f60de-949a-415b-b54d-f65976c10e0f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:46.475616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96837331-1a3f-4ec9-9a3b-ad5fc5121b3d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:46.482570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f60de-949a-415b-b54d-f65976c10e0f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:46.509619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdf66c-5f88-443d-aa9b-f95fafe8c71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:46.510254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdf66c-5f88-443d-aa9b-f95fafe8c71c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:46.510552 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdf66c-5f88-443d-aa9b-f95fafe8c71c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:46.510828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdf66c-5f88-443d-aa9b-f95fafe8c71c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:46.511455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdf66c-5f88-443d-aa9b-f95fafe8c71c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:46.512828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdf66c-5f88-443d-aa9b-f95fafe8c71c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:46.516257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83264b68-2411-4876-b3db-31a44cde185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:46.516860 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83264b68-2411-4876-b3db-31a44cde185c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:46.517142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83264b68-2411-4876-b3db-31a44cde185c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:46.517450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83264b68-2411-4876-b3db-31a44cde185c None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:46.518244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83264b68-2411-4876-b3db-31a44cde185c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:46.518551 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83264b68-2411-4876-b3db-31a44cde185c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:46.519965 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83264b68-2411-4876-b3db-31a44cde185c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-24cdf66c-5f88-443d-aa9b-f95fafe8c71c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:46.521491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:46.522636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:46.523669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 404/811] 10.222.0.39 () {56 vars in 1129 bytes} [Tue Jul 26 02:32:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:46.524690 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69ccef-e531-4fb6-9df5-d7133ca6e7a0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:46.524690 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69ccef-e531-4fb6-9df5-d7133ca6e7a0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:46.524690 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69ccef-e531-4fb6-9df5-d7133ca6e7a0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:46.525931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 405/812] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:46.526673 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69ccef-e531-4fb6-9df5-d7133ca6e7a0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:46.535758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:46.542716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 408/813] 10.222.0.39 () {56 vars in 1149 bytes} [Tue Jul 26 02:32:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:46.543531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83264b68-2411-4876-b3db-31a44cde185c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:46.546853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:46.639945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69ccef-e531-4fb6-9df5-d7133ca6e7a0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:46.642231 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83264b68-2411-4876-b3db-31a44cde185c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:46.675221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48fa2c-d4de-489c-8b2a-c377a711c3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:46.675443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c32ef8-9caa-40ce-817e-ef7b8d835994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:46.675862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48fa2c-d4de-489c-8b2a-c377a711c3c9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:46.676025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c32ef8-9caa-40ce-817e-ef7b8d835994 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:46.676156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48fa2c-d4de-489c-8b2a-c377a711c3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:46.676287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c32ef8-9caa-40ce-817e-ef7b8d835994 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:46.676394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48fa2c-d4de-489c-8b2a-c377a711c3c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:46.676566 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c32ef8-9caa-40ce-817e-ef7b8d835994 None admin] PATH_INFO: `/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/f2365526802146088fcaa4afc2e03a35/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:46.678556 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c32ef8-9caa-40ce-817e-ef7b8d835994 None admin] RBAC: Authorizing `identity:create_grant(project_id=b017927d64b44db8a1611f20e6e3b6f5, user_id=f2365526802146088fcaa4afc2e03a35, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:46.679990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c32ef8-9caa-40ce-817e-ef7b8d835994 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:46.687449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48fa2c-d4de-489c-8b2a-c377a711c3c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:46.688952 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48fa2c-d4de-489c-8b2a-c377a711c3c9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:46.692724 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 409/814] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:32:46 2022] PUT /identity/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/f2365526802146088fcaa4afc2e03a35/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:32:46.693554 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c32ef8-9caa-40ce-817e-ef7b8d835994 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-6c48fa2c-d4de-489c-8b2a-c377a711c3c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:46.714890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:46.715941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:46.716846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:46.716846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:46.716846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:46.716846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:46.721217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 406/815] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:46.722695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d71209-b2d6-4c4c-8f38-a692ee1eab20 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:46.722984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d71209-b2d6-4c4c-8f38-a692ee1eab20 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:46.723300 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d71209-b2d6-4c4c-8f38-a692ee1eab20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:46.744011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c0d71209-b2d6-4c4c-8f38-a692ee1eab20 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:46.745335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c0d71209-b2d6-4c4c-8f38-a692ee1eab20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:46.764716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:46.806930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:46.810763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c32ef8-9caa-40ce-817e-ef7b8d835994 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:46.822731 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 407/816] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:32:46.835048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d71209-b2d6-4c4c-8f38-a692ee1eab20 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:46.852490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7a85d-dea1-4f21-9474-f6d079247934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:46.853350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7a85d-dea1-4f21-9474-f6d079247934 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:46.853718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7a85d-dea1-4f21-9474-f6d079247934 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:46.854091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7a85d-dea1-4f21-9474-f6d079247934 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:46.855288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7a85d-dea1-4f21-9474-f6d079247934 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:46.855699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7a85d-dea1-4f21-9474-f6d079247934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:46.857516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7a85d-dea1-4f21-9474-f6d079247934 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:46.864503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 410/817] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Jul 26 02:32:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:46.865331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7a85d-dea1-4f21-9474-f6d079247934 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:46.951009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d71209-b2d6-4c4c-8f38-a692ee1eab20 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:46.968392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7a85d-dea1-4f21-9474-f6d079247934 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:46.987018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abca3ec-28f0-4b19-8c80-a3c392f3d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:46.987830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abca3ec-28f0-4b19-8c80-a3c392f3d615 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:46.988116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abca3ec-28f0-4b19-8c80-a3c392f3d615 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:46.988390 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abca3ec-28f0-4b19-8c80-a3c392f3d615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:46.995303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:47.000442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abca3ec-28f0-4b19-8c80-a3c392f3d615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:47.001976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abca3ec-28f0-4b19-8c80-a3c392f3d615 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:47.005683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35db434-8eff-4a6c-af1d-70b0f9e0b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:47.006303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35db434-8eff-4a6c-af1d-70b0f9e0b719 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:47.006573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35db434-8eff-4a6c-af1d-70b0f9e0b719 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:47.006841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35db434-8eff-4a6c-af1d-70b0f9e0b719 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:47.007529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35db434-8eff-4a6c-af1d-70b0f9e0b719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:47.007824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35db434-8eff-4a6c-af1d-70b0f9e0b719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:47.009590 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35db434-8eff-4a6c-af1d-70b0f9e0b719 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-1abca3ec-28f0-4b19-8c80-a3c392f3d615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:47.017418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:47.018287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:47.019170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:47.019170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:47.019170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:47.019170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:47.019170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 408/818] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:47.019449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abca3ec-28f0-4b19-8c80-a3c392f3d615 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:47.031934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 411/819] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:47.031934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35db434-8eff-4a6c-af1d-70b0f9e0b719 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:47.065465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:47.127878 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abca3ec-28f0-4b19-8c80-a3c392f3d615 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:47.134894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35db434-8eff-4a6c-af1d-70b0f9e0b719 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:47.162999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872a856-1057-413b-a9dc-ba714946f0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:47.163647 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872a856-1057-413b-a9dc-ba714946f0f9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:47.163934 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872a856-1057-413b-a9dc-ba714946f0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:47.164214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872a856-1057-413b-a9dc-ba714946f0f9 None admin] PATH_INFO: `/v3/services/network` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:47.164843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872a856-1057-413b-a9dc-ba714946f0f9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:47.166261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872a856-1057-413b-a9dc-ba714946f0f9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:47.171322 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92622147-9c33-4d6d-8dfe-63bdaedf2303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:47.171937 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92622147-9c33-4d6d-8dfe-63bdaedf2303 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:47.172215 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92622147-9c33-4d6d-8dfe-63bdaedf2303 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:47.172482 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92622147-9c33-4d6d-8dfe-63bdaedf2303 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:47.173154 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92622147-9c33-4d6d-8dfe-63bdaedf2303 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:47.173477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92622147-9c33-4d6d-8dfe-63bdaedf2303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:47.174815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92622147-9c33-4d6d-8dfe-63bdaedf2303 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a872a856-1057-413b-a9dc-ba714946f0f9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:47.175289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:47.176217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:47.177803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 409/820] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:47 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:47.178597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872a856-1057-413b-a9dc-ba714946f0f9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:47.190669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 412/821] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Jul 26 02:32:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:47.190669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92622147-9c33-4d6d-8dfe-63bdaedf2303 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:47.246982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:47.287614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872a856-1057-413b-a9dc-ba714946f0f9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:47.290863 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:47.296096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92622147-9c33-4d6d-8dfe-63bdaedf2303 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:47.326506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407427c5-49b2-49a8-ac33-0ed81eed4a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:47.327301 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407427c5-49b2-49a8-ac33-0ed81eed4a87 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:47.327595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407427c5-49b2-49a8-ac33-0ed81eed4a87 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:47.328026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407427c5-49b2-49a8-ac33-0ed81eed4a87 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:47.328833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407427c5-49b2-49a8-ac33-0ed81eed4a87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:47.329116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c86e2-934b-423d-9ab4-5c4ed7dcd0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:47.329610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407427c5-49b2-49a8-ac33-0ed81eed4a87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:47.329783 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c86e2-934b-423d-9ab4-5c4ed7dcd0ee None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:47.330057 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c86e2-934b-423d-9ab4-5c4ed7dcd0ee None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:47.330321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c86e2-934b-423d-9ab4-5c4ed7dcd0ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:47.330539 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407427c5-49b2-49a8-ac33-0ed81eed4a87 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:47.337589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c86e2-934b-423d-9ab4-5c4ed7dcd0ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:47.339224 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c86e2-934b-423d-9ab4-5c4ed7dcd0ee None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:47.349273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 410/822] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:47.349273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407427c5-49b2-49a8-ac33-0ed81eed4a87 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e75c86e2-934b-423d-9ab4-5c4ed7dcd0ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:47.355638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:47.356506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:47.357443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:47.357443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:47.357443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:47.357443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:47.357443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:47.357443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:47.357443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:47.357443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:47.357443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 413/823] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:47.357942 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c86e2-934b-423d-9ab4-5c4ed7dcd0ee None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:47.452595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407427c5-49b2-49a8-ac33-0ed81eed4a87 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:47.459992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c86e2-934b-423d-9ab4-5c4ed7dcd0ee None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:47.474003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:47.489319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb4d56-11eb-44ea-837b-dfbba41ef00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:47.489775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb4d56-11eb-44ea-837b-dfbba41ef00e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:47.490051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb4d56-11eb-44ea-837b-dfbba41ef00e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:47.490379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb4d56-11eb-44ea-837b-dfbba41ef00e None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:47.490988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb4d56-11eb-44ea-837b-dfbba41ef00e None admin] RBAC: Adding query filter params (name=network) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:47.491283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb4d56-11eb-44ea-837b-dfbba41ef00e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:47.492652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb4d56-11eb-44ea-837b-dfbba41ef00e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:47.497428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 411/824] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 02:32:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:47.497555 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48195e-0150-4d25-a518-1fa312f1c7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:47.498064 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48195e-0150-4d25-a518-1fa312f1c7e9 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:47.498344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48195e-0150-4d25-a518-1fa312f1c7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:47.498621 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48195e-0150-4d25-a518-1fa312f1c7e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:47.499336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48195e-0150-4d25-a518-1fa312f1c7e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:47.500702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48195e-0150-4d25-a518-1fa312f1c7e9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:47.502513 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb4d56-11eb-44ea-837b-dfbba41ef00e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:47.533323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 414/825] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:32:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:32:47.533323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48195e-0150-4d25-a518-1fa312f1c7e9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:47.542539 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:47.626714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb4d56-11eb-44ea-837b-dfbba41ef00e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:47.670905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fef96-bec3-44a5-b6a6-75e0a949d352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:47.671656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fef96-bec3-44a5-b6a6-75e0a949d352 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:47.671998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fef96-bec3-44a5-b6a6-75e0a949d352 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:47.672421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fef96-bec3-44a5-b6a6-75e0a949d352 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:47.680227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fef96-bec3-44a5-b6a6-75e0a949d352 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:47.682007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fef96-bec3-44a5-b6a6-75e0a949d352 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-ef3fef96-bec3-44a5-b6a6-75e0a949d352 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:47.696575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:47.697612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:47.698988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:47.698988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:47.698988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:47.698988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:47.698988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:47.698988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:47.698988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:47.698988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:47.699651 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48195e-0150-4d25-a518-1fa312f1c7e9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:47.699738 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 412/826] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:47.702844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fef96-bec3-44a5-b6a6-75e0a949d352 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:47.747981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6578a7-812e-4d39-9ee5-c42fa17a1b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:47.748536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6578a7-812e-4d39-9ee5-c42fa17a1b2c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:47.748823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6578a7-812e-4d39-9ee5-c42fa17a1b2c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:47.749096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6578a7-812e-4d39-9ee5-c42fa17a1b2c None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:47.749895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6578a7-812e-4d39-9ee5-c42fa17a1b2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:47.750204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6578a7-812e-4d39-9ee5-c42fa17a1b2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:47.752406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6578a7-812e-4d39-9ee5-c42fa17a1b2c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:47.769235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 415/827] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:47.770502 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6578a7-812e-4d39-9ee5-c42fa17a1b2c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:47.801776 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:47.807530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:47.820372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fef96-bec3-44a5-b6a6-75e0a949d352 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:47.857050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302185fe-aa55-4c19-bfce-87cbdb6a91db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:47.858057 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302185fe-aa55-4c19-bfce-87cbdb6a91db None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:47.858534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302185fe-aa55-4c19-bfce-87cbdb6a91db None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:47.858983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302185fe-aa55-4c19-bfce-87cbdb6a91db None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:47.859831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302185fe-aa55-4c19-bfce-87cbdb6a91db None admin] RBAC: Adding query filter params (type=network) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:47.860324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302185fe-aa55-4c19-bfce-87cbdb6a91db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:47.861912 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302185fe-aa55-4c19-bfce-87cbdb6a91db None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:47.867634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 413/828] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 02:32:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:47.868682 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302185fe-aa55-4c19-bfce-87cbdb6a91db None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:47.901474 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6578a7-812e-4d39-9ee5-c42fa17a1b2c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:47.944746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc5240-51f6-4414-a5d7-25f43138add5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:47.945719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5240-51f6-4414-a5d7-25f43138add5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:47.946221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5240-51f6-4414-a5d7-25f43138add5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:47.946588 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc5240-51f6-4414-a5d7-25f43138add5 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:47.947684 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc5240-51f6-4414-a5d7-25f43138add5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:47.948141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc5240-51f6-4414-a5d7-25f43138add5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:47.950426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc5240-51f6-4414-a5d7-25f43138add5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:47.972249 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 416/829] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:47.972249 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc5240-51f6-4414-a5d7-25f43138add5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:47.992959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302185fe-aa55-4c19-bfce-87cbdb6a91db None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:48.028237 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53e81b-2879-43d7-9f42-f8055862db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:48.029247 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53e81b-2879-43d7-9f42-f8055862db7a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:48.029754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53e81b-2879-43d7-9f42-f8055862db7a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:48.030224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53e81b-2879-43d7-9f42-f8055862db7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:48.031208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53e81b-2879-43d7-9f42-f8055862db7a None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=338b2744014940ca96c08d4e9262697b) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:48.031738 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53e81b-2879-43d7-9f42-f8055862db7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:48.033465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53e81b-2879-43d7-9f42-f8055862db7a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:48.040084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 414/830] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:47 2022] GET /identity/v3/role_assignments?user.id=338b2744014940ca96c08d4e9262697b&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:48.041188 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53e81b-2879-43d7-9f42-f8055862db7a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:48.061842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:48.080565 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:48.095340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc5240-51f6-4414-a5d7-25f43138add5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:48.131985 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ff3f0-5a64-47b5-b40b-7061e780d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:48.132461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ff3f0-5a64-47b5-b40b-7061e780d838 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:48.132840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ff3f0-5a64-47b5-b40b-7061e780d838 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:48.133206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ff3f0-5a64-47b5-b40b-7061e780d838 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:48.134065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ff3f0-5a64-47b5-b40b-7061e780d838 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:48.135669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ff3f0-5a64-47b5-b40b-7061e780d838 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:48.161687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 417/831] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:32:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:32:48.186339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53e81b-2879-43d7-9f42-f8055862db7a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:48.236128 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6241c2-8a89-4f18-a14a-a7092bf37ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:48.236840 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6241c2-8a89-4f18-a14a-a7092bf37ad2 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:48.237166 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6241c2-8a89-4f18-a14a-a7092bf37ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:48.237478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6241c2-8a89-4f18-a14a-a7092bf37ad2 None admin] PATH_INFO: `/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/1a3ecd4bf47a4842b522ccdb575203d6/roles/4afb03ef7ba64a1fabaf9b59249d9a15` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:48.256538 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6241c2-8a89-4f18-a14a-a7092bf37ad2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b017927d64b44db8a1611f20e6e3b6f5, user_id=1a3ecd4bf47a4842b522ccdb575203d6, role_id=4afb03ef7ba64a1fabaf9b59249d9a15)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:48.258143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6241c2-8a89-4f18-a14a-a7092bf37ad2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:48.288772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 415/832] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:32:48 2022] PUT /identity/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/1a3ecd4bf47a4842b522ccdb575203d6/roles/4afb03ef7ba64a1fabaf9b59249d9a15 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:32:48.705769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebcdc7-82b8-4c34-ac87-15af1c3bc68c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:48.706330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebcdc7-82b8-4c34-ac87-15af1c3bc68c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:48.706330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebcdc7-82b8-4c34-ac87-15af1c3bc68c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:48.707947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 418/833] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:48.713299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1cc1-1f68-41fb-8596-5ff9e3276bab None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:48.713773 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1cc1-1f68-41fb-8596-5ff9e3276bab None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:48.713967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c1cc1-1f68-41fb-8596-5ff9e3276bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:48.732124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f96c1cc1-1f68-41fb-8596-5ff9e3276bab None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:48.733326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f96c1cc1-1f68-41fb-8596-5ff9e3276bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:48.787873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:48.802989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 416/834] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:32:48.825336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebcdc7-82b8-4c34-ac87-15af1c3bc68c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:48.934317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebcdc7-82b8-4c34-ac87-15af1c3bc68c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:48.969585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82520f-dc40-4132-b908-c0f4f9bc4520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:48.970637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82520f-dc40-4132-b908-c0f4f9bc4520 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:48.971118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82520f-dc40-4132-b908-c0f4f9bc4520 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:48.971607 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82520f-dc40-4132-b908-c0f4f9bc4520 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:48.983261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82520f-dc40-4132-b908-c0f4f9bc4520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-bb82520f-dc40-4132-b908-c0f4f9bc4520 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:48.988412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:48.989382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:48.990227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:48.990227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:48.990227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:48.990227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:48.990227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:48.990227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:48.990227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:48.990227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:48.990227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:48.990227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:48.990227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:32:48.990227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:48.992922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 419/835] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:48.999232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c1cc1-1f68-41fb-8596-5ff9e3276bab None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:49.100240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c1cc1-1f68-41fb-8596-5ff9e3276bab None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:49.139210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0466e-1561-4fde-b05e-a07369bd2c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:49.139835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0466e-1561-4fde-b05e-a07369bd2c38 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:49.140117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0466e-1561-4fde-b05e-a07369bd2c38 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:49.140386 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0466e-1561-4fde-b05e-a07369bd2c38 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:49.141107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0466e-1561-4fde-b05e-a07369bd2c38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:49.141491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0466e-1561-4fde-b05e-a07369bd2c38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:49.142880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0466e-1561-4fde-b05e-a07369bd2c38 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:49.151344 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 417/836] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:32:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:49.156935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82520f-dc40-4132-b908-c0f4f9bc4520 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:49.162145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:49.262228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82520f-dc40-4132-b908-c0f4f9bc4520 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:49.297319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f0722-9839-4e1e-a36a-365aeab0b6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:49.297965 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f0722-9839-4e1e-a36a-365aeab0b6fb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:49.298244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f0722-9839-4e1e-a36a-365aeab0b6fb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:49.298513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f0722-9839-4e1e-a36a-365aeab0b6fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:49.309319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f0722-9839-4e1e-a36a-365aeab0b6fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:49.310781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f0722-9839-4e1e-a36a-365aeab0b6fb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-d34f0722-9839-4e1e-a36a-365aeab0b6fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:49.325052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:49.325968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:49.326854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:49.326854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:49.326854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:49.326854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:49.326854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 420/837] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:49.333438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0466e-1561-4fde-b05e-a07369bd2c38 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:49.388612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:49.438842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0466e-1561-4fde-b05e-a07369bd2c38 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:49.475359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a86ecc-f891-40e9-a352-ce0197510b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:49.475990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a86ecc-f891-40e9-a352-ce0197510b3f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:49.476629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a86ecc-f891-40e9-a352-ce0197510b3f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:49.476901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a86ecc-f891-40e9-a352-ce0197510b3f None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:49.477689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a86ecc-f891-40e9-a352-ce0197510b3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:49.477993 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a86ecc-f891-40e9-a352-ce0197510b3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:49.479472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a86ecc-f891-40e9-a352-ce0197510b3f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:49.492353 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 418/838] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:49.498379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f0722-9839-4e1e-a36a-365aeab0b6fb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:49.555746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:49.603032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f0722-9839-4e1e-a36a-365aeab0b6fb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:49.636610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69343694-45d7-421a-9402-0afde9dca1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:49.637256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69343694-45d7-421a-9402-0afde9dca1f2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:49.637562 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69343694-45d7-421a-9402-0afde9dca1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:49.637833 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69343694-45d7-421a-9402-0afde9dca1f2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:49.645413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69343694-45d7-421a-9402-0afde9dca1f2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:49.646903 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69343694-45d7-421a-9402-0afde9dca1f2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-69343694-45d7-421a-9402-0afde9dca1f2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:49.658296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:49.659206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:49.660144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:49.660144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:49.660144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:49.660144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:49.660144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:49.660144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:49.660144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:49.660144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:49.660144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 02:32:49.660144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:49.660144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 421/839] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:32:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:49.667041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a86ecc-f891-40e9-a352-ce0197510b3f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:49.765909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a86ecc-f891-40e9-a352-ce0197510b3f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:49.777718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:49.807111 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855ae9b-bab4-4ac1-84ce-948a2bf0fdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:49.807693 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855ae9b-bab4-4ac1-84ce-948a2bf0fdc3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:49.807976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855ae9b-bab4-4ac1-84ce-948a2bf0fdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:49.808247 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855ae9b-bab4-4ac1-84ce-948a2bf0fdc3 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:49.809060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855ae9b-bab4-4ac1-84ce-948a2bf0fdc3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:49.809393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855ae9b-bab4-4ac1-84ce-948a2bf0fdc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:49.810836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855ae9b-bab4-4ac1-84ce-948a2bf0fdc3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:49.828985 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 419/840] 10.222.0.39 () {56 vars in 1135 bytes} [Tue Jul 26 02:32:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:49.834620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69343694-45d7-421a-9402-0afde9dca1f2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:49.943615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69343694-45d7-421a-9402-0afde9dca1f2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:49.952739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7118-8a79-44f1-95c1-1167979c7545 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:49.953037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7118-8a79-44f1-95c1-1167979c7545 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:49.953310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b7118-8a79-44f1-95c1-1167979c7545 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:49.954783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 420/841] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:49.960020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6192-1d1f-4479-81ac-81133e5ba1d0 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:49.960584 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6192-1d1f-4479-81ac-81133e5ba1d0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:49.961078 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e6192-1d1f-4479-81ac-81133e5ba1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:49.964496 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:49.983737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ab0e6192-1d1f-4479-81ac-81133e5ba1d0 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:49.985408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ab0e6192-1d1f-4479-81ac-81133e5ba1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:49.985674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c304fc7-4ba7-456b-8233-6f6d1bd7e2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:49.986308 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c304fc7-4ba7-456b-8233-6f6d1bd7e2e4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:49.986628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c304fc7-4ba7-456b-8233-6f6d1bd7e2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:49.986907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c304fc7-4ba7-456b-8233-6f6d1bd7e2e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.064628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c304fc7-4ba7-456b-8233-6f6d1bd7e2e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:50.066707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c304fc7-4ba7-456b-8233-6f6d1bd7e2e4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:50.073425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 421/842] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:32:50.090917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6192-1d1f-4479-81ac-81133e5ba1d0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:50.173401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 422/843] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:49 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:32:50.176218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c304fc7-4ba7-456b-8233-6f6d1bd7e2e4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:50.193992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:50.196515 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:50.201946 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e6192-1d1f-4479-81ac-81133e5ba1d0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:50.240685 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb14ea8-b877-4067-9bef-1bbd7c1c3046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:50.241772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb14ea8-b877-4067-9bef-1bbd7c1c3046 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:50.242248 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb14ea8-b877-4067-9bef-1bbd7c1c3046 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:50.242737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb14ea8-b877-4067-9bef-1bbd7c1c3046 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.243663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb14ea8-b877-4067-9bef-1bbd7c1c3046 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:50.245533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb14ea8-b877-4067-9bef-1bbd7c1c3046 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-adb14ea8-b877-4067-9bef-1bbd7c1c3046 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:50.255429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:50.256442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 02:32:50.257295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:50.264994 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 422/844] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:32:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:50.266710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb14ea8-b877-4067-9bef-1bbd7c1c3046 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:50.282857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c304fc7-4ba7-456b-8233-6f6d1bd7e2e4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:50.318386 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f1dc1-6e6f-46fd-9c45-fe84ca8d1af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:50.319227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f1dc1-6e6f-46fd-9c45-fe84ca8d1af1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:50.319511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f1dc1-6e6f-46fd-9c45-fe84ca8d1af1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:50.320226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f1dc1-6e6f-46fd-9c45-fe84ca8d1af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.331281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f1dc1-6e6f-46fd-9c45-fe84ca8d1af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:50.332727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f1dc1-6e6f-46fd-9c45-fe84ca8d1af1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-101f1dc1-6e6f-46fd-9c45-fe84ca8d1af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:50.348887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:50.349877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:50.350778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:50.350778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:50.350778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:50.350778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:50.350778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 423/845] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:50.351736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e045d-8e62-4ece-a40c-17a032a3f9bb None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:50.352020 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e045d-8e62-4ece-a40c-17a032a3f9bb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:50.352284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e045d-8e62-4ece-a40c-17a032a3f9bb None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.353840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 424/846] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:50.355162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5eb9-7473-4a64-bacf-963b3e47ca7a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:50.355449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5eb9-7473-4a64-bacf-963b3e47ca7a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:50.355721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5eb9-7473-4a64-bacf-963b3e47ca7a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.357339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 425/847] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:50.357868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a5eb9-7473-4a64-bacf-963b3e47ca7a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:50.377834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb14ea8-b877-4067-9bef-1bbd7c1c3046 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:50.409266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f5498-ad61-43eb-83da-a5e4a3fe4d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:50.409901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f5498-ad61-43eb-83da-a5e4a3fe4d5f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:50.410174 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f5498-ad61-43eb-83da-a5e4a3fe4d5f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:50.410441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f5498-ad61-43eb-83da-a5e4a3fe4d5f None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.411115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f5498-ad61-43eb-83da-a5e4a3fe4d5f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:50.411413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f5498-ad61-43eb-83da-a5e4a3fe4d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:50.412780 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f5498-ad61-43eb-83da-a5e4a3fe4d5f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:50.417618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 423/848] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:32:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:50.418786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084e21-f70c-474b-8a20-e14fd3bddaf7 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:50.419078 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084e21-f70c-474b-8a20-e14fd3bddaf7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:50.419443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3084e21-f70c-474b-8a20-e14fd3bddaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.424737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:50.437937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a3084e21-f70c-474b-8a20-e14fd3bddaf7 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:50.439147 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a3084e21-f70c-474b-8a20-e14fd3bddaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:50.460262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a5eb9-7473-4a64-bacf-963b3e47ca7a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:50.461511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:50.493990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8cfc-3bb2-4e66-8196-6ebdf3d3ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:50.494607 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8cfc-3bb2-4e66-8196-6ebdf3d3ed8a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:50.494891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8cfc-3bb2-4e66-8196-6ebdf3d3ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:50.495159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d8cfc-3bb2-4e66-8196-6ebdf3d3ed8a None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.495879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d8cfc-3bb2-4e66-8196-6ebdf3d3ed8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:50.496179 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d8cfc-3bb2-4e66-8196-6ebdf3d3ed8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:50.497576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d8cfc-3bb2-4e66-8196-6ebdf3d3ed8a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:50.507859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 424/849] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:32:50.508943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0f32e-3c00-405b-b439-807e6ecfbb44 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:50.509234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 426/850] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:50.509357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0f32e-3c00-405b-b439-807e6ecfbb44 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:50.509527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0f32e-3c00-405b-b439-807e6ecfbb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.510011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8cfc-3bb2-4e66-8196-6ebdf3d3ed8a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:50.531212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f6a0f32e-3c00-405b-b439-807e6ecfbb44 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:50.532412 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f6a0f32e-3c00-405b-b439-807e6ecfbb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:50.597669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 425/851] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:32:50.598422 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0f32e-3c00-405b-b439-807e6ecfbb44 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:50.621546 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d8cfc-3bb2-4e66-8196-6ebdf3d3ed8a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:50.652208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:50.660688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc447d-df4b-4e0e-a3e7-2c84dba8a316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:50.661344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc447d-df4b-4e0e-a3e7-2c84dba8a316 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:50.661626 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc447d-df4b-4e0e-a3e7-2c84dba8a316 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:50.661897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc447d-df4b-4e0e-a3e7-2c84dba8a316 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.662580 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc447d-df4b-4e0e-a3e7-2c84dba8a316 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:50.662884 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc447d-df4b-4e0e-a3e7-2c84dba8a316 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:50.664261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc447d-df4b-4e0e-a3e7-2c84dba8a316 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:50.668636 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 427/852] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:32:50 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:50.669431 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc447d-df4b-4e0e-a3e7-2c84dba8a316 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:50.697368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:50.718646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0f32e-3c00-405b-b439-807e6ecfbb44 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:50.756778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60ff25-1916-43dc-b758-4464d6521c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:50.757493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ff25-1916-43dc-b758-4464d6521c12 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:50.757772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ff25-1916-43dc-b758-4464d6521c12 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:50.758048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60ff25-1916-43dc-b758-4464d6521c12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.765780 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60ff25-1916-43dc-b758-4464d6521c12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:50.767268 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60ff25-1916-43dc-b758-4464d6521c12 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:50.779681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc447d-df4b-4e0e-a3e7-2c84dba8a316 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-4d60ff25-1916-43dc-b758-4464d6521c12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:50.780554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:50.781454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:50.782443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:50.782443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:50.782443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:50.782443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:50.782443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:50.782443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:50.782443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:50.782443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:50.787019 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 426/853] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:50.788008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60ff25-1916-43dc-b758-4464d6521c12 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:50.821563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb44695-5bc0-4409-9523-1ffffbf93fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:50.822235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb44695-5bc0-4409-9523-1ffffbf93fab None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:50.822512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb44695-5bc0-4409-9523-1ffffbf93fab None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:50.822782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb44695-5bc0-4409-9523-1ffffbf93fab None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.823467 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb44695-5bc0-4409-9523-1ffffbf93fab None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:50.824851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb44695-5bc0-4409-9523-1ffffbf93fab None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-cfb44695-5bc0-4409-9523-1ffffbf93fab None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:50.835770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:50.837418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:50.838450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 428/854] 10.222.0.39 () {56 vars in 1132 bytes} [Tue Jul 26 02:32:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:50.839807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb44695-5bc0-4409-9523-1ffffbf93fab None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:50.893294 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:50.914017 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60ff25-1916-43dc-b758-4464d6521c12 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:50.940808 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb44695-5bc0-4409-9523-1ffffbf93fab None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:50.951648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc2421-412a-4151-ae3a-79d4e3d0ef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:50.952300 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc2421-412a-4151-ae3a-79d4e3d0ef5c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:50.952579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc2421-412a-4151-ae3a-79d4e3d0ef5c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:50.952844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc2421-412a-4151-ae3a-79d4e3d0ef5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.963874 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc2421-412a-4151-ae3a-79d4e3d0ef5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-31fc2421-412a-4151-ae3a-79d4e3d0ef5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:50.968815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:50.970037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 427/855] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:32:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:50.970890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc2421-412a-4151-ae3a-79d4e3d0ef5c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:50.981105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a1478-89f4-4757-b9c5-a988b420ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:50.981380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:50.981776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a1478-89f4-4757-b9c5-a988b420ce99 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:50.982428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a1478-89f4-4757-b9c5-a988b420ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:50.982754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a1478-89f4-4757-b9c5-a988b420ce99 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:50.983562 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a1478-89f4-4757-b9c5-a988b420ce99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:50.983842 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a1478-89f4-4757-b9c5-a988b420ce99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:50.985296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a1478-89f4-4757-b9c5-a988b420ce99 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:50.998701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 429/856] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:50.999635 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a1478-89f4-4757-b9c5-a988b420ce99 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:51.084638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc2421-412a-4151-ae3a-79d4e3d0ef5c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:51.104985 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a1478-89f4-4757-b9c5-a988b420ce99 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:51.122199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:51.128288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bff90a-68c3-4973-9db0-073090232ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:51.128929 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bff90a-68c3-4973-9db0-073090232ed8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:51.129213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bff90a-68c3-4973-9db0-073090232ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:51.129516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bff90a-68c3-4973-9db0-073090232ed8 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:51.130204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bff90a-68c3-4973-9db0-073090232ed8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:51.130545 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bff90a-68c3-4973-9db0-073090232ed8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:51.131950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bff90a-68c3-4973-9db0-073090232ed8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:51.141532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 428/857] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 02:32:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:51.141532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bff90a-68c3-4973-9db0-073090232ed8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:51.148733 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4125fa-3cd1-4281-a8b7-dc0d2aa5cc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:51.149348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4125fa-3cd1-4281-a8b7-dc0d2aa5cc60 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:51.149615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4125fa-3cd1-4281-a8b7-dc0d2aa5cc60 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:51.149886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4125fa-3cd1-4281-a8b7-dc0d2aa5cc60 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:51.150617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4125fa-3cd1-4281-a8b7-dc0d2aa5cc60 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:51.150922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4125fa-3cd1-4281-a8b7-dc0d2aa5cc60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:51.152398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4125fa-3cd1-4281-a8b7-dc0d2aa5cc60 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:51.167222 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 430/858] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:32:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:51.167222 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4125fa-3cd1-4281-a8b7-dc0d2aa5cc60 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:51.214832 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:51.247500 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bff90a-68c3-4973-9db0-073090232ed8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:51.273654 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4125fa-3cd1-4281-a8b7-dc0d2aa5cc60 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:51.282240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b6ef7-7dd7-43fa-90fd-af3f974a7b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:51.282893 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b6ef7-7dd7-43fa-90fd-af3f974a7b64 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:51.283146 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b6ef7-7dd7-43fa-90fd-af3f974a7b64 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:51.283420 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b6ef7-7dd7-43fa-90fd-af3f974a7b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:51.284212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b6ef7-7dd7-43fa-90fd-af3f974a7b64 None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=f2365526802146088fcaa4afc2e03a35) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:51.284809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b6ef7-7dd7-43fa-90fd-af3f974a7b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:51.285979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b6ef7-7dd7-43fa-90fd-af3f974a7b64 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:51.292170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 429/859] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:51 2022] GET /identity/v3/role_assignments?user.id=f2365526802146088fcaa4afc2e03a35&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:51.292770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b6ef7-7dd7-43fa-90fd-af3f974a7b64 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:51.329333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20afc3-70f6-4bf7-ba01-c0fe097b4283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:51.330417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20afc3-70f6-4bf7-ba01-c0fe097b4283 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:51.330910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20afc3-70f6-4bf7-ba01-c0fe097b4283 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:51.331418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20afc3-70f6-4bf7-ba01-c0fe097b4283 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:51.333519 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20afc3-70f6-4bf7-ba01-c0fe097b4283 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:51.333883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20afc3-70f6-4bf7-ba01-c0fe097b4283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:51.335371 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20afc3-70f6-4bf7-ba01-c0fe097b4283 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:51.341654 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 431/860] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 02:32:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:51.415223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b6ef7-7dd7-43fa-90fd-af3f974a7b64 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:51.456341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b705730-acb6-42b2-bf7e-6992c0d25ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:51.457364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b705730-acb6-42b2-bf7e-6992c0d25ce2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:51.457832 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b705730-acb6-42b2-bf7e-6992c0d25ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:51.458253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b705730-acb6-42b2-bf7e-6992c0d25ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:51.467235 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:51.472957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b705730-acb6-42b2-bf7e-6992c0d25ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:51.474511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b705730-acb6-42b2-bf7e-6992c0d25ce2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-7b705730-acb6-42b2-bf7e-6992c0d25ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:51.492150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:51.493104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:51.494038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:51.494038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:51.494038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:51.494038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:51.494038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 430/861] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:51.499391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20afc3-70f6-4bf7-ba01-c0fe097b4283 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:51.550994 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:51.613312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20afc3-70f6-4bf7-ba01-c0fe097b4283 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:51.647024 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0c84e-8283-45a8-acba-c65adcf2ae05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:51.647660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0c84e-8283-45a8-acba-c65adcf2ae05 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:51.647944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0c84e-8283-45a8-acba-c65adcf2ae05 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:51.648222 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0c84e-8283-45a8-acba-c65adcf2ae05 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:51.648927 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0c84e-8283-45a8-acba-c65adcf2ae05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:51.649237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0c84e-8283-45a8-acba-c65adcf2ae05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:51.650627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0c84e-8283-45a8-acba-c65adcf2ae05 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:51.664418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 432/862] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:51.670167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b705730-acb6-42b2-bf7e-6992c0d25ce2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:51.777593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b705730-acb6-42b2-bf7e-6992c0d25ce2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:51.814497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd36ca-b76a-4bc5-ae96-a8d8460a05db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:51.815495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd36ca-b76a-4bc5-ae96-a8d8460a05db None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:51.815952 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd36ca-b76a-4bc5-ae96-a8d8460a05db None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:51.816416 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd36ca-b76a-4bc5-ae96-a8d8460a05db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:51.824931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd36ca-b76a-4bc5-ae96-a8d8460a05db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:51.826634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd36ca-b76a-4bc5-ae96-a8d8460a05db None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-becd36ca-b76a-4bc5-ae96-a8d8460a05db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:51.838625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:51.839618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:51.840595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:51.840595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:51.840595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:51.840595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:51.840595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:51.840595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:51.840595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:51.840595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:51.840595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 02:32:51.840595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:51.841127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 431/863] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 02:32:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:51.847657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0c84e-8283-45a8-acba-c65adcf2ae05 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:51.954996 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0c84e-8283-45a8-acba-c65adcf2ae05 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:51.956830 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:51.991127 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585f33e-e80e-428e-8021-2c5489dd5eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:51.992080 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585f33e-e80e-428e-8021-2c5489dd5eb2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:51.992563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585f33e-e80e-428e-8021-2c5489dd5eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:51.993033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585f33e-e80e-428e-8021-2c5489dd5eb2 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:51.994055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585f33e-e80e-428e-8021-2c5489dd5eb2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:51.994565 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585f33e-e80e-428e-8021-2c5489dd5eb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:51.996236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585f33e-e80e-428e-8021-2c5489dd5eb2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:52.014711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 433/864] 10.222.0.39 () {56 vars in 1149 bytes} [Tue Jul 26 02:32:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:52.020747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd36ca-b76a-4bc5-ae96-a8d8460a05db None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:52.069234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:52.124265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd36ca-b76a-4bc5-ae96-a8d8460a05db None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:52.159066 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dbb38-803d-4cfe-b19d-b374f222de50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:52.160093 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dbb38-803d-4cfe-b19d-b374f222de50 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:52.160573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dbb38-803d-4cfe-b19d-b374f222de50 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:52.161038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dbb38-803d-4cfe-b19d-b374f222de50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:52.230027 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dbb38-803d-4cfe-b19d-b374f222de50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:52.231806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dbb38-803d-4cfe-b19d-b374f222de50 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:52.277010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:52.331443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 432/865] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:32:52.337399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585f33e-e80e-428e-8021-2c5489dd5eb2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:52.438875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585f33e-e80e-428e-8021-2c5489dd5eb2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:52.474210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15fca2-1406-4d75-bc7a-66cc02fd65f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:52.475255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15fca2-1406-4d75-bc7a-66cc02fd65f0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:52.475737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15fca2-1406-4d75-bc7a-66cc02fd65f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:52.476563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15fca2-1406-4d75-bc7a-66cc02fd65f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:52.488110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15fca2-1406-4d75-bc7a-66cc02fd65f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:52.490022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15fca2-1406-4d75-bc7a-66cc02fd65f0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-fa15fca2-1406-4d75-bc7a-66cc02fd65f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:52.509061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:52.510068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:52.511000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:52.511000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:52.511000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:52.511000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:52.513474 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 434/866] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:52.519663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dbb38-803d-4cfe-b19d-b374f222de50 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:52.622561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dbb38-803d-4cfe-b19d-b374f222de50 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:52.658363 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a4c3d-6645-4257-adbd-1a544d99aa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:52.658997 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a4c3d-6645-4257-adbd-1a544d99aa34 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:52.659279 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a4c3d-6645-4257-adbd-1a544d99aa34 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:52.659553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a4c3d-6645-4257-adbd-1a544d99aa34 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:52.660254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a4c3d-6645-4257-adbd-1a544d99aa34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:52.660558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a4c3d-6645-4257-adbd-1a544d99aa34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:52.661968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a4c3d-6645-4257-adbd-1a544d99aa34 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:52.669789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00bb5b-893f-4ae9-a46d-4602efa0eb22 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:52.670071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00bb5b-893f-4ae9-a46d-4602efa0eb22 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:52.670345 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00bb5b-893f-4ae9-a46d-4602efa0eb22 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:52.671953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 435/867] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:52.673968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 433/868] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:52.676763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132286d-5a16-4c36-8214-b4f7d333855c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:52.677046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132286d-5a16-4c36-8214-b4f7d333855c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:52.677350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132286d-5a16-4c36-8214-b4f7d333855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:52.679176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a4c3d-6645-4257-adbd-1a544d99aa34 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:52.689588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:52.703738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f132286d-5a16-4c36-8214-b4f7d333855c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:52.705369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f132286d-5a16-4c36-8214-b4f7d333855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:52.715157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:52.792945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a4c3d-6645-4257-adbd-1a544d99aa34 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:52.795311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 436/869] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jul 26 02:32:52.814271 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132286d-5a16-4c36-8214-b4f7d333855c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:52.831636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f7044-dcf7-4ae7-b443-ca6159b1e6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:52.832813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7044-dcf7-4ae7-b443-ca6159b1e6ca None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:52.833536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7044-dcf7-4ae7-b443-ca6159b1e6ca None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:52.833834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f7044-dcf7-4ae7-b443-ca6159b1e6ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:52.841497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f7044-dcf7-4ae7-b443-ca6159b1e6ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:52.843041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f7044-dcf7-4ae7-b443-ca6159b1e6ca None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a97f7044-dcf7-4ae7-b443-ca6159b1e6ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:52.855977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:52.856953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:52.857901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:52.857901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:52.857901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:52.857901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:52.857901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:52.857901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:52.857901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:52.857901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:52.862136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 434/870] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:52.863301 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f7044-dcf7-4ae7-b443-ca6159b1e6ca None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:52.933602 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:52.942487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132286d-5a16-4c36-8214-b4f7d333855c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:52.970605 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f7044-dcf7-4ae7-b443-ca6159b1e6ca None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:52.986135 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25d764-2e6a-4e5a-9937-833226dd0a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:52.986756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25d764-2e6a-4e5a-9937-833226dd0a5f None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:52.987035 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25d764-2e6a-4e5a-9937-833226dd0a5f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:52.987307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25d764-2e6a-4e5a-9937-833226dd0a5f None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:52.988196 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25d764-2e6a-4e5a-9937-833226dd0a5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:52.989795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25d764-2e6a-4e5a-9937-833226dd0a5f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:53.013371 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 437/871] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:32:52 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:32:53.024548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042d909-5cf4-4058-9a2b-397166c977fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:53.025635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042d909-5cf4-4058-9a2b-397166c977fd None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:53.026198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042d909-5cf4-4058-9a2b-397166c977fd None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:53.026671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042d909-5cf4-4058-9a2b-397166c977fd None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:53.027710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042d909-5cf4-4058-9a2b-397166c977fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:53.028234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042d909-5cf4-4058-9a2b-397166c977fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:53.030032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042d909-5cf4-4058-9a2b-397166c977fd None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:53.044899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 435/872] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:53.050945 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25d764-2e6a-4e5a-9937-833226dd0a5f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:53.054216 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:53.170859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25d764-2e6a-4e5a-9937-833226dd0a5f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:53.208261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873a461-448e-4cff-9f2a-24e921eb05d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:53.208897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873a461-448e-4cff-9f2a-24e921eb05d6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:53.209198 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873a461-448e-4cff-9f2a-24e921eb05d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:53.209501 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873a461-448e-4cff-9f2a-24e921eb05d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:53.210331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873a461-448e-4cff-9f2a-24e921eb05d6 None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=1a3ecd4bf47a4842b522ccdb575203d6) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:53.210641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873a461-448e-4cff-9f2a-24e921eb05d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:53.212090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873a461-448e-4cff-9f2a-24e921eb05d6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:53.219333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 438/873] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:53 2022] GET /identity/v3/role_assignments?user.id=1a3ecd4bf47a4842b522ccdb575203d6&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:53.437665 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d363d-3dae-49d9-9e9f-fb2fc79e9af0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:53.438360 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d363d-3dae-49d9-9e9f-fb2fc79e9af0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:53.438839 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d363d-3dae-49d9-9e9f-fb2fc79e9af0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:53.440702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 436/874] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:53.445935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7e380-d51d-4851-a23f-8150c7d864be None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:53.446223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7e380-d51d-4851-a23f-8150c7d864be None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:53.446496 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7e380-d51d-4851-a23f-8150c7d864be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:53.462104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c86c7-fe43-4fa1-b098-c7fab66d5f25 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:53.462508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c86c7-fe43-4fa1-b098-c7fab66d5f25 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:53.462662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c86c7-fe43-4fa1-b098-c7fab66d5f25 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:53.464330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 437/875] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:32:53.466849 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1fb7e380-d51d-4851-a23f-8150c7d864be None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:53.468197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1fb7e380-d51d-4851-a23f-8150c7d864be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:53.469749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a49915-3390-43bf-b64b-4ecf21583fa9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:53.470144 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a49915-3390-43bf-b64b-4ecf21583fa9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:53.471472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a49915-3390-43bf-b64b-4ecf21583fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:53.493874 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f7a49915-3390-43bf-b64b-4ecf21583fa9 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:53.495232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f7a49915-3390-43bf-b64b-4ecf21583fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:53.545312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:53.559053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 439/876] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:32:53.582439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7e380-d51d-4851-a23f-8150c7d864be None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:53.588031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 438/877] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:32:53.615491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a49915-3390-43bf-b64b-4ecf21583fa9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:53.673445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:53.709491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7e380-d51d-4851-a23f-8150c7d864be None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:53.728910 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a49915-3390-43bf-b64b-4ecf21583fa9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:53.750330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90127d-4da6-490d-a3e1-6af69494dc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:53.751321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90127d-4da6-490d-a3e1-6af69494dc5e None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:53.751670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90127d-4da6-490d-a3e1-6af69494dc5e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:53.752068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90127d-4da6-490d-a3e1-6af69494dc5e None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:53.752849 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90127d-4da6-490d-a3e1-6af69494dc5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:53.754365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90127d-4da6-490d-a3e1-6af69494dc5e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:53.768081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12d2dc-3448-4dd6-aa5b-c5ca155e36b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:53.769417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12d2dc-3448-4dd6-aa5b-c5ca155e36b9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:53.770013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12d2dc-3448-4dd6-aa5b-c5ca155e36b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:53.770559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12d2dc-3448-4dd6-aa5b-c5ca155e36b9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:53.771404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12d2dc-3448-4dd6-aa5b-c5ca155e36b9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:53.772960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12d2dc-3448-4dd6-aa5b-c5ca155e36b9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:53.777448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 440/878] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:32:53 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-0c12d2dc-3448-4dd6-aa5b-c5ca155e36b9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:53.790331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:53.791438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:32:53.792969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:53.796358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 439/879] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 02:32:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:53.803108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90127d-4da6-490d-a3e1-6af69494dc5e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:53.870872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:53.928401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90127d-4da6-490d-a3e1-6af69494dc5e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:53.963095 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f373b0-a768-49d7-80c1-8c7b0f8060f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:53.964596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f373b0-a768-49d7-80c1-8c7b0f8060f7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:53.964879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f373b0-a768-49d7-80c1-8c7b0f8060f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:53.965152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f373b0-a768-49d7-80c1-8c7b0f8060f7 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:53.965883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f373b0-a768-49d7-80c1-8c7b0f8060f7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:53.966244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f373b0-a768-49d7-80c1-8c7b0f8060f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:53.967654 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f373b0-a768-49d7-80c1-8c7b0f8060f7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:53.973271 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 441/880] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 02:32:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:53.979516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12d2dc-3448-4dd6-aa5b-c5ca155e36b9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:54.081179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12d2dc-3448-4dd6-aa5b-c5ca155e36b9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:54.098020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:54.117523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd8f68-37ef-4a01-ad52-15869138bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:54.118149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd8f68-37ef-4a01-ad52-15869138bde3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:54.118425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd8f68-37ef-4a01-ad52-15869138bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:54.118694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd8f68-37ef-4a01-ad52-15869138bde3 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:54.119424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd8f68-37ef-4a01-ad52-15869138bde3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:54.119788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd8f68-37ef-4a01-ad52-15869138bde3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:54.121169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd8f68-37ef-4a01-ad52-15869138bde3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:54.126331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 440/881] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 02:32:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:55.119320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ccb23-b8c2-4f6f-818b-414785885a8e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:55.119891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ccb23-b8c2-4f6f-818b-414785885a8e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:55.119891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ccb23-b8c2-4f6f-818b-414785885a8e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:55.121416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 442/882] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:55.126709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346198-4c69-4f0b-81f1-4b06367ba35f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:55.127100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346198-4c69-4f0b-81f1-4b06367ba35f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:55.127285 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346198-4c69-4f0b-81f1-4b06367ba35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:55.145587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9b346198-4c69-4f0b-81f1-4b06367ba35f None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:55.146777 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9b346198-4c69-4f0b-81f1-4b06367ba35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:55.214462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 441/883] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:32:55.237124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ccb23-b8c2-4f6f-818b-414785885a8e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:55.343279 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ccb23-b8c2-4f6f-818b-414785885a8e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:55.351667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73054483-0602-4975-80b7-f6a3fe2d1c4d None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:55.351667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73054483-0602-4975-80b7-f6a3fe2d1c4d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:55.351667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73054483-0602-4975-80b7-f6a3fe2d1c4d None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:55.352982 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 442/884] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:55.358099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91436c27-d1bb-4c51-a784-389571de8bf1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:55.358624 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91436c27-d1bb-4c51-a784-389571de8bf1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:55.359082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91436c27-d1bb-4c51-a784-389571de8bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:55.360495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:55.379644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463c279-0e97-4c7b-a248-d4a2bccc8edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:55.380254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463c279-0e97-4c7b-a248-d4a2bccc8edf None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:55.380528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463c279-0e97-4c7b-a248-d4a2bccc8edf None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:55.380846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463c279-0e97-4c7b-a248-d4a2bccc8edf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:55.381502 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463c279-0e97-4c7b-a248-d4a2bccc8edf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:55.382921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463c279-0e97-4c7b-a248-d4a2bccc8edf None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:55.385235 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-91436c27-d1bb-4c51-a784-389571de8bf1 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:55.387125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-91436c27-d1bb-4c51-a784-389571de8bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-4463c279-0e97-4c7b-a248-d4a2bccc8edf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:55.392601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:55.393659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:55.394516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 443/885] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:32:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:55.400317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463c279-0e97-4c7b-a248-d4a2bccc8edf None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:55.468840 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 443/886] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:32:55.491534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91436c27-d1bb-4c51-a784-389571de8bf1 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:55.507055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463c279-0e97-4c7b-a248-d4a2bccc8edf None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:55.543762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:55.558532 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9556a-50eb-4271-a39d-f9de9d5a0b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:55.559163 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9556a-50eb-4271-a39d-f9de9d5a0b31 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:55.559685 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9556a-50eb-4271-a39d-f9de9d5a0b31 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:55.559963 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9556a-50eb-4271-a39d-f9de9d5a0b31 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:55.561110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9556a-50eb-4271-a39d-f9de9d5a0b31 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:55.561613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9556a-50eb-4271-a39d-f9de9d5a0b31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:55.563439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9556a-50eb-4271-a39d-f9de9d5a0b31 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:55.571335 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 444/887] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:32:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:55.577556 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9556a-50eb-4271-a39d-f9de9d5a0b31 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:55.607626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91436c27-d1bb-4c51-a784-389571de8bf1 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:55.642626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876c0ac-d989-4559-8922-f6e0f8264ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:55.643274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876c0ac-d989-4559-8922-f6e0f8264ca8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:55.643550 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876c0ac-d989-4559-8922-f6e0f8264ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:55.643818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876c0ac-d989-4559-8922-f6e0f8264ca8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:55.644612 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:55.656835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876c0ac-d989-4559-8922-f6e0f8264ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-6876c0ac-d989-4559-8922-f6e0f8264ca8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:32:55.662642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:55.663822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:55.669948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:55.669948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:55.669948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:55.669948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:55.669948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:32:55.669948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:32:55.669948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:32:55.669948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:32:55.669948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:32:55.669948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:32:55.669948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 02:32:55.669948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:55.669948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 444/888] 10.222.0.39 () {56 vars in 1120 bytes} [Tue Jul 26 02:32:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:55.672263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876c0ac-d989-4559-8922-f6e0f8264ca8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:55.708073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9556a-50eb-4271-a39d-f9de9d5a0b31 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:55.748046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba45c1-09cc-4c95-ada7-02a0f20fba80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:55.749188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba45c1-09cc-4c95-ada7-02a0f20fba80 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:55.749688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba45c1-09cc-4c95-ada7-02a0f20fba80 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:55.750180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba45c1-09cc-4c95-ada7-02a0f20fba80 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:55.751195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba45c1-09cc-4c95-ada7-02a0f20fba80 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:55.751696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba45c1-09cc-4c95-ada7-02a0f20fba80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:55.753384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba45c1-09cc-4c95-ada7-02a0f20fba80 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:55.759489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 445/889] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:32:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:55.764920 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba45c1-09cc-4c95-ada7-02a0f20fba80 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:55.792105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:55.795533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876c0ac-d989-4559-8922-f6e0f8264ca8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:55.831361 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7d470-f49c-4f0e-833d-77615ab3078b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:55.832460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7d470-f49c-4f0e-833d-77615ab3078b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:55.832965 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7d470-f49c-4f0e-833d-77615ab3078b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:55.833474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7d470-f49c-4f0e-833d-77615ab3078b None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:55.834485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7d470-f49c-4f0e-833d-77615ab3078b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:55.835050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7d470-f49c-4f0e-833d-77615ab3078b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:55.836629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7d470-f49c-4f0e-833d-77615ab3078b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:55.851686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 445/890] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 02:32:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:55.853245 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7d470-f49c-4f0e-833d-77615ab3078b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:55.874150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba45c1-09cc-4c95-ada7-02a0f20fba80 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:55.884194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:55.911363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581524df-b022-4038-b448-8fd2f98dd16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:55.911991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581524df-b022-4038-b448-8fd2f98dd16e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:55.912271 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581524df-b022-4038-b448-8fd2f98dd16e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:55.912542 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581524df-b022-4038-b448-8fd2f98dd16e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:55.913344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581524df-b022-4038-b448-8fd2f98dd16e None admin] RBAC: Adding query filter params (interface=public, service_id=968e8a1f731849c3b6887bd9495992c4, region_id=RegionOne) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:55.913634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581524df-b022-4038-b448-8fd2f98dd16e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:55.915015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581524df-b022-4038-b448-8fd2f98dd16e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:55.920338 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 446/891] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 02:32:55 2022] GET /identity/v3/endpoints?service_id=968e8a1f731849c3b6887bd9495992c4&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:55.924922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860d8f2-5526-4437-94f2-a7fc120d5af3 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:55.924922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860d8f2-5526-4437-94f2-a7fc120d5af3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:55.924922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860d8f2-5526-4437-94f2-a7fc120d5af3 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:55.924922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 447/892] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:55.927946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860d8f2-5526-4437-94f2-a7fc120d5af3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:55.971499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7d470-f49c-4f0e-833d-77615ab3078b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:56.008189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50a392-bc3f-4971-8f4a-109669cf7985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:56.008835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50a392-bc3f-4971-8f4a-109669cf7985 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:56.009115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50a392-bc3f-4971-8f4a-109669cf7985 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:56.009416 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50a392-bc3f-4971-8f4a-109669cf7985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:56.019960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50a392-bc3f-4971-8f4a-109669cf7985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:56.021441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50a392-bc3f-4971-8f4a-109669cf7985 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-1b50a392-bc3f-4971-8f4a-109669cf7985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:56.035883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:56.036808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:56.037728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:56.037728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:56.037728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:56.037728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:56.037728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 446/893] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:56.038358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948690e2-5113-47a4-ac4d-344919889e64 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:56.038541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948690e2-5113-47a4-ac4d-344919889e64 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:56.038815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948690e2-5113-47a4-ac4d-344919889e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:56.039390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860d8f2-5526-4437-94f2-a7fc120d5af3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:56.056678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-948690e2-5113-47a4-ac4d-344919889e64 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:56.058128 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-948690e2-5113-47a4-ac4d-344919889e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:56.068556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:56.076523 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6701d0-b44d-47c2-9836-79545d7bfd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:56.077190 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6701d0-b44d-47c2-9836-79545d7bfd01 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:56.077456 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6701d0-b44d-47c2-9836-79545d7bfd01 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:56.077730 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6701d0-b44d-47c2-9836-79545d7bfd01 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:56.078389 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6701d0-b44d-47c2-9836-79545d7bfd01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:56.079753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6701d0-b44d-47c2-9836-79545d7bfd01 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:56.086041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 448/894] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 02:32:55 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:32:56.086632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6701d0-b44d-47c2-9836-79545d7bfd01 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:56.127975 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:56.160676 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 447/895] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:32:56.162856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0383ba-99f2-4e10-8fa7-c5cb32e7d08e None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:56.163211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0383ba-99f2-4e10-8fa7-c5cb32e7d08e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:56.163548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0383ba-99f2-4e10-8fa7-c5cb32e7d08e None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:56.165124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 448/896] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:56.171179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe1440-59a0-4bb1-ae81-3b6d01775e91 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:56.171593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe1440-59a0-4bb1-ae81-3b6d01775e91 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:56.171991 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe1440-59a0-4bb1-ae81-3b6d01775e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:56.194089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-34fe1440-59a0-4bb1-ae81-3b6d01775e91 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:56.195577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-34fe1440-59a0-4bb1-ae81-3b6d01775e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:56.213032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6701d0-b44d-47c2-9836-79545d7bfd01 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:56.254336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aee991-4dcb-455a-b849-aa0dbfe23286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:56.254962 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aee991-4dcb-455a-b849-aa0dbfe23286 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:56.255243 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aee991-4dcb-455a-b849-aa0dbfe23286 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:56.255889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aee991-4dcb-455a-b849-aa0dbfe23286 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:56.256211 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aee991-4dcb-455a-b849-aa0dbfe23286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:56.256511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aee991-4dcb-455a-b849-aa0dbfe23286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:56.257976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aee991-4dcb-455a-b849-aa0dbfe23286 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:56.270998 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 449/897] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:56.271831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aee991-4dcb-455a-b849-aa0dbfe23286 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:56.275851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 449/898] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:32:56.276905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe1440-59a0-4bb1-ae81-3b6d01775e91 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:56.354077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:56.380572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe1440-59a0-4bb1-ae81-3b6d01775e91 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:56.384912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:56.391828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aee991-4dcb-455a-b849-aa0dbfe23286 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:56.416037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba80ae-76f6-4ddd-baf2-3b1b1cc44640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:56.416671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba80ae-76f6-4ddd-baf2-3b1b1cc44640 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:56.416948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba80ae-76f6-4ddd-baf2-3b1b1cc44640 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:56.417224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba80ae-76f6-4ddd-baf2-3b1b1cc44640 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:56.424792 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba80ae-76f6-4ddd-baf2-3b1b1cc44640 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:56.426280 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba80ae-76f6-4ddd-baf2-3b1b1cc44640 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:56.427957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca8963-7cb8-4c39-bf6a-db00008cf48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:56.428624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca8963-7cb8-4c39-bf6a-db00008cf48c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:56.429321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca8963-7cb8-4c39-bf6a-db00008cf48c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:56.429321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca8963-7cb8-4c39-bf6a-db00008cf48c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:56.429819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca8963-7cb8-4c39-bf6a-db00008cf48c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:56.431168 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca8963-7cb8-4c39-bf6a-db00008cf48c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a3ba80ae-76f6-4ddd-baf2-3b1b1cc44640 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:32:56.438860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:56.439782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:56.440711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:56.440711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:56.440711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:32:56.440711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:32:56.440711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:32:56.440711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:32:56.440711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:32:56.440711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:32:56.440711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 02:32:56.440711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0fca8963-7cb8-4c39-bf6a-db00008cf48c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:56.441234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:56.442189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:56.444287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 450/899] 10.222.0.39 () {56 vars in 1132 bytes} [Tue Jul 26 02:32:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:56.447375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca8963-7cb8-4c39-bf6a-db00008cf48c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:56.449494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 450/900] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 02:32:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:56.450310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba80ae-76f6-4ddd-baf2-3b1b1cc44640 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:56.548780 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca8963-7cb8-4c39-bf6a-db00008cf48c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:56.556106 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba80ae-76f6-4ddd-baf2-3b1b1cc44640 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:56.587338 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a142cd-2ff6-4bf1-ad98-3dd5a3767387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:56.588611 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a142cd-2ff6-4bf1-ad98-3dd5a3767387 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:56.589331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a142cd-2ff6-4bf1-ad98-3dd5a3767387 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:56.589746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a142cd-2ff6-4bf1-ad98-3dd5a3767387 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:56.590656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a142cd-2ff6-4bf1-ad98-3dd5a3767387 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:56.592162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a142cd-2ff6-4bf1-ad98-3dd5a3767387 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:56.592826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fc51c-31c4-475b-9674-b1cfbbc0f50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:56.593506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fc51c-31c4-475b-9674-b1cfbbc0f50e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:56.593782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fc51c-31c4-475b-9674-b1cfbbc0f50e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:56.594056 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fc51c-31c4-475b-9674-b1cfbbc0f50e None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:56.594862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fc51c-31c4-475b-9674-b1cfbbc0f50e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:56.595162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fc51c-31c4-475b-9674-b1cfbbc0f50e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:56.596585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fc51c-31c4-475b-9674-b1cfbbc0f50e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:56.598373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:56.619181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 451/901] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:32:56 2022] POST /identity/v3/services => generated 241 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:32:56.619831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 451/902] 10.222.0.39 () {56 vars in 1149 bytes} [Tue Jul 26 02:32:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:56.620723 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a142cd-2ff6-4bf1-ad98-3dd5a3767387 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:56.625402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fc51c-31c4-475b-9674-b1cfbbc0f50e None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:56.655191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:56.759426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a142cd-2ff6-4bf1-ad98-3dd5a3767387 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:56.796173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fc51c-31c4-475b-9674-b1cfbbc0f50e None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:56.798528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a10aec-da3c-4f33-b61f-f8fb3606fea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:56.799157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a10aec-da3c-4f33-b61f-f8fb3606fea3 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:56.799435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a10aec-da3c-4f33-b61f-f8fb3606fea3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:56.799750 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a10aec-da3c-4f33-b61f-f8fb3606fea3 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:56.800390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a10aec-da3c-4f33-b61f-f8fb3606fea3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:56.800690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a10aec-da3c-4f33-b61f-f8fb3606fea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:56.803033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a10aec-da3c-4f33-b61f-f8fb3606fea3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:56.809209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 452/903] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 02:32:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:56.814880 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a10aec-da3c-4f33-b61f-f8fb3606fea3 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:56.841520 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c92b0-68b3-4d60-8aab-75b178ebfe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:56.842179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c92b0-68b3-4d60-8aab-75b178ebfe8a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:56.842613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c92b0-68b3-4d60-8aab-75b178ebfe8a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:56.842894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c92b0-68b3-4d60-8aab-75b178ebfe8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:56.904854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:56.921761 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:56.925953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a10aec-da3c-4f33-b61f-f8fb3606fea3 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:56.931864 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c92b0-68b3-4d60-8aab-75b178ebfe8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:56.934504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c92b0-68b3-4d60-8aab-75b178ebfe8a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:56.963170 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f5229-7918-4e69-b9c1-a56f55e816c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:56.963858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5229-7918-4e69-b9c1-a56f55e816c4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:56.964137 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5229-7918-4e69-b9c1-a56f55e816c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:56.964410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f5229-7918-4e69-b9c1-a56f55e816c4 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:56.965091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f5229-7918-4e69-b9c1-a56f55e816c4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:56.965409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f5229-7918-4e69-b9c1-a56f55e816c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:56.967046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f5229-7918-4e69-b9c1-a56f55e816c4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:56.977631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 453/904] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 02:32:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:56.978500 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f5229-7918-4e69-b9c1-a56f55e816c4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:57.056826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 452/905] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:32:56 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:32:57.062238 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c92b0-68b3-4d60-8aab-75b178ebfe8a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:57.088177 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f5229-7918-4e69-b9c1-a56f55e816c4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:57.124449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992c692-c804-499b-bb95-40be8ed000d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:57.125077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992c692-c804-499b-bb95-40be8ed000d9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:57.125384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992c692-c804-499b-bb95-40be8ed000d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:57.125657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992c692-c804-499b-bb95-40be8ed000d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:57.126431 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992c692-c804-499b-bb95-40be8ed000d9 None admin] RBAC: Adding query filter params (interface=public, service_id=7414c9251de0453fa44cdae21c4064df, region_id=RegionOne) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:57.127006 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992c692-c804-499b-bb95-40be8ed000d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:57.128086 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992c692-c804-499b-bb95-40be8ed000d9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:57.137713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 454/906] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 02:32:56 2022] GET /identity/v3/endpoints?service_id=7414c9251de0453fa44cdae21c4064df&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:57.139481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992c692-c804-499b-bb95-40be8ed000d9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:57.151629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:57.183685 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:57.193687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c92b0-68b3-4d60-8aab-75b178ebfe8a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:57.230727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b02028-06a7-48a5-b66d-90f42837b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:57.231742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b02028-06a7-48a5-b66d-90f42837b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:57.232210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b02028-06a7-48a5-b66d-90f42837b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:57.232705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b02028-06a7-48a5-b66d-90f42837b0a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:57.245221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b02028-06a7-48a5-b66d-90f42837b0a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:57.246992 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b02028-06a7-48a5-b66d-90f42837b0a7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a4b02028-06a7-48a5-b66d-90f42837b0a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:32:57.262186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:57.263088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:57.263976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:32:57.263976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:32:57.263976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:32:57.263976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:57.266232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 453/907] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:57.266953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992c692-c804-499b-bb95-40be8ed000d9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:57.274218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b02028-06a7-48a5-b66d-90f42837b0a7 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:57.301944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dba2fc-9987-4c33-9f8e-301a8a86247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:57.302963 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dba2fc-9987-4c33-9f8e-301a8a86247e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:57.303433 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dba2fc-9987-4c33-9f8e-301a8a86247e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:57.303891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dba2fc-9987-4c33-9f8e-301a8a86247e None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:57.304729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dba2fc-9987-4c33-9f8e-301a8a86247e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:57.306304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dba2fc-9987-4c33-9f8e-301a8a86247e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:57.313015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 455/908] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 02:32:57 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:32:57.392527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b02028-06a7-48a5-b66d-90f42837b0a7 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:57.430208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06ebb9-2d5a-459e-9d87-fef01b325d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:57.430859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06ebb9-2d5a-459e-9d87-fef01b325d0d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:57.431130 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06ebb9-2d5a-459e-9d87-fef01b325d0d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:57.431406 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06ebb9-2d5a-459e-9d87-fef01b325d0d None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:57.432177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06ebb9-2d5a-459e-9d87-fef01b325d0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:57.432480 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06ebb9-2d5a-459e-9d87-fef01b325d0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:57.433911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06ebb9-2d5a-459e-9d87-fef01b325d0d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:57.448063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 454/909] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:57.453459 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dba2fc-9987-4c33-9f8e-301a8a86247e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:57.532762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:57.564512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dba2fc-9987-4c33-9f8e-301a8a86247e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:57.598251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49059a4-e0fd-4e3a-b57e-1d3118b2a85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:57.598896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49059a4-e0fd-4e3a-b57e-1d3118b2a85b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:57.599176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49059a4-e0fd-4e3a-b57e-1d3118b2a85b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:57.599446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49059a4-e0fd-4e3a-b57e-1d3118b2a85b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:57.608745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49059a4-e0fd-4e3a-b57e-1d3118b2a85b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:57.608745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49059a4-e0fd-4e3a-b57e-1d3118b2a85b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b49059a4-e0fd-4e3a-b57e-1d3118b2a85b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:32:57.620429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:57.621392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:57.622727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:32:57.622727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:32:57.622727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:32:57.622727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:32:57.622727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:32:57.622727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:32:57.622727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:32:57.622727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:57.622727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 456/910] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:32:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:57.633680 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06ebb9-2d5a-459e-9d87-fef01b325d0d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:57.638193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:57.738259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06ebb9-2d5a-459e-9d87-fef01b325d0d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:57.772969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688ca57-7251-40d2-a003-bd8965c25471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:57.774009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688ca57-7251-40d2-a003-bd8965c25471 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:57.774503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688ca57-7251-40d2-a003-bd8965c25471 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:57.774961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688ca57-7251-40d2-a003-bd8965c25471 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:57.776041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688ca57-7251-40d2-a003-bd8965c25471 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:57.776548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688ca57-7251-40d2-a003-bd8965c25471 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:57.778223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688ca57-7251-40d2-a003-bd8965c25471 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:57.791086 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 455/911] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:32:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:57.797520 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49059a4-e0fd-4e3a-b57e-1d3118b2a85b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:57.900261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49059a4-e0fd-4e3a-b57e-1d3118b2a85b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:57.933855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:57.939381 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f27e35-4dd6-44bc-ab27-05df36556db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:57.940016 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f27e35-4dd6-44bc-ab27-05df36556db9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:57.940298 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f27e35-4dd6-44bc-ab27-05df36556db9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:57.940570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f27e35-4dd6-44bc-ab27-05df36556db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:57.941394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f27e35-4dd6-44bc-ab27-05df36556db9 None admin] RBAC: Adding query filter params (role.id=ad2dba59bed14bb1b37cab7b9d4ef96d, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=1a3ecd4bf47a4842b522ccdb575203d6) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:57.941714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f27e35-4dd6-44bc-ab27-05df36556db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:57.943163 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f27e35-4dd6-44bc-ab27-05df36556db9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:57.949433 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 457/912] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:32:57 2022] GET /identity/v3/role_assignments?user.id=1a3ecd4bf47a4842b522ccdb575203d6&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=ad2dba59bed14bb1b37cab7b9d4ef96d => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:58.188744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b05a6-64cb-4136-8861-65ae45462f75 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:58.189257 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b05a6-64cb-4136-8861-65ae45462f75 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:58.189508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b05a6-64cb-4136-8861-65ae45462f75 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:58.191215 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 456/913] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:58.196489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d3acc-9f4d-4fd8-831d-dbfbb642f5ae None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:58.196911 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d3acc-9f4d-4fd8-831d-dbfbb642f5ae None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:58.197231 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d3acc-9f4d-4fd8-831d-dbfbb642f5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:58.215855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9a5d3acc-9f4d-4fd8-831d-dbfbb642f5ae None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:58.217046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9a5d3acc-9f4d-4fd8-831d-dbfbb642f5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:58.286566 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 458/914] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:32:58.309206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b05a6-64cb-4136-8861-65ae45462f75 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:58.378553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:58.420028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b05a6-64cb-4136-8861-65ae45462f75 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:58.454291 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa1841-91d4-4107-8ba7-2fc07e331682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:58.455284 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa1841-91d4-4107-8ba7-2fc07e331682 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:58.455754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa1841-91d4-4107-8ba7-2fc07e331682 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:58.456231 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa1841-91d4-4107-8ba7-2fc07e331682 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:58.457059 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa1841-91d4-4107-8ba7-2fc07e331682 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:58.458728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa1841-91d4-4107-8ba7-2fc07e331682 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-7efa1841-91d4-4107-8ba7-2fc07e331682 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:58.468454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:58.469492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 02:32:58.470350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:58.473185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 457/915] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:32:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:32:58.485330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d3acc-9f4d-4fd8-831d-dbfbb642f5ae None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:58.580471 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d3acc-9f4d-4fd8-831d-dbfbb642f5ae None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:58.613652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:58.617128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa068c16-6cfb-4aee-a5fd-c8e87973c5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:58.617834 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa068c16-6cfb-4aee-a5fd-c8e87973c5e8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:58.619647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa068c16-6cfb-4aee-a5fd-c8e87973c5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:58.619647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa068c16-6cfb-4aee-a5fd-c8e87973c5e8 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:58.619647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa068c16-6cfb-4aee-a5fd-c8e87973c5e8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:58.619647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa068c16-6cfb-4aee-a5fd-c8e87973c5e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:58.621210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa068c16-6cfb-4aee-a5fd-c8e87973c5e8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:58.626816 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 459/916] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:32:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:58.632470 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa1841-91d4-4107-8ba7-2fc07e331682 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:58.699686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1b3fb-fe66-430d-bfbe-45da8792c705 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:58.700019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1b3fb-fe66-430d-bfbe-45da8792c705 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:58.700238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1b3fb-fe66-430d-bfbe-45da8792c705 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:58.701867 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 460/917] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:32:58.708556 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5e363-1824-4cd8-867d-67462d332968 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:58.708786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5e363-1824-4cd8-867d-67462d332968 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:58.709040 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5e363-1824-4cd8-867d-67462d332968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:58.731606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c2f5e363-1824-4cd8-867d-67462d332968 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:58.732956 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c2f5e363-1824-4cd8-867d-67462d332968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:58.741859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa1841-91d4-4107-8ba7-2fc07e331682 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:58.776193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2eeda-5b8e-42f9-ae46-824fecb1fe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:58.777140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2eeda-5b8e-42f9-ae46-824fecb1fe56 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:58.777867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2eeda-5b8e-42f9-ae46-824fecb1fe56 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:58.778358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2eeda-5b8e-42f9-ae46-824fecb1fe56 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:58.779238 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2eeda-5b8e-42f9-ae46-824fecb1fe56 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:58.779737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2eeda-5b8e-42f9-ae46-824fecb1fe56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:58.781347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2eeda-5b8e-42f9-ae46-824fecb1fe56 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:58.786586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 458/918] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 02:32:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:58.789484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:58.793249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2eeda-5b8e-42f9-ae46-824fecb1fe56 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:58.819534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 461/919] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:32:58.841103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5e363-1824-4cd8-867d-67462d332968 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:58.911120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2eeda-5b8e-42f9-ae46-824fecb1fe56 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:58.948817 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5e363-1824-4cd8-867d-67462d332968 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:58.958960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec1d54-896d-4146-be6c-d5d9b94abdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:58.960342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec1d54-896d-4146-be6c-d5d9b94abdf6 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:58.961224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec1d54-896d-4146-be6c-d5d9b94abdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:58.961721 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec1d54-896d-4146-be6c-d5d9b94abdf6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:58.962913 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec1d54-896d-4146-be6c-d5d9b94abdf6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:58.965274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec1d54-896d-4146-be6c-d5d9b94abdf6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:58.971314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:58.987480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69609eb-6352-4348-a832-cb2a75bdf172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:58.988153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69609eb-6352-4348-a832-cb2a75bdf172 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:58.988511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69609eb-6352-4348-a832-cb2a75bdf172 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:58.989036 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69609eb-6352-4348-a832-cb2a75bdf172 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:58.989498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69609eb-6352-4348-a832-cb2a75bdf172 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:58.991021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69609eb-6352-4348-a832-cb2a75bdf172 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:58.995713 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 459/920] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:32:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b69609eb-6352-4348-a832-cb2a75bdf172 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:59.001446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:59.002461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:32:59.003309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 462/921] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 02:32:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:59.010704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69609eb-6352-4348-a832-cb2a75bdf172 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:59.132855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69609eb-6352-4348-a832-cb2a75bdf172 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:59.178151 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca0f37-9b88-48ae-958b-ea4282825c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:59.179174 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0f37-9b88-48ae-958b-ea4282825c04 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:59.179670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0f37-9b88-48ae-958b-ea4282825c04 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:59.180151 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca0f37-9b88-48ae-958b-ea4282825c04 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:59.180841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca0f37-9b88-48ae-958b-ea4282825c04 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:59.181145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca0f37-9b88-48ae-958b-ea4282825c04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:59.182646 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca0f37-9b88-48ae-958b-ea4282825c04 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:59.187914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 463/922] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 02:32:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:59.194323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec1d54-896d-4146-be6c-d5d9b94abdf6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:59.250957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:59.305326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec1d54-896d-4146-be6c-d5d9b94abdf6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:59.339418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b983579-0d63-4005-ba95-c3c7f4e03d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:59.340093 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b983579-0d63-4005-ba95-c3c7f4e03d7c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:59.340371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b983579-0d63-4005-ba95-c3c7f4e03d7c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:59.340684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b983579-0d63-4005-ba95-c3c7f4e03d7c None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:59.341484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b983579-0d63-4005-ba95-c3c7f4e03d7c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:59.341851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b983579-0d63-4005-ba95-c3c7f4e03d7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:59.343233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b983579-0d63-4005-ba95-c3c7f4e03d7c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:59.348908 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 460/923] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 02:32:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:59.355640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca0f37-9b88-48ae-958b-ea4282825c04 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:59.405783 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:59.457173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2cf89-72cb-42ed-8417-7f58d06284da None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:59.457553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2cf89-72cb-42ed-8417-7f58d06284da None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:59.457842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2cf89-72cb-42ed-8417-7f58d06284da None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:59.459229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 461/924] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:32:59.461570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca0f37-9b88-48ae-958b-ea4282825c04 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:59.465166 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2de2-b878-4a92-ba86-1980315f5dfe None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:59.465487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2de2-b878-4a92-ba86-1980315f5dfe None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:59.465759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2de2-b878-4a92-ba86-1980315f5dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:59.489326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-83ef2de2-b878-4a92-ba86-1980315f5dfe None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:59.491695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-83ef2de2-b878-4a92-ba86-1980315f5dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:32:59.501690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2ee9e-23ae-4514-a956-eee3f6672413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:59.502653 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2ee9e-23ae-4514-a956-eee3f6672413 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:59.502653 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2ee9e-23ae-4514-a956-eee3f6672413 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:59.502898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2ee9e-23ae-4514-a956-eee3f6672413 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:59.503827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2ee9e-23ae-4514-a956-eee3f6672413 None admin] RBAC: Adding query filter params (interface=public, service_id=8465a444ec06475a9091f3cc5f7ab997, region_id=RegionOne) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:59.504201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2ee9e-23ae-4514-a956-eee3f6672413 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:59.505737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2ee9e-23ae-4514-a956-eee3f6672413 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:59.515950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 464/925] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 02:32:59 2022] GET /identity/v3/endpoints?service_id=8465a444ec06475a9091f3cc5f7ab997&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:32:59.517022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2ee9e-23ae-4514-a956-eee3f6672413 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:59.593473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 462/926] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:32:59.611639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef2de2-b878-4a92-ba86-1980315f5dfe None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:59.636444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2ee9e-23ae-4514-a956-eee3f6672413 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:59.645943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:59.668856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:32:59.673050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1362563-b529-4b91-80d1-df875589d310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:59.673742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1362563-b529-4b91-80d1-df875589d310 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:59.674021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1362563-b529-4b91-80d1-df875589d310 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:59.674289 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1362563-b529-4b91-80d1-df875589d310 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:59.675241 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1362563-b529-4b91-80d1-df875589d310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:59.676674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1362563-b529-4b91-80d1-df875589d310 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:59.693313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 465/927] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 02:32:59 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:32:59.733678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef2de2-b878-4a92-ba86-1980315f5dfe None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:59.772656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbba65c-ce00-4be5-9858-643b2843baa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:59.773252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbba65c-ce00-4be5-9858-643b2843baa1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:59.773563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbba65c-ce00-4be5-9858-643b2843baa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:59.773840 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbba65c-ce00-4be5-9858-643b2843baa1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:59.774487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbba65c-ce00-4be5-9858-643b2843baa1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:59.775981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbba65c-ce00-4be5-9858-643b2843baa1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-0dbba65c-ce00-4be5-9858-643b2843baa1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:32:59.785925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:32:59.787007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:32:59.787896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 463/928] 10.222.0.39 () {56 vars in 1132 bytes} [Tue Jul 26 02:32:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:32:59.795605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1362563-b529-4b91-80d1-df875589d310 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:59.905954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1362563-b529-4b91-80d1-df875589d310 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:32:59.940705 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a3569-e3f9-46ac-9fb2-f300186903b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:32:59.941745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a3569-e3f9-46ac-9fb2-f300186903b8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:59.942247 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a3569-e3f9-46ac-9fb2-f300186903b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:59.942719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a3569-e3f9-46ac-9fb2-f300186903b8 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:59.943596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a3569-e3f9-46ac-9fb2-f300186903b8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:32:59.944120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a3569-e3f9-46ac-9fb2-f300186903b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:32:59.945720 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a3569-e3f9-46ac-9fb2-f300186903b8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:32:59.951307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 466/929] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 02:32:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:32:59.957478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbba65c-ce00-4be5-9858-643b2843baa1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:32:59.969890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea631-0194-4a41-af62-4816a8ce4d4c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:59.970153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea631-0194-4a41-af62-4816a8ce4d4c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:59.970460 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ea631-0194-4a41-af62-4816a8ce4d4c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:59.972053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 467/930] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:32:59.977560 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459909a-8b2e-435c-8372-de0d5c84d86e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:32:59.977848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459909a-8b2e-435c-8372-de0d5c84d86e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:32:59.978130 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459909a-8b2e-435c-8372-de0d5c84d86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:32:59.997564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4459909a-8b2e-435c-8372-de0d5c84d86e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:32:59.998771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4459909a-8b2e-435c-8372-de0d5c84d86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:00.034447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:00.074981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 468/931] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:32:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:33:00.083151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbba65c-ce00-4be5-9858-643b2843baa1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:00.097472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459909a-8b2e-435c-8372-de0d5c84d86e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:00.109673 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:00.120981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797d96f-7e27-47f6-9f8b-dc244e470db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:00.122180 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797d96f-7e27-47f6-9f8b-dc244e470db9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:00.122717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797d96f-7e27-47f6-9f8b-dc244e470db9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:00.123211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797d96f-7e27-47f6-9f8b-dc244e470db9 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:00.124184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797d96f-7e27-47f6-9f8b-dc244e470db9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:00.124845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797d96f-7e27-47f6-9f8b-dc244e470db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:00.126611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797d96f-7e27-47f6-9f8b-dc244e470db9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:00.132686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 464/932] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 02:32:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:00.138916 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797d96f-7e27-47f6-9f8b-dc244e470db9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:00.200170 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459909a-8b2e-435c-8372-de0d5c84d86e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:00.236733 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b97b54-c4d5-4c85-8f40-0ff0b77c414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:00.237438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b97b54-c4d5-4c85-8f40-0ff0b77c414c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:00.237730 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b97b54-c4d5-4c85-8f40-0ff0b77c414c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:00.237995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b97b54-c4d5-4c85-8f40-0ff0b77c414c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:00.251106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b97b54-c4d5-4c85-8f40-0ff0b77c414c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:33:00.251631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797d96f-7e27-47f6-9f8b-dc244e470db9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-84b97b54-c4d5-4c85-8f40-0ff0b77c414c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:33:00.256359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:00.257313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:00.258159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:00.258159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:00.258159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:00.258159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:00.258159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:33:00.258159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:33:00.258159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:33:00.258159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:33:00.258159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:33:00.258159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:33:00.258159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 02:33:00.258159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:00.258159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 469/933] 10.222.0.39 () {56 vars in 1120 bytes} [Tue Jul 26 02:33:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:00.266678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b97b54-c4d5-4c85-8f40-0ff0b77c414c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:00.296116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cea8f9-1d7c-4836-9477-2aada38f8a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:00.296664 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cea8f9-1d7c-4836-9477-2aada38f8a5d None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:00.296945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cea8f9-1d7c-4836-9477-2aada38f8a5d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:00.297218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cea8f9-1d7c-4836-9477-2aada38f8a5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:00.297969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cea8f9-1d7c-4836-9477-2aada38f8a5d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:00.299353 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cea8f9-1d7c-4836-9477-2aada38f8a5d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:00.308498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:00.329312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 465/934] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:33:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:33:00.402251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b97b54-c4d5-4c85-8f40-0ff0b77c414c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:00.448752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce07d0e-e3b9-4780-998d-6d1ca1f2c654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:00.449861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce07d0e-e3b9-4780-998d-6d1ca1f2c654 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:00.450361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce07d0e-e3b9-4780-998d-6d1ca1f2c654 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:00.450828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce07d0e-e3b9-4780-998d-6d1ca1f2c654 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:00.451776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce07d0e-e3b9-4780-998d-6d1ca1f2c654 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:00.452305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce07d0e-e3b9-4780-998d-6d1ca1f2c654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:00.453950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce07d0e-e3b9-4780-998d-6d1ca1f2c654 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:00.465199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 470/935] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 02:33:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:00.470619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cea8f9-1d7c-4836-9477-2aada38f8a5d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:00.501722 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:00.581947 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cea8f9-1d7c-4836-9477-2aada38f8a5d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:00.619730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa413f83-c66c-47fd-a7d4-6bc6634c8542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:00.620392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa413f83-c66c-47fd-a7d4-6bc6634c8542 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:00.620672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa413f83-c66c-47fd-a7d4-6bc6634c8542 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:00.620941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa413f83-c66c-47fd-a7d4-6bc6634c8542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:00.632054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa413f83-c66c-47fd-a7d4-6bc6634c8542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:00.633545 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa413f83-c66c-47fd-a7d4-6bc6634c8542 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-aa413f83-c66c-47fd-a7d4-6bc6634c8542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:33:00.648581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:00.649651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:00.650530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:33:00.650530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:33:00.650530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:00.650530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:00.650530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 466/936] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:00.658605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce07d0e-e3b9-4780-998d-6d1ca1f2c654 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:00.747229 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:00.764589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce07d0e-e3b9-4780-998d-6d1ca1f2c654 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:00.798522 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74eb3d-8b68-4258-9093-8e772bd79ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:00.799145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74eb3d-8b68-4258-9093-8e772bd79ea6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:00.799430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74eb3d-8b68-4258-9093-8e772bd79ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:00.799702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74eb3d-8b68-4258-9093-8e772bd79ea6 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:00.800400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74eb3d-8b68-4258-9093-8e772bd79ea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:00.800706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74eb3d-8b68-4258-9093-8e772bd79ea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:00.802107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74eb3d-8b68-4258-9093-8e772bd79ea6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:00.818673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 471/937] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:00.823999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa413f83-c66c-47fd-a7d4-6bc6634c8542 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:00.910842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:00.933640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa413f83-c66c-47fd-a7d4-6bc6634c8542 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:00.967742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082778cb-cb1b-431f-a237-99adea000845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:00.968391 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082778cb-cb1b-431f-a237-99adea000845 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:00.968671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082778cb-cb1b-431f-a237-99adea000845 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:00.968945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082778cb-cb1b-431f-a237-99adea000845 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:00.978170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082778cb-cb1b-431f-a237-99adea000845 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:00.979727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082778cb-cb1b-431f-a237-99adea000845 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-082778cb-cb1b-431f-a237-99adea000845 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:33:00.991161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:00.992107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:00.993061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:00.993061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:00.993061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:33:00.993061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:33:00.993061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:33:00.993061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:33:00.993061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:33:00.993061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:33:00.993061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 02:33:00.993061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:00.993061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 467/938] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 02:33:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:00.998179 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74eb3d-8b68-4258-9093-8e772bd79ea6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:01.096653 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74eb3d-8b68-4258-9093-8e772bd79ea6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:01.131309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c75cfc-94a5-471a-8522-250480880f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:01.131980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c75cfc-94a5-471a-8522-250480880f99 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:01.132295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c75cfc-94a5-471a-8522-250480880f99 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:01.132572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c75cfc-94a5-471a-8522-250480880f99 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:01.133453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c75cfc-94a5-471a-8522-250480880f99 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:01.133760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c75cfc-94a5-471a-8522-250480880f99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:01.135262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c75cfc-94a5-471a-8522-250480880f99 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:01.152775 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 472/939] 10.222.0.39 () {56 vars in 1149 bytes} [Tue Jul 26 02:33:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:01.158686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082778cb-cb1b-431f-a237-99adea000845 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:01.159721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebf6df-9804-412c-9438-b2efbd6e8bce None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:01.160015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebf6df-9804-412c-9438-b2efbd6e8bce None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:01.160289 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebf6df-9804-412c-9438-b2efbd6e8bce None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:01.161893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 473/940] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:01.169538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a44a1-48a2-44c6-ad6f-96d177448498 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:01.169823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a44a1-48a2-44c6-ad6f-96d177448498 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:01.170100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a44a1-48a2-44c6-ad6f-96d177448498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:01.178312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:01.191092 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-881a44a1-48a2-44c6-ad6f-96d177448498 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:01.192454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-881a44a1-48a2-44c6-ad6f-96d177448498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:01.273772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 474/941] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:01.280870 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082778cb-cb1b-431f-a237-99adea000845 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:01.289581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a44a1-48a2-44c6-ad6f-96d177448498 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:01.328604 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d951d-7c8c-4492-8b02-8f8347397e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:01.329685 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d951d-7c8c-4492-8b02-8f8347397e7d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:01.330157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d951d-7c8c-4492-8b02-8f8347397e7d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:01.330636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d951d-7c8c-4492-8b02-8f8347397e7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:01.341603 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:01.347586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d951d-7c8c-4492-8b02-8f8347397e7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:01.349142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d951d-7c8c-4492-8b02-8f8347397e7d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-cd7d951d-7c8c-4492-8b02-8f8347397e7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:33:01.369770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:01.370744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:01.371634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:33:01.371634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:33:01.371634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:01.371634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:01.373432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 468/942] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:01.376826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d951d-7c8c-4492-8b02-8f8347397e7d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:01.414065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a44a1-48a2-44c6-ad6f-96d177448498 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:01.446338 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:01.453205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405f162-de78-43fa-a21c-14ea3250065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:01.454240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405f162-de78-43fa-a21c-14ea3250065f None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:01.454712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405f162-de78-43fa-a21c-14ea3250065f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:01.455210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405f162-de78-43fa-a21c-14ea3250065f None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:01.456199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405f162-de78-43fa-a21c-14ea3250065f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:01.457959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405f162-de78-43fa-a21c-14ea3250065f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:01.460967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: WARNING keystone.server.flask.common [None req-c405f162-de78-43fa-a21c-14ea3250065f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 02:33:01.480987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.sql.core [None req-c405f162-de78-43fa-a21c-14ea3250065f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 02:33:01.480987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 02:33:01.480987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [parameters: {'id': 'ba908466bfb5404dba9b498d3ee23f1a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 02:33:01.480987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86830) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 02:33:01.482022 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d951d-7c8c-4492-8b02-8f8347397e7d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:01.490415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c405f162-de78-43fa-a21c-14ea3250065f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ba908466bfb5404dba9b498d3ee23f1a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ba908466bfb5404dba9b498d3ee23f1a. Jul 26 02:33:01.490415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:01.490415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 02:33:01.490415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 02:33:01.490415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 02:33:01.490415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 02:33:01.490415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 02:33:01.490415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 02:33:01.490415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 02:33:01.490415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 26 02:33:01.490415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 02:33:01.490415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 02:33:01.490415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 26 02:33:01.491256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application yield resource Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise self.value Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application session.commit() Jul 26 02:33:01.492213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.flush() Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application compat.raise_( Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 02:33:01.493088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 02:33:01.494787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 02:33:01.495578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [parameters: {'id': 'ba908466bfb5404dba9b498d3ee23f1a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:01.496435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:01.497209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:01.499713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:01.499713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 26 02:33:01.499713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 26 02:33:01.499713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:01.499713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:01.499713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 26 02:33:01.499713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 26 02:33:01.499713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ba908466bfb5404dba9b498d3ee23f1a. Jul 26 02:33:01.499713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:01.507623 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 475/943] 10.222.0.39 () {60 vars in 1140 bytes} [Tue Jul 26 02:33:01 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:01.508792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405f162-de78-43fa-a21c-14ea3250065f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:01.516557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f5c6b-e8c1-480d-8550-f02ecb55f949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:01.517185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f5c6b-e8c1-480d-8550-f02ecb55f949 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:01.517490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f5c6b-e8c1-480d-8550-f02ecb55f949 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:01.517770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f5c6b-e8c1-480d-8550-f02ecb55f949 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:01.519096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f5c6b-e8c1-480d-8550-f02ecb55f949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:01.519096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f5c6b-e8c1-480d-8550-f02ecb55f949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:01.520142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f5c6b-e8c1-480d-8550-f02ecb55f949 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:01.537396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 469/944] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:01.540465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f5c6b-e8c1-480d-8550-f02ecb55f949 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:01.605180 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:01.644443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405f162-de78-43fa-a21c-14ea3250065f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:01.661899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f5c6b-e8c1-480d-8550-f02ecb55f949 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:01.682951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b01bd-76b7-4510-87eb-b3d5d1857ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:01.683573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b01bd-76b7-4510-87eb-b3d5d1857ffc None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:01.683859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b01bd-76b7-4510-87eb-b3d5d1857ffc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:01.684132 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b01bd-76b7-4510-87eb-b3d5d1857ffc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:01.691563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b01bd-76b7-4510-87eb-b3d5d1857ffc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:01.693213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b01bd-76b7-4510-87eb-b3d5d1857ffc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:01.700406 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5c1b1-17f7-4368-9036-9278ccf19c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:01.701314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5c1b1-17f7-4368-9036-9278ccf19c02 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:01.701799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5c1b1-17f7-4368-9036-9278ccf19c02 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:01.702301 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5c1b1-17f7-4368-9036-9278ccf19c02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-689b01bd-76b7-4510-87eb-b3d5d1857ffc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:33:01.704772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:01.705678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:01.706564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:33:01.706564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:33:01.706564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:33:01.706564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:33:01.706564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:33:01.706564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:33:01.706564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:33:01.706564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:01.706564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 476/945] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:33:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:01.711933 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b01bd-76b7-4510-87eb-b3d5d1857ffc None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:01.713298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5c1b1-17f7-4368-9036-9278ccf19c02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:01.714967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5c1b1-17f7-4368-9036-9278ccf19c02 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-5aa5c1b1-17f7-4368-9036-9278ccf19c02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:33:01.727608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:01.728508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:01.729937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:33:01.729937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:33:01.729937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:33:01.729937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:33:01.729937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:33:01.729937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:33:01.729937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:33:01.729937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:01.736664 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 470/946] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:33:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:01.737749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5c1b1-17f7-4368-9036-9278ccf19c02 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:01.763853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:01.818227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b01bd-76b7-4510-87eb-b3d5d1857ffc None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:01.856127 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f21d62-2ce2-488d-8940-8abc69c1e1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:01.857711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f21d62-2ce2-488d-8940-8abc69c1e1c5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:01.858197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f21d62-2ce2-488d-8940-8abc69c1e1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:01.858666 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f21d62-2ce2-488d-8940-8abc69c1e1c5 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:01.860023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f21d62-2ce2-488d-8940-8abc69c1e1c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:01.860650 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f21d62-2ce2-488d-8940-8abc69c1e1c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:01.862359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f21d62-2ce2-488d-8940-8abc69c1e1c5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:01.863119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5c1b1-17f7-4368-9036-9278ccf19c02 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:01.874550 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:01.887558 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 477/947] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 02:33:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:01.888920 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9340e-403f-44be-96fa-39fda379b296 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:01.889205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9340e-403f-44be-96fa-39fda379b296 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:01.889517 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9340e-403f-44be-96fa-39fda379b296 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:01.890887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 478/948] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:01.896405 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332f32b-42f0-4d80-9e24-14933c59e660 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:01.896721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332f32b-42f0-4d80-9e24-14933c59e660 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:01.896965 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332f32b-42f0-4d80-9e24-14933c59e660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:01.913833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ca12b-2772-4815-ac65-da12da347001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:01.914981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca12b-2772-4815-ac65-da12da347001 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:01.915464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca12b-2772-4815-ac65-da12da347001 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:01.915936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ca12b-2772-4815-ac65-da12da347001 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:01.917065 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ca12b-2772-4815-ac65-da12da347001 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:01.917301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b332f32b-42f0-4d80-9e24-14933c59e660 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:01.917839 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ca12b-2772-4815-ac65-da12da347001 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:01.918929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b332f32b-42f0-4d80-9e24-14933c59e660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:01.919833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ca12b-2772-4815-ac65-da12da347001 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:01.938660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 471/949] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:33:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:01.944920 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ca12b-2772-4815-ac65-da12da347001 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:02.001646 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 479/950] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:33:02.017412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332f32b-42f0-4d80-9e24-14933c59e660 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:02.060954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:02.088401 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ca12b-2772-4815-ac65-da12da347001 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:02.124946 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374b969-2790-40bd-bc4b-a448895cc00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:02.125666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374b969-2790-40bd-bc4b-a448895cc00d None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:02.125945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374b969-2790-40bd-bc4b-a448895cc00d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:02.126226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374b969-2790-40bd-bc4b-a448895cc00d None admin] PATH_INFO: `/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/1a3ecd4bf47a4842b522ccdb575203d6/roles/ad2dba59bed14bb1b37cab7b9d4ef96d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:02.128413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374b969-2790-40bd-bc4b-a448895cc00d None admin] RBAC: Authorizing `identity:create_grant(project_id=b017927d64b44db8a1611f20e6e3b6f5, user_id=1a3ecd4bf47a4842b522ccdb575203d6, role_id=ad2dba59bed14bb1b37cab7b9d4ef96d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:02.131180 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374b969-2790-40bd-bc4b-a448895cc00d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:02.131300 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332f32b-42f0-4d80-9e24-14933c59e660 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:02.148607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 472/951] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:33:01 2022] PUT /identity/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/1a3ecd4bf47a4842b522ccdb575203d6/roles/ad2dba59bed14bb1b37cab7b9d4ef96d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:33:02.175718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b384c-ea3f-4d35-a7ca-9c6902f325c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:02.176402 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b384c-ea3f-4d35-a7ca-9c6902f325c8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:02.176737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b384c-ea3f-4d35-a7ca-9c6902f325c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:02.177017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b384c-ea3f-4d35-a7ca-9c6902f325c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:02.178393 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b384c-ea3f-4d35-a7ca-9c6902f325c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:02.179231 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b384c-ea3f-4d35-a7ca-9c6902f325c8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-320b384c-ea3f-4d35-a7ca-9c6902f325c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:02.191331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:02.192387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:02.193219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 480/952] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 02:33:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:02.200268 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374b969-2790-40bd-bc4b-a448895cc00d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:02.236390 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:02.315012 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374b969-2790-40bd-bc4b-a448895cc00d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:02.355460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714c5e9-b9fe-418f-90ff-f90bf2224778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:02.356091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714c5e9-b9fe-418f-90ff-f90bf2224778 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:02.356370 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714c5e9-b9fe-418f-90ff-f90bf2224778 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:02.356641 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714c5e9-b9fe-418f-90ff-f90bf2224778 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:02.357356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714c5e9-b9fe-418f-90ff-f90bf2224778 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:02.357665 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714c5e9-b9fe-418f-90ff-f90bf2224778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:02.359052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5714c5e9-b9fe-418f-90ff-f90bf2224778 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:02.364267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 473/953] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 02:33:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:02.370476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b384c-ea3f-4d35-a7ca-9c6902f325c8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:02.441922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aec2b-4899-4613-8ec4-4543f31810f2 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:02.442121 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aec2b-4899-4613-8ec4-4543f31810f2 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:02.442372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53aec2b-4899-4613-8ec4-4543f31810f2 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:02.443966 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 474/954] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:02.448911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5ee35-35b6-4689-aff8-9466e30c5b27 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:02.449191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5ee35-35b6-4689-aff8-9466e30c5b27 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:02.449514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5ee35-35b6-4689-aff8-9466e30c5b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:02.468644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-89e5ee35-35b6-4689-aff8-9466e30c5b27 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:02.469870 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-89e5ee35-35b6-4689-aff8-9466e30c5b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:02.472480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b384c-ea3f-4d35-a7ca-9c6902f325c8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:02.474228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:02.507526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8257a-9c4c-4424-9519-5891a9ecd7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:02.508144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8257a-9c4c-4424-9519-5891a9ecd7af None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:02.508424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8257a-9c4c-4424-9519-5891a9ecd7af None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:02.508698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8257a-9c4c-4424-9519-5891a9ecd7af None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:02.509409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8257a-9c4c-4424-9519-5891a9ecd7af None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:02.509714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8257a-9c4c-4424-9519-5891a9ecd7af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:02.511240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8257a-9c4c-4424-9519-5891a9ecd7af None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:02.521155 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 481/955] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 02:33:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:02.523452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8257a-9c4c-4424-9519-5891a9ecd7af None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:02.554341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 475/956] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:33:02.578406 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5ee35-35b6-4689-aff8-9466e30c5b27 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:02.604874 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:02.659534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8257a-9c4c-4424-9519-5891a9ecd7af None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:02.707070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5ee35-35b6-4689-aff8-9466e30c5b27 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:02.707404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2de60c-f609-4c7d-be83-d5a5b0da0277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:02.708509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2de60c-f609-4c7d-be83-d5a5b0da0277 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:02.708946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2de60c-f609-4c7d-be83-d5a5b0da0277 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:02.710269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2de60c-f609-4c7d-be83-d5a5b0da0277 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:02.711139 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2de60c-f609-4c7d-be83-d5a5b0da0277 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:02.712650 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2de60c-f609-4c7d-be83-d5a5b0da0277 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:02.749657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 482/957] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:33:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:33:02.758119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554cb2a-00a6-4cf8-8133-35769a9f52b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:02.758898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554cb2a-00a6-4cf8-8133-35769a9f52b6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:02.759175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554cb2a-00a6-4cf8-8133-35769a9f52b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:02.759482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3554cb2a-00a6-4cf8-8133-35769a9f52b6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:02.760296 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554cb2a-00a6-4cf8-8133-35769a9f52b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:02.761899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3554cb2a-00a6-4cf8-8133-35769a9f52b6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-3554cb2a-00a6-4cf8-8133-35769a9f52b6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:02.772328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:02.773594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:02.775253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 476/958] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:33:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:02.780110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2de60c-f609-4c7d-be83-d5a5b0da0277 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:02.809718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:02.890964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2de60c-f609-4c7d-be83-d5a5b0da0277 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:02.926687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed687505-a00f-4aca-b781-ea71b7dc2000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:02.927319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed687505-a00f-4aca-b781-ea71b7dc2000 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:02.927604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed687505-a00f-4aca-b781-ea71b7dc2000 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:02.927870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed687505-a00f-4aca-b781-ea71b7dc2000 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:02.928571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed687505-a00f-4aca-b781-ea71b7dc2000 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:02.928860 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed687505-a00f-4aca-b781-ea71b7dc2000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:02.930277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed687505-a00f-4aca-b781-ea71b7dc2000 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:02.936976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 483/959] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 02:33:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:02.942707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554cb2a-00a6-4cf8-8133-35769a9f52b6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:03.029676 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:03.046944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3554cb2a-00a6-4cf8-8133-35769a9f52b6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:03.080323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92943982-57bf-4d9f-af24-e7bd50a57801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:03.080945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943982-57bf-4d9f-af24-e7bd50a57801 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:03.081221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943982-57bf-4d9f-af24-e7bd50a57801 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:03.081518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92943982-57bf-4d9f-af24-e7bd50a57801 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:03.082271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92943982-57bf-4d9f-af24-e7bd50a57801 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:03.082570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92943982-57bf-4d9f-af24-e7bd50a57801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:03.083933 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92943982-57bf-4d9f-af24-e7bd50a57801 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:03.088841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 477/960] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 02:33:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:04.077097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08394dec-718e-4036-9178-236a7f1cb258 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:04.077663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08394dec-718e-4036-9178-236a7f1cb258 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:04.077663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08394dec-718e-4036-9178-236a7f1cb258 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:04.079233 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 484/961] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:04.084437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7835dc-21bc-4606-b126-aed8262960c9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:04.084855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7835dc-21bc-4606-b126-aed8262960c9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:04.085043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7835dc-21bc-4606-b126-aed8262960c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:04.103644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3b7835dc-21bc-4606-b126-aed8262960c9 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:04.104860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3b7835dc-21bc-4606-b126-aed8262960c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:04.171533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 478/962] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:04.196103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08394dec-718e-4036-9178-236a7f1cb258 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:04.249316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fd057-2a53-40ff-8d54-a5f1f5488a8b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:04.249316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fd057-2a53-40ff-8d54-a5f1f5488a8b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:04.249316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fd057-2a53-40ff-8d54-a5f1f5488a8b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:04.249316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 479/963] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:04.251504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb70725-60ef-4f70-80c4-9644a3507685 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:04.251786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb70725-60ef-4f70-80c4-9644a3507685 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:04.252058 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb70725-60ef-4f70-80c4-9644a3507685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:04.270213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ccb70725-60ef-4f70-80c4-9644a3507685 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:04.271400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ccb70725-60ef-4f70-80c4-9644a3507685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:04.293043 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:04.313894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08394dec-718e-4036-9178-236a7f1cb258 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:04.353706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 480/964] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:33:04.363003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0cdc6-3a70-42da-85d7-8d39810fe763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:04.363722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0cdc6-3a70-42da-85d7-8d39810fe763 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:04.364079 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0cdc6-3a70-42da-85d7-8d39810fe763 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:04.364414 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0cdc6-3a70-42da-85d7-8d39810fe763 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:04.365166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0cdc6-3a70-42da-85d7-8d39810fe763 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:04.366729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f0cdc6-3a70-42da-85d7-8d39810fe763 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:04.370841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb70725-60ef-4f70-80c4-9644a3507685 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:04.382396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:04.385483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.sql.core [None req-81f0cdc6-3a70-42da-85d7-8d39810fe763 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 02:33:04.385483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 02:33:04.385483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [parameters: {'user_id': '44e0058b08ec468984566101b5dc9f12', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 02:33:04.385483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86830) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-81f0cdc6-3a70-42da-85d7-8d39810fe763 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 26 02:33:04.394360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 02:33:04.395234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application yield resource Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application next(self.gen) Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise self.value Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application session.commit() Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 02:33:04.396203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.session.flush() Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application compat.raise_( Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 02:33:04.397112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 02:33:04.399571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application conn.query(q) Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application result.read() Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 02:33:04.401629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [parameters: {'user_id': '44e0058b08ec468984566101b5dc9f12', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:04.403597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 26 02:33:04.410515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 26 02:33:04.412604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 26 02:33:04.412604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 26 02:33:04.412604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 02:33:04.412604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 02:33:04.412604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 02:33:04.412604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:04.412604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 485/965] 10.222.0.39 () {60 vars in 1131 bytes} [Tue Jul 26 02:33:04 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:04.414492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0cdc6-3a70-42da-85d7-8d39810fe763 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:04.499006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb70725-60ef-4f70-80c4-9644a3507685 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:04.525160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0cdc6-3a70-42da-85d7-8d39810fe763 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:04.544568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea9f87-ac6d-4d10-be58-fc246bcc3879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:04.545222 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea9f87-ac6d-4d10-be58-fc246bcc3879 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:04.545542 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea9f87-ac6d-4d10-be58-fc246bcc3879 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:04.545818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fea9f87-ac6d-4d10-be58-fc246bcc3879 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:04.560148 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fea9f87-ac6d-4d10-be58-fc246bcc3879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:33:04.562990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725ec5a-0a90-4ce4-94ca-92203bde1a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:04.563831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725ec5a-0a90-4ce4-94ca-92203bde1a90 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:04.564333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725ec5a-0a90-4ce4-94ca-92203bde1a90 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:04.564751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725ec5a-0a90-4ce4-94ca-92203bde1a90 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-3fea9f87-ac6d-4d10-be58-fc246bcc3879 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:33:04.565054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:04.566223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:04.567209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:04.567209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:04.567209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:04.567209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:04.567209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:33:04.567209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:33:04.567209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:33:04.567209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:33:04.567209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:33:04.567209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:33:04.567209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 02:33:04.567209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:04.571560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 481/966] 10.222.0.39 () {56 vars in 1120 bytes} [Tue Jul 26 02:33:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:04.573265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea9f87-ac6d-4d10-be58-fc246bcc3879 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:04.578375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725ec5a-0a90-4ce4-94ca-92203bde1a90 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:04.580346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725ec5a-0a90-4ce4-94ca-92203bde1a90 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b725ec5a-0a90-4ce4-94ca-92203bde1a90 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:33:04.593223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:04.594492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:04.595594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:04.595594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:04.595594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:33:04.595594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:33:04.595594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:33:04.595594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:33:04.595594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:33:04.595594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:33:04.595594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 02:33:04.595594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:04.601459 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 486/967] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:33:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:04.604366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725ec5a-0a90-4ce4-94ca-92203bde1a90 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:04.625143 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:04.654287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:04.697997 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fea9f87-ac6d-4d10-be58-fc246bcc3879 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:04.728851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725ec5a-0a90-4ce4-94ca-92203bde1a90 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:04.739776 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf42596-b061-40a6-be22-e562447e09e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:04.741060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf42596-b061-40a6-be22-e562447e09e5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:04.741657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf42596-b061-40a6-be22-e562447e09e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:04.742187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf42596-b061-40a6-be22-e562447e09e5 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:04.743070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf42596-b061-40a6-be22-e562447e09e5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:04.743751 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf42596-b061-40a6-be22-e562447e09e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:04.746088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf42596-b061-40a6-be22-e562447e09e5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:04.761787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 482/968] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 02:33:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:04.763638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf42596-b061-40a6-be22-e562447e09e5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:04.772166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d7c4b-6ab2-46c1-875e-2336992324f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:04.773095 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d7c4b-6ab2-46c1-875e-2336992324f7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:04.773608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d7c4b-6ab2-46c1-875e-2336992324f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:04.774513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d7c4b-6ab2-46c1-875e-2336992324f7 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:04.775568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d7c4b-6ab2-46c1-875e-2336992324f7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:04.776400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d7c4b-6ab2-46c1-875e-2336992324f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:04.778392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d7c4b-6ab2-46c1-875e-2336992324f7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:04.825738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 487/969] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 02:33:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:04.879940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf42596-b061-40a6-be22-e562447e09e5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:04.913400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:04.917458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1ca1b-19a1-4833-807c-262cf27de314 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:04.918087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1ca1b-19a1-4833-807c-262cf27de314 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:04.918561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1ca1b-19a1-4833-807c-262cf27de314 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:04.920592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 488/970] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:04.924746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a66807-0503-42c7-945c-5469ac3e6a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:04.924746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a66807-0503-42c7-945c-5469ac3e6a43 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:04.924746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a66807-0503-42c7-945c-5469ac3e6a43 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:04.924746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a66807-0503-42c7-945c-5469ac3e6a43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:04.926746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf497092-af76-4977-9e4b-6b4f8b1e580d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:04.927258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf497092-af76-4977-9e4b-6b4f8b1e580d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:04.927734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf497092-af76-4977-9e4b-6b4f8b1e580d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:04.936191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a66807-0503-42c7-945c-5469ac3e6a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:04.937183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a66807-0503-42c7-945c-5469ac3e6a43 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:04.948117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bf497092-af76-4977-9e4b-6b4f8b1e580d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:04.950153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bf497092-af76-4977-9e4b-6b4f8b1e580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-39a66807-0503-42c7-945c-5469ac3e6a43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:33:04.953270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:04.954224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:04.960906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:33:04.960906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:33:04.960906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:04.960906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:04.960906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 483/971] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:04.960906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a66807-0503-42c7-945c-5469ac3e6a43 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:05.043390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:05.054057 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 489/972] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:05.078897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf497092-af76-4977-9e4b-6b4f8b1e580d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:05.090720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a66807-0503-42c7-945c-5469ac3e6a43 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:05.127921 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cd9dd-8163-44f9-a74d-6ce14768ac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:05.128545 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cd9dd-8163-44f9-a74d-6ce14768ac39 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:05.128822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cd9dd-8163-44f9-a74d-6ce14768ac39 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:05.129090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cd9dd-8163-44f9-a74d-6ce14768ac39 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:05.129823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cd9dd-8163-44f9-a74d-6ce14768ac39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:05.130168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cd9dd-8163-44f9-a74d-6ce14768ac39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:05.131493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cd9dd-8163-44f9-a74d-6ce14768ac39 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:05.143172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 484/973] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:05.144367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293112c-e823-4fe7-925f-e843288eb2ba None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:05.144648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293112c-e823-4fe7-925f-e843288eb2ba None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:05.144917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293112c-e823-4fe7-925f-e843288eb2ba None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:05.146262 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 485/974] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:05.148787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293112c-e823-4fe7-925f-e843288eb2ba None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:05.187953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf497092-af76-4977-9e4b-6b4f8b1e580d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:05.192355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:05.222447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c9157-4388-40bf-b0aa-90b6ca6ac8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:05.223090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c9157-4388-40bf-b0aa-90b6ca6ac8a4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:05.223369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c9157-4388-40bf-b0aa-90b6ca6ac8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:05.223641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c9157-4388-40bf-b0aa-90b6ca6ac8a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:05.224270 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c9157-4388-40bf-b0aa-90b6ca6ac8a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:05.226022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c9157-4388-40bf-b0aa-90b6ca6ac8a4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-006c9157-4388-40bf-b0aa-90b6ca6ac8a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:05.235352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:05.236372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:05.237217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 490/975] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 02:33:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:05.238052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d010a-df3f-4a96-8465-178a40c1032c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:05.238052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d010a-df3f-4a96-8465-178a40c1032c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:05.238185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d010a-df3f-4a96-8465-178a40c1032c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:05.252214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293112c-e823-4fe7-925f-e843288eb2ba None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:05.255422 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-523d010a-df3f-4a96-8465-178a40c1032c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:05.256597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-523d010a-df3f-4a96-8465-178a40c1032c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:05.287426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed556f8-e43e-4312-894d-5db384f83c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:05.288324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed556f8-e43e-4312-894d-5db384f83c9b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:05.288601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed556f8-e43e-4312-894d-5db384f83c9b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:05.288877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed556f8-e43e-4312-894d-5db384f83c9b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:05.296511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed556f8-e43e-4312-894d-5db384f83c9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:05.297989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed556f8-e43e-4312-894d-5db384f83c9b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-4ed556f8-e43e-4312-894d-5db384f83c9b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:33:05.309767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:05.310813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:05.311918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:05.311918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:05.311918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:33:05.311918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:33:05.311918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:33:05.311918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:33:05.311918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:33:05.311918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:33:05.311918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 02:33:05.311918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:05.311918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 486/976] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 02:33:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:05.312570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:05.312647 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed556f8-e43e-4312-894d-5db384f83c9b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:05.325862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 491/977] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:05.326672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d010a-df3f-4a96-8465-178a40c1032c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:05.414541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed556f8-e43e-4312-894d-5db384f83c9b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:05.415958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:05.426834 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d010a-df3f-4a96-8465-178a40c1032c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:05.448921 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb8c55-a1b4-4f9f-856f-80531a4e9583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:05.449583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb8c55-a1b4-4f9f-856f-80531a4e9583 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:05.449862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb8c55-a1b4-4f9f-856f-80531a4e9583 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:05.450130 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb8c55-a1b4-4f9f-856f-80531a4e9583 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:05.450810 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb8c55-a1b4-4f9f-856f-80531a4e9583 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:05.451113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb8c55-a1b4-4f9f-856f-80531a4e9583 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:05.452517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb8c55-a1b4-4f9f-856f-80531a4e9583 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:05.457093 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 487/978] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 02:33:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:05.457929 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb8c55-a1b4-4f9f-856f-80531a4e9583 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:05.459758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd19c3-532f-4783-8955-40beebec14c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:05.460375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd19c3-532f-4783-8955-40beebec14c4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:05.460648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd19c3-532f-4783-8955-40beebec14c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:05.460915 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd19c3-532f-4783-8955-40beebec14c4 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:05.461821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd19c3-532f-4783-8955-40beebec14c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:05.462187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd19c3-532f-4783-8955-40beebec14c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:05.463607 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd19c3-532f-4783-8955-40beebec14c4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:05.480753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 492/979] 10.222.0.39 () {56 vars in 1149 bytes} [Tue Jul 26 02:33:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:05.481556 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd19c3-532f-4783-8955-40beebec14c4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:05.528630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:05.562679 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb8c55-a1b4-4f9f-856f-80531a4e9583 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:05.577876 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd19c3-532f-4783-8955-40beebec14c4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:05.596135 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa11f51-2a5a-4323-8b4e-a003e7b9a2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:05.596745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa11f51-2a5a-4323-8b4e-a003e7b9a2f0 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:05.597018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa11f51-2a5a-4323-8b4e-a003e7b9a2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:05.597303 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa11f51-2a5a-4323-8b4e-a003e7b9a2f0 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:05.597984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa11f51-2a5a-4323-8b4e-a003e7b9a2f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:05.599356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa11f51-2a5a-4323-8b4e-a003e7b9a2f0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:05.614240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 488/980] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:33:05 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:33:05.615039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa11f51-2a5a-4323-8b4e-a003e7b9a2f0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:05.621932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fdb19-4248-4a63-94b2-e387bd1ed4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:05.622580 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fdb19-4248-4a63-94b2-e387bd1ed4fc None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:05.622861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fdb19-4248-4a63-94b2-e387bd1ed4fc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:05.623135 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fdb19-4248-4a63-94b2-e387bd1ed4fc None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:05.623852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fdb19-4248-4a63-94b2-e387bd1ed4fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:05.624145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fdb19-4248-4a63-94b2-e387bd1ed4fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:05.625764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fdb19-4248-4a63-94b2-e387bd1ed4fc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:05.636178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 493/981] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 02:33:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:05.642480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fdb19-4248-4a63-94b2-e387bd1ed4fc None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:05.654009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:05.736307 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa11f51-2a5a-4323-8b4e-a003e7b9a2f0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:05.760788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fdb19-4248-4a63-94b2-e387bd1ed4fc None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:05.771309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:05.775117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc565bc-0194-4935-aec2-70a7921151e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:05.775877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc565bc-0194-4935-aec2-70a7921151e3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:05.775877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc565bc-0194-4935-aec2-70a7921151e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:05.776096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc565bc-0194-4935-aec2-70a7921151e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:05.803090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08d170-1e2f-467b-a991-2c0a59e8da9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:05.803715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08d170-1e2f-467b-a991-2c0a59e8da9c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:05.803991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08d170-1e2f-467b-a991-2c0a59e8da9c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:05.804259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08d170-1e2f-467b-a991-2c0a59e8da9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:05.805020 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08d170-1e2f-467b-a991-2c0a59e8da9c None admin] RBAC: Adding query filter params (interface=admin, service_id=8465a444ec06475a9091f3cc5f7ab997, region_id=RegionOne) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:05.805377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08d170-1e2f-467b-a991-2c0a59e8da9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:05.806854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08d170-1e2f-467b-a991-2c0a59e8da9c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:05.812431 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 494/982] 10.222.0.39 () {56 vars in 1249 bytes} [Tue Jul 26 02:33:05 2022] GET /identity/v3/endpoints?service_id=8465a444ec06475a9091f3cc5f7ab997&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:05.818240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08d170-1e2f-467b-a991-2c0a59e8da9c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:05.851374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc565bc-0194-4935-aec2-70a7921151e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:05.852844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc565bc-0194-4935-aec2-70a7921151e3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:05.882509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:05.922569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08d170-1e2f-467b-a991-2c0a59e8da9c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:05.956729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035efd3-e5eb-4f5f-9579-ae1dc1bbcebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:05.957378 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035efd3-e5eb-4f5f-9579-ae1dc1bbcebe None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:05.957663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035efd3-e5eb-4f5f-9579-ae1dc1bbcebe None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:05.957941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035efd3-e5eb-4f5f-9579-ae1dc1bbcebe None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:05.958896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035efd3-e5eb-4f5f-9579-ae1dc1bbcebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:05.959009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 489/983] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:33:05 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:33:05.959965 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035efd3-e5eb-4f5f-9579-ae1dc1bbcebe None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:05.964297 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc565bc-0194-4935-aec2-70a7921151e3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:05.966943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 495/984] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 02:33:05 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:33:06.080968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc565bc-0194-4935-aec2-70a7921151e3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:06.112548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:06.124237 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e18221-1af1-4f4d-baa1-6fe978b4ac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:06.124891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e18221-1af1-4f4d-baa1-6fe978b4ac7b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:06.125173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e18221-1af1-4f4d-baa1-6fe978b4ac7b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:06.125492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e18221-1af1-4f4d-baa1-6fe978b4ac7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:06.136469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e18221-1af1-4f4d-baa1-6fe978b4ac7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:06.138085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e18221-1af1-4f4d-baa1-6fe978b4ac7b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-88e18221-1af1-4f4d-baa1-6fe978b4ac7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:33:06.153120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:06.154070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:06.154968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:33:06.154968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:33:06.154968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:06.154968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:06.154968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 490/985] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:06.161134 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035efd3-e5eb-4f5f-9579-ae1dc1bbcebe None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:06.197727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:06.266815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035efd3-e5eb-4f5f-9579-ae1dc1bbcebe None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:06.303779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e023d-08d2-49d5-adac-6487091ee2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:06.304397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e023d-08d2-49d5-adac-6487091ee2b5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:06.304677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e023d-08d2-49d5-adac-6487091ee2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:06.304949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e023d-08d2-49d5-adac-6487091ee2b5 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:06.305681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e023d-08d2-49d5-adac-6487091ee2b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:06.305987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e023d-08d2-49d5-adac-6487091ee2b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:06.307444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e023d-08d2-49d5-adac-6487091ee2b5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:06.324014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 496/986] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:06.325324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e18221-1af1-4f4d-baa1-6fe978b4ac7b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:06.427122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e18221-1af1-4f4d-baa1-6fe978b4ac7b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:06.461662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c2175-9407-4631-8118-4493601b4b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:06.462306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c2175-9407-4631-8118-4493601b4b79 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:06.462585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c2175-9407-4631-8118-4493601b4b79 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:06.462879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c2175-9407-4631-8118-4493601b4b79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:06.469674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c2175-9407-4631-8118-4493601b4b79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:06.471185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c2175-9407-4631-8118-4493601b4b79 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a49c2175-9407-4631-8118-4493601b4b79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:33:06.483048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:06.483941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:06.484820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:33:06.484820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:33:06.484820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:33:06.484820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:33:06.484820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:33:06.484820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:33:06.484820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:33:06.484820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:06.484820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 491/987] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:33:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:06.491568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e023d-08d2-49d5-adac-6487091ee2b5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:06.589743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:06.595829 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e023d-08d2-49d5-adac-6487091ee2b5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:06.636934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d448aea-bd5a-4c15-9764-c4e179474853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:06.637698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d448aea-bd5a-4c15-9764-c4e179474853 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:06.637824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d448aea-bd5a-4c15-9764-c4e179474853 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:06.638130 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d448aea-bd5a-4c15-9764-c4e179474853 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:06.638881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d448aea-bd5a-4c15-9764-c4e179474853 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:06.639183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d448aea-bd5a-4c15-9764-c4e179474853 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:06.640605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d448aea-bd5a-4c15-9764-c4e179474853 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:06.653595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 497/988] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:33:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:06.659546 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c2175-9407-4631-8118-4493601b4b79 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:06.702070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:06.766563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c2175-9407-4631-8118-4493601b4b79 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:06.799875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c34e76-8161-4ac0-b4bc-831d60574375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:06.800490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c34e76-8161-4ac0-b4bc-831d60574375 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:06.800768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c34e76-8161-4ac0-b4bc-831d60574375 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:06.801035 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c34e76-8161-4ac0-b4bc-831d60574375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:06.801853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c34e76-8161-4ac0-b4bc-831d60574375 None admin] RBAC: Adding query filter params (role.id=ad2dba59bed14bb1b37cab7b9d4ef96d, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=1a3ecd4bf47a4842b522ccdb575203d6) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:06.802160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c34e76-8161-4ac0-b4bc-831d60574375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:06.803599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c34e76-8161-4ac0-b4bc-831d60574375 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:06.809663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 492/989] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:33:06 2022] GET /identity/v3/role_assignments?user.id=1a3ecd4bf47a4842b522ccdb575203d6&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=ad2dba59bed14bb1b37cab7b9d4ef96d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:07.634129 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a09ece-b9ca-44fb-b8f5-213f7995c674 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:07.634571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a09ece-b9ca-44fb-b8f5-213f7995c674 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:07.634773 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a09ece-b9ca-44fb-b8f5-213f7995c674 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:07.636116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 498/990] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:07.641572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5bb74-1c1c-4ffe-8af9-86bc720c898c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:07.641995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5bb74-1c1c-4ffe-8af9-86bc720c898c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:07.642071 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5bb74-1c1c-4ffe-8af9-86bc720c898c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:07.661110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-64a5bb74-1c1c-4ffe-8af9-86bc720c898c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:07.662353 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-64a5bb74-1c1c-4ffe-8af9-86bc720c898c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:07.733495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 493/991] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:07.752655 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a09ece-b9ca-44fb-b8f5-213f7995c674 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:07.855988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a09ece-b9ca-44fb-b8f5-213f7995c674 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:07.891638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b512f-9335-4137-9a48-13eeebc2e6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:07.892201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b512f-9335-4137-9a48-13eeebc2e6da None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:07.892480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b512f-9335-4137-9a48-13eeebc2e6da None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:07.892752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b512f-9335-4137-9a48-13eeebc2e6da None admin] PATH_INFO: `/v3/services/compute` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:07.893409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b512f-9335-4137-9a48-13eeebc2e6da None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:07.894790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b512f-9335-4137-9a48-13eeebc2e6da None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e91b512f-9335-4137-9a48-13eeebc2e6da None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:07.904272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:07.905277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 02:33:07.906466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:07.909682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 499/992] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:33:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:07.911783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5bb74-1c1c-4ffe-8af9-86bc720c898c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:07.946364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:07.994304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39885a-0b3e-4697-ba05-ff1c03ad9719 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:07.994651 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39885a-0b3e-4697-ba05-ff1c03ad9719 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:07.994835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39885a-0b3e-4697-ba05-ff1c03ad9719 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:07.996377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 500/993] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:33:08.001120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9187d7-2583-46ad-8343-a37f02c2db06 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:08.001437 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9187d7-2583-46ad-8343-a37f02c2db06 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:08.001728 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9187d7-2583-46ad-8343-a37f02c2db06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:08.018533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5bb74-1c1c-4ffe-8af9-86bc720c898c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:08.022664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7c9187d7-2583-46ad-8343-a37f02c2db06 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:08.023840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7c9187d7-2583-46ad-8343-a37f02c2db06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:08.038828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:08.055825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b133b-ee6c-449b-8814-f6e7868c7c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:08.056459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b133b-ee6c-449b-8814-f6e7868c7c37 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:08.056793 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b133b-ee6c-449b-8814-f6e7868c7c37 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:08.057065 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b133b-ee6c-449b-8814-f6e7868c7c37 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:08.057773 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b133b-ee6c-449b-8814-f6e7868c7c37 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:08.058074 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b133b-ee6c-449b-8814-f6e7868c7c37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:08.059453 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b133b-ee6c-449b-8814-f6e7868c7c37 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:08.068912 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 494/994] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 02:33:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:08.070168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b133b-ee6c-449b-8814-f6e7868c7c37 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:08.109575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 501/995] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:33:08.122813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9187d7-2583-46ad-8343-a37f02c2db06 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:08.167686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:08.173902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b133b-ee6c-449b-8814-f6e7868c7c37 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:08.208879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267e23a-ce21-4940-8f0e-e91c452344ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:08.209524 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e23a-ce21-4940-8f0e-e91c452344ae None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:08.209806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e23a-ce21-4940-8f0e-e91c452344ae None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:08.210079 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267e23a-ce21-4940-8f0e-e91c452344ae None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:08.210752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267e23a-ce21-4940-8f0e-e91c452344ae None admin] RBAC: Adding query filter params (type=compute) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:08.211056 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267e23a-ce21-4940-8f0e-e91c452344ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:08.212434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267e23a-ce21-4940-8f0e-e91c452344ae None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:08.217550 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 495/996] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 02:33:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:08.223097 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267e23a-ce21-4940-8f0e-e91c452344ae None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:08.226932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9187d7-2583-46ad-8343-a37f02c2db06 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:08.262011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c43083-e2e3-4955-9769-5960b25dcc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:08.262659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c43083-e2e3-4955-9769-5960b25dcc3a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:08.262940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c43083-e2e3-4955-9769-5960b25dcc3a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:08.263209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c43083-e2e3-4955-9769-5960b25dcc3a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:08.263843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c43083-e2e3-4955-9769-5960b25dcc3a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:08.265254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c43083-e2e3-4955-9769-5960b25dcc3a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-62c43083-e2e3-4955-9769-5960b25dcc3a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:08.274141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:08.275110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:08.276096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 502/997] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 02:33:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:08.281316 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c43083-e2e3-4955-9769-5960b25dcc3a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:08.297200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:08.335982 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267e23a-ce21-4940-8f0e-e91c452344ae None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:08.375534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d2c5a-c792-421c-bcd4-5e968262afde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:08.376491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d2c5a-c792-421c-bcd4-5e968262afde None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:08.376839 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d2c5a-c792-421c-bcd4-5e968262afde None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:08.377408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d2c5a-c792-421c-bcd4-5e968262afde None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:08.378523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d2c5a-c792-421c-bcd4-5e968262afde None admin] RBAC: Adding query filter params (interface=public, service_id=01a73ecad5b74e008fedd297094ec596, region_id=RegionOne) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:08.378903 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d2c5a-c792-421c-bcd4-5e968262afde None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:08.380347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d2c5a-c792-421c-bcd4-5e968262afde None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:08.386784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 496/998] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 02:33:08 2022] GET /identity/v3/endpoints?service_id=01a73ecad5b74e008fedd297094ec596&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:08.392322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d2c5a-c792-421c-bcd4-5e968262afde None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:08.393631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c43083-e2e3-4955-9769-5960b25dcc3a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:08.419835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:08.432154 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb4035-0786-46a8-9bf1-856b72ec8410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:08.432917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb4035-0786-46a8-9bf1-856b72ec8410 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:08.433320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb4035-0786-46a8-9bf1-856b72ec8410 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:08.433697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb4035-0786-46a8-9bf1-856b72ec8410 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:08.434516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb4035-0786-46a8-9bf1-856b72ec8410 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:08.434923 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb4035-0786-46a8-9bf1-856b72ec8410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:08.436396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb4035-0786-46a8-9bf1-856b72ec8410 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:08.443604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 503/999] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 02:33:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:08.449219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb4035-0786-46a8-9bf1-856b72ec8410 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:08.506432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d2c5a-c792-421c-bcd4-5e968262afde None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:08.539100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:08.540423 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52522a-c2d9-4833-aace-66445a856137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:08.541139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52522a-c2d9-4833-aace-66445a856137 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:08.541465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52522a-c2d9-4833-aace-66445a856137 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:08.541712 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52522a-c2d9-4833-aace-66445a856137 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:08.542413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52522a-c2d9-4833-aace-66445a856137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:08.543782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52522a-c2d9-4833-aace-66445a856137 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:08.549938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 497/1000] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 02:33:08 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:33:08.572417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb4035-0786-46a8-9bf1-856b72ec8410 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:08.615715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90ba72-5cc8-42f2-a986-44e7910e7baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:08.616358 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90ba72-5cc8-42f2-a986-44e7910e7baa None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:08.616604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90ba72-5cc8-42f2-a986-44e7910e7baa None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:08.616895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90ba72-5cc8-42f2-a986-44e7910e7baa None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:08.617609 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90ba72-5cc8-42f2-a986-44e7910e7baa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:08.617918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90ba72-5cc8-42f2-a986-44e7910e7baa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:08.619376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90ba72-5cc8-42f2-a986-44e7910e7baa None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:08.625599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 504/1001] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 02:33:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:08.631786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52522a-c2d9-4833-aace-66445a856137 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:08.728639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:08.740986 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52522a-c2d9-4833-aace-66445a856137 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:08.778656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bf591-4d12-48cb-8f73-ecdbb32160e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:08.779282 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf591-4d12-48cb-8f73-ecdbb32160e4 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:08.779557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf591-4d12-48cb-8f73-ecdbb32160e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:08.779828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bf591-4d12-48cb-8f73-ecdbb32160e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:08.780559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bf591-4d12-48cb-8f73-ecdbb32160e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:08.781980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bf591-4d12-48cb-8f73-ecdbb32160e4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:08.805305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 498/1002] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:33:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:33:08.812124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c7e9c-058a-4773-bfed-fe563a5fc942 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:08.812715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c7e9c-058a-4773-bfed-fe563a5fc942 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:08.812715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c7e9c-058a-4773-bfed-fe563a5fc942 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:08.814331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 505/1003] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:08.820092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279265-9fff-4d68-bd2a-46dc7d7dd446 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:08.820428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279265-9fff-4d68-bd2a-46dc7d7dd446 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:08.820654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af279265-9fff-4d68-bd2a-46dc7d7dd446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:08.840438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-af279265-9fff-4d68-bd2a-46dc7d7dd446 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:08.841711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-af279265-9fff-4d68-bd2a-46dc7d7dd446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:08.925329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 499/1004] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:08.946619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c7e9c-058a-4773-bfed-fe563a5fc942 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:09.053134 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c7e9c-058a-4773-bfed-fe563a5fc942 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:09.088485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b4dc9-2e53-40bf-872b-36cd7ca0963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:09.089148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4dc9-2e53-40bf-872b-36cd7ca0963e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:09.089471 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4dc9-2e53-40bf-872b-36cd7ca0963e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:09.089737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b4dc9-2e53-40bf-872b-36cd7ca0963e None admin] PATH_INFO: `/v3/services/image` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:09.090377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b4dc9-2e53-40bf-872b-36cd7ca0963e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:09.091770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b4dc9-2e53-40bf-872b-36cd7ca0963e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-1c2b4dc9-2e53-40bf-872b-36cd7ca0963e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:09.102041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:09.103169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:09.104013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 506/1005] 10.222.0.39 () {56 vars in 1105 bytes} [Tue Jul 26 02:33:08 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:09.109537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af279265-9fff-4d68-bd2a-46dc7d7dd446 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:09.187264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:09.214517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af279265-9fff-4d68-bd2a-46dc7d7dd446 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:09.248679 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ad1b6-0705-47b7-aff1-7bafa631e920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:09.249441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ad1b6-0705-47b7-aff1-7bafa631e920 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:09.249785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ad1b6-0705-47b7-aff1-7bafa631e920 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:09.250128 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ad1b6-0705-47b7-aff1-7bafa631e920 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:09.250879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ad1b6-0705-47b7-aff1-7bafa631e920 None admin] RBAC: Adding query filter params (name=image) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:09.251252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ad1b6-0705-47b7-aff1-7bafa631e920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:09.252727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ad1b6-0705-47b7-aff1-7bafa631e920 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:09.257981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 500/1006] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:09.263751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b4dc9-2e53-40bf-872b-36cd7ca0963e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:09.273442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:09.367773 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b4dc9-2e53-40bf-872b-36cd7ca0963e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:09.402797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75317b9c-2f9b-4509-b23c-2662e29d4ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:09.403508 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75317b9c-2f9b-4509-b23c-2662e29d4ce1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:09.403851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75317b9c-2f9b-4509-b23c-2662e29d4ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:09.404193 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75317b9c-2f9b-4509-b23c-2662e29d4ce1 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:09.404946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75317b9c-2f9b-4509-b23c-2662e29d4ce1 None admin] RBAC: Adding query filter params (type=image) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:09.405335 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75317b9c-2f9b-4509-b23c-2662e29d4ce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:09.406776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75317b9c-2f9b-4509-b23c-2662e29d4ce1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:09.411579 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 507/1007] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:10.553435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688267c-9147-4056-8e81-65cffd24df99 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:10.554026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688267c-9147-4056-8e81-65cffd24df99 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:10.554026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688267c-9147-4056-8e81-65cffd24df99 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:10.555414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 501/1008] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:10.560628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cdf89-18f0-4769-a787-7431699d6aa3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:10.561075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cdf89-18f0-4769-a787-7431699d6aa3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:10.561166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cdf89-18f0-4769-a787-7431699d6aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:10.580488 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-692cdf89-18f0-4769-a787-7431699d6aa3 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:10.582122 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-692cdf89-18f0-4769-a787-7431699d6aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:10.661462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:10.669318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 508/1009] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:10 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:10.689497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688267c-9147-4056-8e81-65cffd24df99 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:10.794266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688267c-9147-4056-8e81-65cffd24df99 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:10.805998 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecfead-b7ca-4c50-a7a5-4cbaaa8d46c3 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:10.806184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecfead-b7ca-4c50-a7a5-4cbaaa8d46c3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:10.806515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecfead-b7ca-4c50-a7a5-4cbaaa8d46c3 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:10.807924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 509/1010] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:33:10.813771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505f6b-99df-405a-a815-d85a6ef80432 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:10.814131 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505f6b-99df-405a-a815-d85a6ef80432 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:10.814473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505f6b-99df-405a-a815-d85a6ef80432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:10.833645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9b505f6b-99df-405a-a815-d85a6ef80432 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:10.834642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1ed4b-7220-4cad-93ac-726a68d9a9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:10.834938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9b505f6b-99df-405a-a815-d85a6ef80432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:10.835291 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1ed4b-7220-4cad-93ac-726a68d9a9c1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:10.835568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1ed4b-7220-4cad-93ac-726a68d9a9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:10.835832 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1ed4b-7220-4cad-93ac-726a68d9a9c1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:10.836456 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1ed4b-7220-4cad-93ac-726a68d9a9c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:10.837897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1ed4b-7220-4cad-93ac-726a68d9a9c1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-f5a1ed4b-7220-4cad-93ac-726a68d9a9c1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:10.847446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:10.848580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:10.849457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 502/1011] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:33:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:10.855133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1ed4b-7220-4cad-93ac-726a68d9a9c1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:10.857916 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:10.921328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 510/1012] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:10 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:33:10.941600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b505f6b-99df-405a-a815-d85a6ef80432 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:10.962429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1ed4b-7220-4cad-93ac-726a68d9a9c1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:11.000197 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ec20e-70b4-4ffc-987f-11228a814057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:11.001193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec20e-70b4-4ffc-987f-11228a814057 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:11.001498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec20e-70b4-4ffc-987f-11228a814057 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:11.001775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ec20e-70b4-4ffc-987f-11228a814057 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:11.002610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ec20e-70b4-4ffc-987f-11228a814057 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:11.003223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ec20e-70b4-4ffc-987f-11228a814057 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:11.005032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ec20e-70b4-4ffc-987f-11228a814057 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:11.010743 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 503/1013] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 02:33:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:11.016320 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ec20e-70b4-4ffc-987f-11228a814057 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:11.047772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b505f6b-99df-405a-a815-d85a6ef80432 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:11.080060 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:11.086251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0b281-bc4e-44ae-822d-ef74d96c5542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:11.087033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0b281-bc4e-44ae-822d-ef74d96c5542 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:11.087400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0b281-bc4e-44ae-822d-ef74d96c5542 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:11.087836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0b281-bc4e-44ae-822d-ef74d96c5542 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:11.089129 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0b281-bc4e-44ae-822d-ef74d96c5542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:11.089434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:11.090663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0b281-bc4e-44ae-822d-ef74d96c5542 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:11.092312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 511/1014] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:11.098210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0b281-bc4e-44ae-822d-ef74d96c5542 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:11.128869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ec20e-70b4-4ffc-987f-11228a814057 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:11.167361 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d4db6-293e-49ac-b875-76cb5bbdb678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:11.168498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d4db6-293e-49ac-b875-76cb5bbdb678 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:11.168782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d4db6-293e-49ac-b875-76cb5bbdb678 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:11.169211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d4db6-293e-49ac-b875-76cb5bbdb678 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:11.170051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d4db6-293e-49ac-b875-76cb5bbdb678 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:11.170358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d4db6-293e-49ac-b875-76cb5bbdb678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:11.172698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d4db6-293e-49ac-b875-76cb5bbdb678 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:11.182867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 504/1015] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 02:33:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:11.184489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d4db6-293e-49ac-b875-76cb5bbdb678 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:11.204789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0b281-bc4e-44ae-822d-ef74d96c5542 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:11.242193 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2d76e-31c0-4804-bf11-15aea655b3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:11.242821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2d76e-31c0-4804-bf11-15aea655b3f3 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:11.243100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2d76e-31c0-4804-bf11-15aea655b3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:11.243420 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2d76e-31c0-4804-bf11-15aea655b3f3 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:11.244119 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2d76e-31c0-4804-bf11-15aea655b3f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:11.245590 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2d76e-31c0-4804-bf11-15aea655b3f3 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:11.285324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 512/1016] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:33:11 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:33:11.300771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d4db6-293e-49ac-b875-76cb5bbdb678 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:11.332818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:11.339845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6675e22-a37d-416f-8a7b-ee8ca8ba783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:11.340453 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675e22-a37d-416f-8a7b-ee8ca8ba783d None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:11.340720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675e22-a37d-416f-8a7b-ee8ca8ba783d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:11.341000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675e22-a37d-416f-8a7b-ee8ca8ba783d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:11.341766 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6675e22-a37d-416f-8a7b-ee8ca8ba783d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:11.343261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6675e22-a37d-416f-8a7b-ee8ca8ba783d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:11.367891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 505/1017] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:33:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:33:11.388530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1139031-81e1-4d72-b3bd-70d54499d837 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:11.388891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1139031-81e1-4d72-b3bd-70d54499d837 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:11.389099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1139031-81e1-4d72-b3bd-70d54499d837 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:11.391044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 513/1018] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:11.396897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69e39b-49be-4463-a580-6810fa743164 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:11.397254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69e39b-49be-4463-a580-6810fa743164 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:11.397508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69e39b-49be-4463-a580-6810fa743164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:11.418432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9c69e39b-49be-4463-a580-6810fa743164 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:11.419710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9c69e39b-49be-4463-a580-6810fa743164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:11.505623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 506/1019] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:11 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:11.528293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1139031-81e1-4d72-b3bd-70d54499d837 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:11.582716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:11.642384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1139031-81e1-4d72-b3bd-70d54499d837 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:11.676801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21304443-b395-418c-925c-06e95ec7f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:11.677513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21304443-b395-418c-925c-06e95ec7f9c7 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:11.677798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21304443-b395-418c-925c-06e95ec7f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:11.678071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21304443-b395-418c-925c-06e95ec7f9c7 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:11.678777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21304443-b395-418c-925c-06e95ec7f9c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:11.680159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21304443-b395-418c-925c-06e95ec7f9c7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:11.697544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 514/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:33:11 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:33:13.316991 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48944b-d75d-41b0-b668-73a84bec5d0c None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:13.317591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48944b-d75d-41b0-b668-73a84bec5d0c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:13.317591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba48944b-d75d-41b0-b668-73a84bec5d0c None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:13.318891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 507/1021] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:13.324452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1508007-b5aa-4e8e-9d01-1eb62fcfec44 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:13.325014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1508007-b5aa-4e8e-9d01-1eb62fcfec44 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:13.325014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1508007-b5aa-4e8e-9d01-1eb62fcfec44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:13.343605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f1508007-b5aa-4e8e-9d01-1eb62fcfec44 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:13.344731 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f1508007-b5aa-4e8e-9d01-1eb62fcfec44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:13.422195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 515/1022] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:13.445734 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48944b-d75d-41b0-b668-73a84bec5d0c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:13.460663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd0001-88f5-484a-aec4-f8f19be05d06 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:13.460952 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd0001-88f5-484a-aec4-f8f19be05d06 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:13.461210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd0001-88f5-484a-aec4-f8f19be05d06 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:13.462751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 516/1023] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:33:13.468112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e687da4-e104-4780-b0dc-5d9b2e05c4d6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:13.468398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e687da4-e104-4780-b0dc-5d9b2e05c4d6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:13.468671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e687da4-e104-4780-b0dc-5d9b2e05c4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:13.488082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5e687da4-e104-4780-b0dc-5d9b2e05c4d6 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:13.488767 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5e687da4-e104-4780-b0dc-5d9b2e05c4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:13.518888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:13.560896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 517/1024] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:33:13.566069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba48944b-d75d-41b0-b668-73a84bec5d0c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:13.580149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:13.583924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e687da4-e104-4780-b0dc-5d9b2e05c4d6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:13.603580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae77069-7059-449b-8f90-e7c3b955956b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:13.604231 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae77069-7059-449b-8f90-e7c3b955956b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:13.604510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae77069-7059-449b-8f90-e7c3b955956b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:13.604778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae77069-7059-449b-8f90-e7c3b955956b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:13.606343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae77069-7059-449b-8f90-e7c3b955956b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:13.607801 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae77069-7059-449b-8f90-e7c3b955956b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:13.611556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 508/1025] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:13.617087 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae77069-7059-449b-8f90-e7c3b955956b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:13.696423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e687da4-e104-4780-b0dc-5d9b2e05c4d6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:13.719742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae77069-7059-449b-8f90-e7c3b955956b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:13.730116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5facbe-2f9d-4bb2-b394-2df86cca00f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:13.730734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5facbe-2f9d-4bb2-b394-2df86cca00f2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:13.731008 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5facbe-2f9d-4bb2-b394-2df86cca00f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:13.731278 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5facbe-2f9d-4bb2-b394-2df86cca00f2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:13.741617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5facbe-2f9d-4bb2-b394-2df86cca00f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-5d5facbe-2f9d-4bb2-b394-2df86cca00f2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:33:13.746613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:13.747637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 518/1026] 10.222.0.39 () {56 vars in 1120 bytes} [Tue Jul 26 02:33:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:13.754021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fc2fc-aa95-46ad-87fe-f3c3db26feb2 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:13.754968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fc2fc-aa95-46ad-87fe-f3c3db26feb2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:13.754968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2fc2fc-aa95-46ad-87fe-f3c3db26feb2 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:13.754968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 519/1027] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:13.755157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ce439-64bf-4941-8a37-71c158112ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:13.755157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ce439-64bf-4941-8a37-71c158112ece None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:13.755157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ce439-64bf-4941-8a37-71c158112ece None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:13.755157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ce439-64bf-4941-8a37-71c158112ece None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:13.755521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ce439-64bf-4941-8a37-71c158112ece None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:13.755642 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fc2fc-aa95-46ad-87fe-f3c3db26feb2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:13.756522 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ce439-64bf-4941-8a37-71c158112ece None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:13.779376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 509/1028] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:33:13 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:33:13.780614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98594-445d-4201-9c7e-4f078ed1638a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:13.780897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98594-445d-4201-9c7e-4f078ed1638a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:13.781168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98594-445d-4201-9c7e-4f078ed1638a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:13.793730 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:13.800648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-34e98594-445d-4201-9c7e-4f078ed1638a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:13.801918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-34e98594-445d-4201-9c7e-4f078ed1638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:13.836139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:13.881748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2fc2fc-aa95-46ad-87fe-f3c3db26feb2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:13.882846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 510/1029] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:13.905795 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98594-445d-4201-9c7e-4f078ed1638a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:13.918666 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ddcfa-8cfd-4417-8035-3f8f3bc021f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:13.919305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ddcfa-8cfd-4417-8035-3f8f3bc021f7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:13.919595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ddcfa-8cfd-4417-8035-3f8f3bc021f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:13.919856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ddcfa-8cfd-4417-8035-3f8f3bc021f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:13.920595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ddcfa-8cfd-4417-8035-3f8f3bc021f7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:13.920929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ddcfa-8cfd-4417-8035-3f8f3bc021f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:13.922369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ddcfa-8cfd-4417-8035-3f8f3bc021f7 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:13.936779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 520/1030] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 02:33:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:13.938747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ddcfa-8cfd-4417-8035-3f8f3bc021f7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:14.028841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98594-445d-4201-9c7e-4f078ed1638a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:14.045107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:14.057189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ddcfa-8cfd-4417-8035-3f8f3bc021f7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:14.069141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bc4c5-0e47-42b9-b354-a3822409b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:14.070028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bc4c5-0e47-42b9-b354-a3822409b11c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:14.070664 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bc4c5-0e47-42b9-b354-a3822409b11c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:14.071461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bc4c5-0e47-42b9-b354-a3822409b11c None admin] PATH_INFO: `/v3/services/image` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:14.072602 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737bc4c5-0e47-42b9-b354-a3822409b11c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:14.074567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737bc4c5-0e47-42b9-b354-a3822409b11c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-737bc4c5-0e47-42b9-b354-a3822409b11c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:14.083999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:14.085011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:14.085888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 511/1031] 10.222.0.39 () {56 vars in 1105 bytes} [Tue Jul 26 02:33:13 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:14.091329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bc4c5-0e47-42b9-b354-a3822409b11c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:14.094976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d4bbd-042d-431c-94ee-e2eab7f716dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:14.095631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d4bbd-042d-431c-94ee-e2eab7f716dd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:14.095905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d4bbd-042d-431c-94ee-e2eab7f716dd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:14.096167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d4bbd-042d-431c-94ee-e2eab7f716dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:14.107772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d4bbd-042d-431c-94ee-e2eab7f716dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:14.109226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d4bbd-042d-431c-94ee-e2eab7f716dd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-485d4bbd-042d-431c-94ee-e2eab7f716dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:33:14.124784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:14.125868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:14.126978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:33:14.126978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:33:14.126978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:14.126978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:14.127256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:14.130929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 521/1032] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:14.133669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d4bbd-042d-431c-94ee-e2eab7f716dd None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:14.200117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737bc4c5-0e47-42b9-b354-a3822409b11c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:14.233800 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589f2d6-5813-4361-ae0c-f97d3545715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:14.234427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f2d6-5813-4361-ae0c-f97d3545715a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:14.234702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f2d6-5813-4361-ae0c-f97d3545715a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:14.234969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589f2d6-5813-4361-ae0c-f97d3545715a None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:14.235638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589f2d6-5813-4361-ae0c-f97d3545715a None admin] RBAC: Adding query filter params (name=image) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:14.235931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589f2d6-5813-4361-ae0c-f97d3545715a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:14.237318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589f2d6-5813-4361-ae0c-f97d3545715a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:14.246792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d4bbd-042d-431c-94ee-e2eab7f716dd None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:14.246960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 512/1033] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:14.247869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589f2d6-5813-4361-ae0c-f97d3545715a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:14.282575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90242780-a621-4092-949a-72a1ce2a6b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:14.283258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242780-a621-4092-949a-72a1ce2a6b82 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:14.283545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242780-a621-4092-949a-72a1ce2a6b82 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:14.283821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90242780-a621-4092-949a-72a1ce2a6b82 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:14.284513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90242780-a621-4092-949a-72a1ce2a6b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:14.284824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90242780-a621-4092-949a-72a1ce2a6b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:14.286424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90242780-a621-4092-949a-72a1ce2a6b82 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:14.296582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:14.306177 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 522/1034] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:14.307051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90242780-a621-4092-949a-72a1ce2a6b82 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:14.342520 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:14.349866 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589f2d6-5813-4361-ae0c-f97d3545715a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:14.386400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f66f7-9405-4097-8cbe-aeeeb6ba73df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:14.387189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f66f7-9405-4097-8cbe-aeeeb6ba73df None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:14.387475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f66f7-9405-4097-8cbe-aeeeb6ba73df None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:14.388115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f66f7-9405-4097-8cbe-aeeeb6ba73df None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:14.389100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f66f7-9405-4097-8cbe-aeeeb6ba73df None admin] RBAC: Adding query filter params (type=image) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:14.389433 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f66f7-9405-4097-8cbe-aeeeb6ba73df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:14.391251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f66f7-9405-4097-8cbe-aeeeb6ba73df None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:14.398918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 513/1035] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:14.405091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f66f7-9405-4097-8cbe-aeeeb6ba73df None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:14.417415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90242780-a621-4092-949a-72a1ce2a6b82 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:14.470978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecbd46-a9b9-44f2-940e-2f310afca12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:14.472439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecbd46-a9b9-44f2-940e-2f310afca12b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:14.472828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecbd46-a9b9-44f2-940e-2f310afca12b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:14.473224 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceecbd46-a9b9-44f2-940e-2f310afca12b None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:14.485113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecbd46-a9b9-44f2-940e-2f310afca12b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:14.487377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceecbd46-a9b9-44f2-940e-2f310afca12b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ceecbd46-a9b9-44f2-940e-2f310afca12b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:33:14.507061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:14.508149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:14.509217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:14.509217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:14.509217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:33:14.509217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:33:14.509217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:33:14.509217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:33:14.509217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:33:14.509217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:33:14.509217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:33:14.509217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:14.516398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 523/1036] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 02:33:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:14.518364 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecbd46-a9b9-44f2-940e-2f310afca12b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:14.560335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f66f7-9405-4097-8cbe-aeeeb6ba73df None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:14.594350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:14.599124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b925ff3-643b-4045-8dd7-4100ae789758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:14.599966 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b925ff3-643b-4045-8dd7-4100ae789758 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:14.600585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b925ff3-643b-4045-8dd7-4100ae789758 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:14.600856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b925ff3-643b-4045-8dd7-4100ae789758 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:14.601668 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b925ff3-643b-4045-8dd7-4100ae789758 None admin] RBAC: Adding query filter params (interface=public, service_id=56ba9b5119a7488e9bb641069f850b8f, region_id=RegionOne) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:14.601979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b925ff3-643b-4045-8dd7-4100ae789758 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:14.603466 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b925ff3-643b-4045-8dd7-4100ae789758 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:14.608794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 514/1037] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 02:33:14 2022] GET /identity/v3/endpoints?service_id=56ba9b5119a7488e9bb641069f850b8f&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:14.614890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b925ff3-643b-4045-8dd7-4100ae789758 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:14.640233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:14.650551 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceecbd46-a9b9-44f2-940e-2f310afca12b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:14.692590 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ba59b-d95a-4e1d-826c-9057cd6de60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:14.693730 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ba59b-d95a-4e1d-826c-9057cd6de60d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:14.694019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ba59b-d95a-4e1d-826c-9057cd6de60d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:14.694300 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ba59b-d95a-4e1d-826c-9057cd6de60d None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:14.695537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ba59b-d95a-4e1d-826c-9057cd6de60d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:14.695854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ba59b-d95a-4e1d-826c-9057cd6de60d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:14.698034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ba59b-d95a-4e1d-826c-9057cd6de60d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:14.717895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 524/1038] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 02:33:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:14.719467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b925ff3-643b-4045-8dd7-4100ae789758 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:14.723571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ba59b-d95a-4e1d-826c-9057cd6de60d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:14.756540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a1451-cbc1-4369-82d5-ff60cacd2b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:14.757163 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1451-cbc1-4369-82d5-ff60cacd2b25 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:14.757473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1451-cbc1-4369-82d5-ff60cacd2b25 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:14.757748 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1451-cbc1-4369-82d5-ff60cacd2b25 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:14.758517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a1451-cbc1-4369-82d5-ff60cacd2b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:14.760071 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a1451-cbc1-4369-82d5-ff60cacd2b25 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:14.777592 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 515/1039] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 02:33:14 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:33:14.840053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ba59b-d95a-4e1d-826c-9057cd6de60d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:14.860177 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:14.880552 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660d6b8-40ac-49b0-840a-7b1525ce8fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:14.881198 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660d6b8-40ac-49b0-840a-7b1525ce8fa1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:14.881499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660d6b8-40ac-49b0-840a-7b1525ce8fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:14.881768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660d6b8-40ac-49b0-840a-7b1525ce8fa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:14.956848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660d6b8-40ac-49b0-840a-7b1525ce8fa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:14.958320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660d6b8-40ac-49b0-840a-7b1525ce8fa1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:15.055930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 525/1040] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:33:14 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 02:33:15.061788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a1451-cbc1-4369-82d5-ff60cacd2b25 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:15.148344 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:15.164852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a1451-cbc1-4369-82d5-ff60cacd2b25 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:15.198235 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89335c-424f-4c55-993e-d5c8328e1df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:15.198882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89335c-424f-4c55-993e-d5c8328e1df2 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:15.199162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89335c-424f-4c55-993e-d5c8328e1df2 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:15.199434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89335c-424f-4c55-993e-d5c8328e1df2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:15.210754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89335c-424f-4c55-993e-d5c8328e1df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:15.212263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89335c-424f-4c55-993e-d5c8328e1df2 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-da89335c-424f-4c55-993e-d5c8328e1df2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:33:15.226928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:15.227852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:15.229875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:33:15.229875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:33:15.229875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:15.229875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:15.229875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 516/1041] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:15.234234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660d6b8-40ac-49b0-840a-7b1525ce8fa1 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:15.253481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:15.337165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660d6b8-40ac-49b0-840a-7b1525ce8fa1 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:15.372023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94911e-95b1-4fa7-b6b5-a5a05b7b7cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:15.372633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94911e-95b1-4fa7-b6b5-a5a05b7b7cd6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:15.372908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94911e-95b1-4fa7-b6b5-a5a05b7b7cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:15.373178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94911e-95b1-4fa7-b6b5-a5a05b7b7cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:15.373895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94911e-95b1-4fa7-b6b5-a5a05b7b7cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:15.374190 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94911e-95b1-4fa7-b6b5-a5a05b7b7cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:15.375543 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94911e-95b1-4fa7-b6b5-a5a05b7b7cd6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:15.387261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 526/1042] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:15.392865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89335c-424f-4c55-993e-d5c8328e1df2 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:15.496153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89335c-424f-4c55-993e-d5c8328e1df2 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:15.531282 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517b50f-012d-464c-8cb3-e4fcda9af4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:15.531914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517b50f-012d-464c-8cb3-e4fcda9af4db None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:15.532182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517b50f-012d-464c-8cb3-e4fcda9af4db None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:15.532447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517b50f-012d-464c-8cb3-e4fcda9af4db None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:15.539338 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517b50f-012d-464c-8cb3-e4fcda9af4db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:15.541131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517b50f-012d-464c-8cb3-e4fcda9af4db None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:15.542735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b517b50f-012d-464c-8cb3-e4fcda9af4db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:33:15.554072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:15.555040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:15.555958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:33:15.555958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:33:15.555958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:33:15.555958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:33:15.555958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:33:15.555958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:33:15.555958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:33:15.555958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:15.557649 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 517/1043] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:33:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:15.561361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94911e-95b1-4fa7-b6b5-a5a05b7b7cd6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:15.646174 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:15.669826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94911e-95b1-4fa7-b6b5-a5a05b7b7cd6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:15.704311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d9d56-965b-463a-bbcd-4eca821b4362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:15.705166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9d56-965b-463a-bbcd-4eca821b4362 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:15.705673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9d56-965b-463a-bbcd-4eca821b4362 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:15.706124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d9d56-965b-463a-bbcd-4eca821b4362 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:15.707068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d9d56-965b-463a-bbcd-4eca821b4362 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:15.707519 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d9d56-965b-463a-bbcd-4eca821b4362 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:15.709088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d9d56-965b-463a-bbcd-4eca821b4362 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:15.721970 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 527/1044] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:33:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:15.728465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517b50f-012d-464c-8cb3-e4fcda9af4db None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:15.820903 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25c020-13ae-4d4e-a284-d650bcee20f6 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:15.821091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25c020-13ae-4d4e-a284-d650bcee20f6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:15.821360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25c020-13ae-4d4e-a284-d650bcee20f6 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:15.822771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 528/1045] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:33:15.828181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3b0bb-a175-4706-a845-2edc1c0dba49 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:15.828568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3b0bb-a175-4706-a845-2edc1c0dba49 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:15.828743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3b0bb-a175-4706-a845-2edc1c0dba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:15.835768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517b50f-012d-464c-8cb3-e4fcda9af4db None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:15.848057 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bbf3b0bb-a175-4706-a845-2edc1c0dba49 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:15.849257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bbf3b0bb-a175-4706-a845-2edc1c0dba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:15.873723 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0aa1a0-3ddf-4ed2-9f70-39d70057fa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:15.874377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aa1a0-3ddf-4ed2-9f70-39d70057fa12 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:15.874653 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aa1a0-3ddf-4ed2-9f70-39d70057fa12 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:15.874925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0aa1a0-3ddf-4ed2-9f70-39d70057fa12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:15.875754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0aa1a0-3ddf-4ed2-9f70-39d70057fa12 None admin] RBAC: Adding query filter params (role.id=ad2dba59bed14bb1b37cab7b9d4ef96d, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=338b2744014940ca96c08d4e9262697b) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:15.876063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0aa1a0-3ddf-4ed2-9f70-39d70057fa12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:15.877584 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0aa1a0-3ddf-4ed2-9f70-39d70057fa12 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:15.883841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 518/1046] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:33:15 2022] GET /identity/v3/role_assignments?user.id=338b2744014940ca96c08d4e9262697b&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=ad2dba59bed14bb1b37cab7b9d4ef96d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:15.925753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 529/1047] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:15.948984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0aa1a0-3ddf-4ed2-9f70-39d70057fa12 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:16.016800 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:16.060696 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0aa1a0-3ddf-4ed2-9f70-39d70057fa12 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:16.093881 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35c345-9ec4-447b-a287-16d41dc49e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:16.094494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35c345-9ec4-447b-a287-16d41dc49e79 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:16.094772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35c345-9ec4-447b-a287-16d41dc49e79 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:16.095042 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35c345-9ec4-447b-a287-16d41dc49e79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:16.105630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35c345-9ec4-447b-a287-16d41dc49e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-7f35c345-9ec4-447b-a287-16d41dc49e79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:33:16.110942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:16.111852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:16.112681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:16.112681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:16.112681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:16.112681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:16.112681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:33:16.112681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:33:16.112681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:33:16.112681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:33:16.112681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:33:16.112681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:33:16.112681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:33:16.112681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:16.112681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 519/1048] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:33:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:16.120161 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3b0bb-a175-4706-a845-2edc1c0dba49 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:16.190380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:16.225629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3b0bb-a175-4706-a845-2edc1c0dba49 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:16.259951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f923a-82c9-4648-92fb-6c9f954370b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:16.260565 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f923a-82c9-4648-92fb-6c9f954370b6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:16.260845 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f923a-82c9-4648-92fb-6c9f954370b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:16.261116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f923a-82c9-4648-92fb-6c9f954370b6 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:16.261859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f923a-82c9-4648-92fb-6c9f954370b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:16.262160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f923a-82c9-4648-92fb-6c9f954370b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:16.263525 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f923a-82c9-4648-92fb-6c9f954370b6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:16.271965 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 530/1049] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:33:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:16.277775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35c345-9ec4-447b-a287-16d41dc49e79 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:16.382930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35c345-9ec4-447b-a287-16d41dc49e79 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:16.405251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:16.420583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17d3a3-9ba3-4be2-a321-7de70634eded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:16.421274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d3a3-9ba3-4be2-a321-7de70634eded None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:16.421579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d3a3-9ba3-4be2-a321-7de70634eded None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:16.421847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17d3a3-9ba3-4be2-a321-7de70634eded None admin] PATH_INFO: `/v3/users/22fc3488b5b449928e9a2f7ee0abf732` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:16.435364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17d3a3-9ba3-4be2-a321-7de70634eded None admin] RBAC: Authorizing `identity:get_user(user_id=22fc3488b5b449928e9a2f7ee0abf732)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:16.437099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17d3a3-9ba3-4be2-a321-7de70634eded None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:16.443510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 520/1050] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:33:16 2022] GET /identity/v3/users/22fc3488b5b449928e9a2f7ee0abf732 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:16.444772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f923a-82c9-4648-92fb-6c9f954370b6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:16.550750 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f923a-82c9-4648-92fb-6c9f954370b6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:16.578972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:16.586171 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604e274-9efc-43b5-9ec8-8985352fb111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:16.586797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e274-9efc-43b5-9ec8-8985352fb111 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:16.587077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e274-9efc-43b5-9ec8-8985352fb111 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:16.587364 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604e274-9efc-43b5-9ec8-8985352fb111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:16.663763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604e274-9efc-43b5-9ec8-8985352fb111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:16.665550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604e274-9efc-43b5-9ec8-8985352fb111 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:16.770510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 531/1051] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:33:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:33:16.770739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaff6d-8566-4edb-a144-f85309e3bf4b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:16.770963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaff6d-8566-4edb-a144-f85309e3bf4b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:16.771276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eaff6d-8566-4edb-a144-f85309e3bf4b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:16.772760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 521/1052] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:33:16.776316 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604e274-9efc-43b5-9ec8-8985352fb111 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:16.777442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da26a10-3dbe-4a92-89a4-20a93cec922d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:16.777726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da26a10-3dbe-4a92-89a4-20a93cec922d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:16.777978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da26a10-3dbe-4a92-89a4-20a93cec922d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:16.796487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0da26a10-3dbe-4a92-89a4-20a93cec922d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:16.797715 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0da26a10-3dbe-4a92-89a4-20a93cec922d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:16.807325 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:16.866179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 522/1053] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:33:16.885667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604e274-9efc-43b5-9ec8-8985352fb111 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:16.888577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da26a10-3dbe-4a92-89a4-20a93cec922d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:16.922142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e26f9b-a18b-4dc0-ac86-61a8f8ec5a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:16.923025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e26f9b-a18b-4dc0-ac86-61a8f8ec5a6c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:16.923451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e26f9b-a18b-4dc0-ac86-61a8f8ec5a6c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:16.923880 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e26f9b-a18b-4dc0-ac86-61a8f8ec5a6c None admin] PATH_INFO: `/v3/projects/15cc215116554404bac2356c0e03667b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:16.925042 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e26f9b-a18b-4dc0-ac86-61a8f8ec5a6c None admin] RBAC: Authorizing `identity:get_project(project_id=15cc215116554404bac2356c0e03667b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:16.926526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e26f9b-a18b-4dc0-ac86-61a8f8ec5a6c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:16.928241 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 532/1054] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:33:16 2022] GET /identity/v3/projects/15cc215116554404bac2356c0e03667b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:16.934269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e26f9b-a18b-4dc0-ac86-61a8f8ec5a6c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:16.989958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da26a10-3dbe-4a92-89a4-20a93cec922d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:17.002176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:17.027460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bb1cc-b899-4917-9066-d787f2c59e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:17.028182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bb1cc-b899-4917-9066-d787f2c59e56 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:17.028471 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bb1cc-b899-4917-9066-d787f2c59e56 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:17.028768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6bb1cc-b899-4917-9066-d787f2c59e56 None admin] PATH_INFO: `/v3/services/image` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:17.029515 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6bb1cc-b899-4917-9066-d787f2c59e56 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:17.030916 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6bb1cc-b899-4917-9066-d787f2c59e56 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:17.034581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:17.038791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e26f9b-a18b-4dc0-ac86-61a8f8ec5a6c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-6c6bb1cc-b899-4917-9066-d787f2c59e56 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:17.042312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:17.043304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:17.044136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 523/1055] 10.222.0.39 () {56 vars in 1105 bytes} [Tue Jul 26 02:33:16 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:17.049536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bb1cc-b899-4917-9066-d787f2c59e56 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:17.082912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdd3f2-b9af-4091-8be4-4d3ab9b8f5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:17.083532 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdd3f2-b9af-4091-8be4-4d3ab9b8f5c6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:17.083813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdd3f2-b9af-4091-8be4-4d3ab9b8f5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:17.084084 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdd3f2-b9af-4091-8be4-4d3ab9b8f5c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:17.084870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdd3f2-b9af-4091-8be4-4d3ab9b8f5c6 None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=15cc215116554404bac2356c0e03667b, user.id=22fc3488b5b449928e9a2f7ee0abf732) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:17.085180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdd3f2-b9af-4091-8be4-4d3ab9b8f5c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:17.086694 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdd3f2-b9af-4091-8be4-4d3ab9b8f5c6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:17.092562 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 533/1056] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:33:16 2022] GET /identity/v3/role_assignments?user.id=22fc3488b5b449928e9a2f7ee0abf732&scope.project.id=15cc215116554404bac2356c0e03667b&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:17.171423 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6bb1cc-b899-4917-9066-d787f2c59e56 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:17.207667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5debdeb-f891-40c1-950c-1d5ad9ede4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:17.208225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5debdeb-f891-40c1-950c-1d5ad9ede4a1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:17.208505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5debdeb-f891-40c1-950c-1d5ad9ede4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:17.208775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5debdeb-f891-40c1-950c-1d5ad9ede4a1 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:17.209516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5debdeb-f891-40c1-950c-1d5ad9ede4a1 None admin] RBAC: Adding query filter params (name=image) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:17.209825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5debdeb-f891-40c1-950c-1d5ad9ede4a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:17.211276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5debdeb-f891-40c1-950c-1d5ad9ede4a1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:17.217465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 524/1057] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:17.223474 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdd3f2-b9af-4091-8be4-4d3ab9b8f5c6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:17.329515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdd3f2-b9af-4091-8be4-4d3ab9b8f5c6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:17.365551 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51e8fc-69ca-45a6-aac3-b0e325a9640c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:17.366174 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51e8fc-69ca-45a6-aac3-b0e325a9640c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:17.366453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51e8fc-69ca-45a6-aac3-b0e325a9640c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:17.366724 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51e8fc-69ca-45a6-aac3-b0e325a9640c None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:17.367401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51e8fc-69ca-45a6-aac3-b0e325a9640c None admin] RBAC: Adding query filter params (type=image) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:17.367703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51e8fc-69ca-45a6-aac3-b0e325a9640c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:17.369184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51e8fc-69ca-45a6-aac3-b0e325a9640c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:17.374295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 534/1058] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:17.379934 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5debdeb-f891-40c1-950c-1d5ad9ede4a1 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:17.422190 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:17.485606 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5debdeb-f891-40c1-950c-1d5ad9ede4a1 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:17.519771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe2259-7dc9-4ccd-8895-54848494ce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:17.520397 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe2259-7dc9-4ccd-8895-54848494ce57 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:17.520670 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe2259-7dc9-4ccd-8895-54848494ce57 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:17.520941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe2259-7dc9-4ccd-8895-54848494ce57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:17.521700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe2259-7dc9-4ccd-8895-54848494ce57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:17.523085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe2259-7dc9-4ccd-8895-54848494ce57 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:17.544694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 525/1059] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:33:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:33:17.876202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9696a-c82a-4bc6-97fe-02d2f051f215 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:17.876774 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9696a-c82a-4bc6-97fe-02d2f051f215 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:17.876774 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9696a-c82a-4bc6-97fe-02d2f051f215 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:17.878366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 535/1060] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:17.883761 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905658bf-e21f-4c52-8c22-16957d62b780 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:17.884054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905658bf-e21f-4c52-8c22-16957d62b780 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:17.884330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905658bf-e21f-4c52-8c22-16957d62b780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:17.903611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-905658bf-e21f-4c52-8c22-16957d62b780 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:17.904902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-905658bf-e21f-4c52-8c22-16957d62b780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:17.981860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 526/1061] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:18.003790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9696a-c82a-4bc6-97fe-02d2f051f215 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:18.034814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:18.114247 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9696a-c82a-4bc6-97fe-02d2f051f215 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:18.148115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3ea4-4831-4120-ad0f-16f6bc86d81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:18.148685 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3ea4-4831-4120-ad0f-16f6bc86d81c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:18.148962 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3ea4-4831-4120-ad0f-16f6bc86d81c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:18.149232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3ea4-4831-4120-ad0f-16f6bc86d81c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:18.159976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d3ea4-4831-4120-ad0f-16f6bc86d81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-5e5d3ea4-4831-4120-ad0f-16f6bc86d81c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:33:18.164890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:18.166117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:18.172236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:18.172236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:18.172236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:18.172236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:18.172236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:33:18.172236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:33:18.172236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:33:18.172236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:33:18.172236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:33:18.172236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:33:18.172236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 02:33:18.172236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:18.172236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 536/1062] 10.222.0.39 () {56 vars in 1120 bytes} [Tue Jul 26 02:33:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:18.174752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905658bf-e21f-4c52-8c22-16957d62b780 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:18.199242 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:18.283015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905658bf-e21f-4c52-8c22-16957d62b780 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:18.317599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed744d55-d96e-4c5b-9ed0-96c8d611d2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:18.318215 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed744d55-d96e-4c5b-9ed0-96c8d611d2c0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:18.318492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed744d55-d96e-4c5b-9ed0-96c8d611d2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:18.318763 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed744d55-d96e-4c5b-9ed0-96c8d611d2c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:18.319484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed744d55-d96e-4c5b-9ed0-96c8d611d2c0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:18.319784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed744d55-d96e-4c5b-9ed0-96c8d611d2c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:18.321160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed744d55-d96e-4c5b-9ed0-96c8d611d2c0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:18.329382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 527/1063] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 02:33:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:18.335134 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3ea4-4831-4120-ad0f-16f6bc86d81c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:18.421794 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:18.438363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3ea4-4831-4120-ad0f-16f6bc86d81c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:18.472023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2a47b-fc79-4440-8052-d36ddb18114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:18.472704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2a47b-fc79-4440-8052-d36ddb18114f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:18.472987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2a47b-fc79-4440-8052-d36ddb18114f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:18.473257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2a47b-fc79-4440-8052-d36ddb18114f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:18.484228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2a47b-fc79-4440-8052-d36ddb18114f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:18.485704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2a47b-fc79-4440-8052-d36ddb18114f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-d1c2a47b-fc79-4440-8052-d36ddb18114f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:33:18.500052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:18.500988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:18.501907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:33:18.501907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:33:18.501907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:18.501907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:18.505670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 537/1064] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:18.507143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed744d55-d96e-4c5b-9ed0-96c8d611d2c0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:18.593821 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:18.619425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed744d55-d96e-4c5b-9ed0-96c8d611d2c0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:18.658351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20361117-10cd-4440-8c42-5421c6c83053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:18.659002 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20361117-10cd-4440-8c42-5421c6c83053 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:18.659277 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20361117-10cd-4440-8c42-5421c6c83053 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:18.659546 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20361117-10cd-4440-8c42-5421c6c83053 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:18.660265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20361117-10cd-4440-8c42-5421c6c83053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:18.660597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20361117-10cd-4440-8c42-5421c6c83053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:18.662055 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20361117-10cd-4440-8c42-5421c6c83053 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:18.680639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 528/1065] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:18.681646 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2a47b-fc79-4440-8052-d36ddb18114f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:18.791732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2a47b-fc79-4440-8052-d36ddb18114f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:18.825503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63b627-e2e4-4e7e-8604-5f7979773beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:18.826126 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63b627-e2e4-4e7e-8604-5f7979773beb None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:18.826400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63b627-e2e4-4e7e-8604-5f7979773beb None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:18.826668 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63b627-e2e4-4e7e-8604-5f7979773beb None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:18.834442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63b627-e2e4-4e7e-8604-5f7979773beb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:18.835879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63b627-e2e4-4e7e-8604-5f7979773beb None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:18.838576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-8a63b627-e2e4-4e7e-8604-5f7979773beb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:33:18.849002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:18.850398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:18.851352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:18.851352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:18.851352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:33:18.851352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:33:18.851352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:33:18.851352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:33:18.851352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:33:18.851352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:33:18.851352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:33:18.851352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:18.855695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 538/1066] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 02:33:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:18.857102 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20361117-10cd-4440-8c42-5421c6c83053 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:18.955227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20361117-10cd-4440-8c42-5421c6c83053 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:18.989032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e12f2-c256-4f43-9135-0a757236e72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:18.989737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e12f2-c256-4f43-9135-0a757236e72e None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:18.990005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e12f2-c256-4f43-9135-0a757236e72e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:18.990280 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e12f2-c256-4f43-9135-0a757236e72e None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:18.991069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e12f2-c256-4f43-9135-0a757236e72e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:18.991368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e12f2-c256-4f43-9135-0a757236e72e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:18.992793 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e12f2-c256-4f43-9135-0a757236e72e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:19.006656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:19.011396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 529/1067] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 02:33:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:19.017019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63b627-e2e4-4e7e-8604-5f7979773beb None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:19.064689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf1951-d720-4613-99f3-1baf5c54f643 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.065045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf1951-d720-4613-99f3-1baf5c54f643 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.065222 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf1951-d720-4613-99f3-1baf5c54f643 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:19.066744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 530/1068] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:33:19.071616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dab5b-d4a0-4356-81fd-ec2b67a7bae8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.071973 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dab5b-d4a0-4356-81fd-ec2b67a7bae8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.072257 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dab5b-d4a0-4356-81fd-ec2b67a7bae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:19.090182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d24dab5b-d4a0-4356-81fd-ec2b67a7bae8 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:19.091364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d24dab5b-d4a0-4356-81fd-ec2b67a7bae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:19.119711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63b627-e2e4-4e7e-8604-5f7979773beb None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:19.153799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76119a86-362f-409f-a3b0-90d8bbf0660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:19.154437 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76119a86-362f-409f-a3b0-90d8bbf0660f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.154712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76119a86-362f-409f-a3b0-90d8bbf0660f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.154987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76119a86-362f-409f-a3b0-90d8bbf0660f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:19.162276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 531/1069] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:33:19.165750 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76119a86-362f-409f-a3b0-90d8bbf0660f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:19.167172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76119a86-362f-409f-a3b0-90d8bbf0660f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-76119a86-362f-409f-a3b0-90d8bbf0660f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:33:19.181703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:19.182628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:19.183553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:33:19.183553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:33:19.183553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:19.183553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:19.184876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dab5b-d4a0-4356-81fd-ec2b67a7bae8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:19.187570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 539/1070] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:19.188760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76119a86-362f-409f-a3b0-90d8bbf0660f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:19.244623 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:19.295398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76119a86-362f-409f-a3b0-90d8bbf0660f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:19.296288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dab5b-d4a0-4356-81fd-ec2b67a7bae8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:19.326803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:19.328728 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6ce0-ebeb-46dd-956e-ba6f8477b87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:19.329489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6ce0-ebeb-46dd-956e-ba6f8477b87a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.329791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6ce0-ebeb-46dd-956e-ba6f8477b87a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.330107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a6ce0-ebeb-46dd-956e-ba6f8477b87a None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:19.330893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a6ce0-ebeb-46dd-956e-ba6f8477b87a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:19.331197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a6ce0-ebeb-46dd-956e-ba6f8477b87a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:19.332556 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a6ce0-ebeb-46dd-956e-ba6f8477b87a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:19.333909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045be1bb-4886-497f-a7be-5bd48d143954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:19.334580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045be1bb-4886-497f-a7be-5bd48d143954 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.334854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045be1bb-4886-497f-a7be-5bd48d143954 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.335414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045be1bb-4886-497f-a7be-5bd48d143954 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:19.346190 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045be1bb-4886-497f-a7be-5bd48d143954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:33:19.346374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 540/1071] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-045be1bb-4886-497f-a7be-5bd48d143954 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:33:19.351355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:19.352273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:19.353225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:19.353225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:19.353225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:19.353225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:19.353225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:33:19.353225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:33:19.353225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:33:19.353225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:33:19.353225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:33:19.353225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:33:19.353225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:33:19.353225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:19.354420 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6ce0-ebeb-46dd-956e-ba6f8477b87a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:19.354502 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 532/1072] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:33:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:19.358439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045be1bb-4886-497f-a7be-5bd48d143954 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:19.457578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a6ce0-ebeb-46dd-956e-ba6f8477b87a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:19.460600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045be1bb-4886-497f-a7be-5bd48d143954 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:19.468998 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:19.495017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9d67-17b5-47cb-b64f-ded7e08a1e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:19.496157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9d67-17b5-47cb-b64f-ded7e08a1e08 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.496610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9d67-17b5-47cb-b64f-ded7e08a1e08 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.496891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9d67-17b5-47cb-b64f-ded7e08a1e08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:19.501396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc213bc5-b320-4944-a2c6-79cc6b2b8de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:19.502018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc213bc5-b320-4944-a2c6-79cc6b2b8de0 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.502295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc213bc5-b320-4944-a2c6-79cc6b2b8de0 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.502564 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc213bc5-b320-4944-a2c6-79cc6b2b8de0 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:19.503277 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc213bc5-b320-4944-a2c6-79cc6b2b8de0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:19.503579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc213bc5-b320-4944-a2c6-79cc6b2b8de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:19.503853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e9d67-17b5-47cb-b64f-ded7e08a1e08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:19.504974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc213bc5-b320-4944-a2c6-79cc6b2b8de0 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:19.505277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e9d67-17b5-47cb-b64f-ded7e08a1e08 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:19.518414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 533/1073] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:33:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-1f0e9d67-17b5-47cb-b64f-ded7e08a1e08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:33:19.519052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:19.520082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:19.521195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:33:19.521195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:33:19.521195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:33:19.521195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:33:19.521195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:33:19.521195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:33:19.521195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:33:19.521195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:19.521195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 541/1074] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:33:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:19.523306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9d67-17b5-47cb-b64f-ded7e08a1e08 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:19.523423 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc213bc5-b320-4944-a2c6-79cc6b2b8de0 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:19.578432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:19.623042 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9d67-17b5-47cb-b64f-ded7e08a1e08 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:19.627346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc213bc5-b320-4944-a2c6-79cc6b2b8de0 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:19.657798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83740d47-c2ee-47c4-903f-ab7a7b0609b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:19.658411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83740d47-c2ee-47c4-903f-ab7a7b0609b1 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.658685 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83740d47-c2ee-47c4-903f-ab7a7b0609b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.658949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83740d47-c2ee-47c4-903f-ab7a7b0609b1 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:19.659684 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83740d47-c2ee-47c4-903f-ab7a7b0609b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:19.659981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83740d47-c2ee-47c4-903f-ab7a7b0609b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:19.660826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143f9d8-c043-4d9c-a362-953c6ddd7810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:19.661411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83740d47-c2ee-47c4-903f-ab7a7b0609b1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:19.661521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f9d8-c043-4d9c-a362-953c6ddd7810 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.661772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f9d8-c043-4d9c-a362-953c6ddd7810 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.662040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f9d8-c043-4d9c-a362-953c6ddd7810 None admin] PATH_INFO: `/v3/users/22fc3488b5b449928e9a2f7ee0abf732` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:19.663207 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143f9d8-c043-4d9c-a362-953c6ddd7810 None admin] RBAC: Authorizing `identity:get_user(user_id=22fc3488b5b449928e9a2f7ee0abf732)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:19.664632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143f9d8-c043-4d9c-a362-953c6ddd7810 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:19.666472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 534/1075] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:33:19 2022] GET /identity/v3/users/22fc3488b5b449928e9a2f7ee0abf732 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:19.667429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4137cda-e4f1-4691-b155-2307cc25bb01 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.667710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4137cda-e4f1-4691-b155-2307cc25bb01 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.667987 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4137cda-e4f1-4691-b155-2307cc25bb01 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:19.669170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 535/1076] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:19.673449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 542/1077] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:33:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:19.673886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4137cda-e4f1-4691-b155-2307cc25bb01 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:19.675160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2a6c5-6439-4b8c-83a7-884a6076e391 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.675442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2a6c5-6439-4b8c-83a7-884a6076e391 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.675711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2a6c5-6439-4b8c-83a7-884a6076e391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:19.694310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-83c2a6c5-6439-4b8c-83a7-884a6076e391 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:19.695492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-83c2a6c5-6439-4b8c-83a7-884a6076e391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:19.719334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:19.763698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 543/1078] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:19.764418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2a6c5-6439-4b8c-83a7-884a6076e391 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:19.787545 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4137cda-e4f1-4691-b155-2307cc25bb01 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:19.807332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:19.822399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df279afa-cba0-42b9-8b33-2cfd457b2041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:19.823043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df279afa-cba0-42b9-8b33-2cfd457b2041 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.823323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df279afa-cba0-42b9-8b33-2cfd457b2041 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.823594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df279afa-cba0-42b9-8b33-2cfd457b2041 None admin] PATH_INFO: `/v3/projects/15cc215116554404bac2356c0e03667b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:19.824735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df279afa-cba0-42b9-8b33-2cfd457b2041 None admin] RBAC: Authorizing `identity:get_project(project_id=15cc215116554404bac2356c0e03667b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:19.826213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df279afa-cba0-42b9-8b33-2cfd457b2041 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:19.827881 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 536/1079] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:33:19 2022] GET /identity/v3/projects/15cc215116554404bac2356c0e03667b => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:19.833081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df279afa-cba0-42b9-8b33-2cfd457b2041 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:19.861868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2a6c5-6439-4b8c-83a7-884a6076e391 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:19.895535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52b2d7-4826-48eb-944a-174df78f57b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:19.896189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52b2d7-4826-48eb-944a-174df78f57b8 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.896474 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52b2d7-4826-48eb-944a-174df78f57b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.896704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52b2d7-4826-48eb-944a-174df78f57b8 None admin] PATH_INFO: `/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/338b2744014940ca96c08d4e9262697b/roles/ad2dba59bed14bb1b37cab7b9d4ef96d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:19.899030 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52b2d7-4826-48eb-944a-174df78f57b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b017927d64b44db8a1611f20e6e3b6f5, user_id=338b2744014940ca96c08d4e9262697b, role_id=ad2dba59bed14bb1b37cab7b9d4ef96d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:19.900511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52b2d7-4826-48eb-944a-174df78f57b8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:19.914028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 544/1080] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:33:19 2022] PUT /identity/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/338b2744014940ca96c08d4e9262697b/roles/ad2dba59bed14bb1b37cab7b9d4ef96d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:33:19.914800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52b2d7-4826-48eb-944a-174df78f57b8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:19.930648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df279afa-cba0-42b9-8b33-2cfd457b2041 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:19.938665 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:19.974279 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74c4e4-0c3e-438f-8389-bc1ff5971c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:19.975269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74c4e4-0c3e-438f-8389-bc1ff5971c08 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:19.975552 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74c4e4-0c3e-438f-8389-bc1ff5971c08 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:19.975820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b74c4e4-0c3e-438f-8389-bc1ff5971c08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:20.030437 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52b2d7-4826-48eb-944a-174df78f57b8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:20.037374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:20.050948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74c4e4-0c3e-438f-8389-bc1ff5971c08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:20.052473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b74c4e4-0c3e-438f-8389-bc1ff5971c08 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:20.073383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40591880-1216-48ce-8ebb-d768fbc30aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:20.074455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591880-1216-48ce-8ebb-d768fbc30aa9 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:20.074939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591880-1216-48ce-8ebb-d768fbc30aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:20.075409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591880-1216-48ce-8ebb-d768fbc30aa9 None admin] PATH_INFO: `/v3/projects/15cc215116554404bac2356c0e03667b/users/22fc3488b5b449928e9a2f7ee0abf732/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:20.079133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40591880-1216-48ce-8ebb-d768fbc30aa9 None admin] RBAC: Authorizing `identity:create_grant(project_id=15cc215116554404bac2356c0e03667b, user_id=22fc3488b5b449928e9a2f7ee0abf732, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:20.081454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40591880-1216-48ce-8ebb-d768fbc30aa9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:20.099229 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 545/1081] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:33:19 2022] PUT /identity/v3/projects/15cc215116554404bac2356c0e03667b/users/22fc3488b5b449928e9a2f7ee0abf732/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:33:20.168894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 537/1082] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:33:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:33:20.174869 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40591880-1216-48ce-8ebb-d768fbc30aa9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:20.267639 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:20.288912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40591880-1216-48ce-8ebb-d768fbc30aa9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:20.323609 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08315e-4484-47e4-9845-68f645f27bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:20.324254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08315e-4484-47e4-9845-68f645f27bd0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:20.324524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08315e-4484-47e4-9845-68f645f27bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:20.324791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08315e-4484-47e4-9845-68f645f27bd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:20.335293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08315e-4484-47e4-9845-68f645f27bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:20.336774 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08315e-4484-47e4-9845-68f645f27bd0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9a08315e-4484-47e4-9845-68f645f27bd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:33:20.353737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:20.354697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:20.355571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:33:20.355571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:33:20.355571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:20.355571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:20.355571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 546/1083] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:20.362089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74c4e4-0c3e-438f-8389-bc1ff5971c08 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:20.454805 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:20.468011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b74c4e4-0c3e-438f-8389-bc1ff5971c08 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:20.502949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a38d32-5d6d-4200-8105-20a7cf394cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:20.503905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a38d32-5d6d-4200-8105-20a7cf394cee None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:20.504374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a38d32-5d6d-4200-8105-20a7cf394cee None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:20.504830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a38d32-5d6d-4200-8105-20a7cf394cee None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:20.505733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a38d32-5d6d-4200-8105-20a7cf394cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:20.506227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a38d32-5d6d-4200-8105-20a7cf394cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:20.507811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a38d32-5d6d-4200-8105-20a7cf394cee None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:20.525543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 538/1084] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:21.884527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59b256-e34b-46e5-b499-0214f6a686cc None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:21.885128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59b256-e34b-46e5-b499-0214f6a686cc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:21.885128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59b256-e34b-46e5-b499-0214f6a686cc None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:21.886491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 547/1085] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:21.891707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061b253-0d1d-4487-89f9-898457926e96 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:21.892099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061b253-0d1d-4487-89f9-898457926e96 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:21.892245 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061b253-0d1d-4487-89f9-898457926e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:21.911157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b061b253-0d1d-4487-89f9-898457926e96 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:21.912340 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b061b253-0d1d-4487-89f9-898457926e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:21.980633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 539/1086] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:22.003460 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59b256-e34b-46e5-b499-0214f6a686cc None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:22.090284 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cd622-6f51-4241-aff0-aeae2a80b23d None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:22.090567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cd622-6f51-4241-aff0-aeae2a80b23d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:22.090834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083cd622-6f51-4241-aff0-aeae2a80b23d None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:22.092227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 540/1087] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:22.097131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99181b8b-7bf2-48c8-ada2-d51d512f3de0 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:22.097360 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99181b8b-7bf2-48c8-ada2-d51d512f3de0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:22.097639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99181b8b-7bf2-48c8-ada2-d51d512f3de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:22.109554 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59b256-e34b-46e5-b499-0214f6a686cc None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:22.116672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-99181b8b-7bf2-48c8-ada2-d51d512f3de0 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:22.118331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-99181b8b-7bf2-48c8-ada2-d51d512f3de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:22.140064 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:22.145561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90021fb-a1e1-4a89-be2a-818a59c20dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:22.146245 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90021fb-a1e1-4a89-be2a-818a59c20dc7 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:22.146777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90021fb-a1e1-4a89-be2a-818a59c20dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:22.146777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90021fb-a1e1-4a89-be2a-818a59c20dc7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:22.158488 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90021fb-a1e1-4a89-be2a-818a59c20dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e90021fb-a1e1-4a89-be2a-818a59c20dc7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:33:22.163349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:22.164292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:22.165400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:22.165400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:22.165400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:22.165400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:22.165400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:33:22.165400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:33:22.165400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:33:22.165400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:33:22.165400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:33:22.165400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:33:22.165400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 02:33:22.165400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:22.165400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 548/1088] 10.222.0.39 () {56 vars in 1120 bytes} [Tue Jul 26 02:33:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:22.170721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90021fb-a1e1-4a89-be2a-818a59c20dc7 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:22.186807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 541/1089] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 02:33:22.208983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99181b8b-7bf2-48c8-ada2-d51d512f3de0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:22.218611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:22.270953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90021fb-a1e1-4a89-be2a-818a59c20dc7 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:22.302846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99181b8b-7bf2-48c8-ada2-d51d512f3de0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:22.303877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5640c-3094-42bd-819f-0a1cdd4d234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:22.304497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5640c-3094-42bd-819f-0a1cdd4d234a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:22.304778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5640c-3094-42bd-819f-0a1cdd4d234a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:22.305053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5640c-3094-42bd-819f-0a1cdd4d234a None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:22.305808 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5640c-3094-42bd-819f-0a1cdd4d234a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:22.306161 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5640c-3094-42bd-819f-0a1cdd4d234a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:22.307546 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5640c-3094-42bd-819f-0a1cdd4d234a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:22.315416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 549/1090] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 02:33:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:22.321040 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5640c-3094-42bd-819f-0a1cdd4d234a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:22.336042 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e63510-e9b9-4aec-b774-e3f22fc63aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:22.336687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e63510-e9b9-4aec-b774-e3f22fc63aa7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:22.336964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e63510-e9b9-4aec-b774-e3f22fc63aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:22.337236 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e63510-e9b9-4aec-b774-e3f22fc63aa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:22.347619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e63510-e9b9-4aec-b774-e3f22fc63aa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d6e63510-e9b9-4aec-b774-e3f22fc63aa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:33:22.352888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:22.354043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:22.354880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:22.354880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:22.354880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:22.354880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:22.354880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:33:22.354880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:33:22.354880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:33:22.354880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:33:22.354880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:33:22.354880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:33:22.354880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:33:22.354880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:22.354880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 542/1091] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:33:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:22.359927 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e63510-e9b9-4aec-b774-e3f22fc63aa7 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:22.376850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:22.420577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5640c-3094-42bd-819f-0a1cdd4d234a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:22.423360 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:22.453496 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea3a5e-0fb5-4e93-88f6-b9fe4e993d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:22.454132 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea3a5e-0fb5-4e93-88f6-b9fe4e993d20 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:22.454410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea3a5e-0fb5-4e93-88f6-b9fe4e993d20 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:22.454680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea3a5e-0fb5-4e93-88f6-b9fe4e993d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:22.455203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e63510-e9b9-4aec-b774-e3f22fc63aa7 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:22.465603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea3a5e-0fb5-4e93-88f6-b9fe4e993d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:22.467037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea3a5e-0fb5-4e93-88f6-b9fe4e993d20 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-c2ea3a5e-0fb5-4e93-88f6-b9fe4e993d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:33:22.481311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:22.482348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:22.483846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:33:22.483846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:33:22.483846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:22.483846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:22.483846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 550/1092] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:22.488146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea3a5e-0fb5-4e93-88f6-b9fe4e993d20 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:22.488958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b07a16-7a21-46eb-8fd5-76f92a3fdbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:22.489610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b07a16-7a21-46eb-8fd5-76f92a3fdbaf None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:22.489894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b07a16-7a21-46eb-8fd5-76f92a3fdbaf None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:22.490168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b07a16-7a21-46eb-8fd5-76f92a3fdbaf None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:22.490883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b07a16-7a21-46eb-8fd5-76f92a3fdbaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:22.491189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b07a16-7a21-46eb-8fd5-76f92a3fdbaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:22.492570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b07a16-7a21-46eb-8fd5-76f92a3fdbaf None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:22.505862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 543/1093] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:33:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:22.507117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b07a16-7a21-46eb-8fd5-76f92a3fdbaf None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:22.586226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea3a5e-0fb5-4e93-88f6-b9fe4e993d20 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:22.593136 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:22.605925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b07a16-7a21-46eb-8fd5-76f92a3fdbaf None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:22.623178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4a34d-a06f-4038-932b-703899177ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:22.623807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4a34d-a06f-4038-932b-703899177ce2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:22.624085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4a34d-a06f-4038-932b-703899177ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:22.624356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4a34d-a06f-4038-932b-703899177ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:22.625050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4a34d-a06f-4038-932b-703899177ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:22.625380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4a34d-a06f-4038-932b-703899177ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:22.626760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4a34d-a06f-4038-932b-703899177ce2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:22.633669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:22.639218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 551/1094] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:22.640110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c6075-ffd6-4aec-a88e-d10dc7c1bc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:22.640760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c6075-ffd6-4aec-a88e-d10dc7c1bc43 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:22.641045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c6075-ffd6-4aec-a88e-d10dc7c1bc43 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:22.641543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c6075-ffd6-4aec-a88e-d10dc7c1bc43 None admin] PATH_INFO: `/v3/users/22fc3488b5b449928e9a2f7ee0abf732` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:22.643527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c6075-ffd6-4aec-a88e-d10dc7c1bc43 None admin] RBAC: Authorizing `identity:get_user(user_id=22fc3488b5b449928e9a2f7ee0abf732)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:22.644802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4a34d-a06f-4038-932b-703899177ce2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:22.645064 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c6075-ffd6-4aec-a88e-d10dc7c1bc43 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:22.647096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 544/1095] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:33:22 2022] GET /identity/v3/users/22fc3488b5b449928e9a2f7ee0abf732 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:22.652568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c6075-ffd6-4aec-a88e-d10dc7c1bc43 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:22.744644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4a34d-a06f-4038-932b-703899177ce2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:22.755376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c6075-ffd6-4aec-a88e-d10dc7c1bc43 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:22.777800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000c97e-a3c6-4317-94d7-9256b147655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:22.778470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000c97e-a3c6-4317-94d7-9256b147655a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:22.778729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000c97e-a3c6-4317-94d7-9256b147655a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:22.778999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000c97e-a3c6-4317-94d7-9256b147655a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:22.786620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000c97e-a3c6-4317-94d7-9256b147655a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:22.788877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000c97e-a3c6-4317-94d7-9256b147655a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:22.790587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081cb7b-ec39-4994-b812-ae737c980b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:22.791209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081cb7b-ec39-4994-b812-ae737c980b44 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:22.791487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081cb7b-ec39-4994-b812-ae737c980b44 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:22.791755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081cb7b-ec39-4994-b812-ae737c980b44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e000c97e-a3c6-4317-94d7-9256b147655a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:33:22.802987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:22.803921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:22.804895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:22.804895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:22.804895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:33:22.804895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:33:22.804895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:33:22.804895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:33:22.804895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:33:22.804895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:33:22.804895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 02:33:22.804895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:22.804895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 552/1096] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 02:33:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:33:22.810404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000c97e-a3c6-4317-94d7-9256b147655a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:22.837993 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:22.856621 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:22.859384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081cb7b-ec39-4994-b812-ae737c980b44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:22.861278 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081cb7b-ec39-4994-b812-ae737c980b44 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:22.909493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000c97e-a3c6-4317-94d7-9256b147655a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:22.942275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7af7ef-b076-4297-ab98-9d500cb99831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:22.942885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af7ef-b076-4297-ab98-9d500cb99831 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:22.943161 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af7ef-b076-4297-ab98-9d500cb99831 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:22.943428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af7ef-b076-4297-ab98-9d500cb99831 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:22.944205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7af7ef-b076-4297-ab98-9d500cb99831 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:22.944505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7af7ef-b076-4297-ab98-9d500cb99831 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:22.945943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7af7ef-b076-4297-ab98-9d500cb99831 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:22.957884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 545/1097] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:33:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 02:33:22.963419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 553/1098] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 02:33:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:22.963891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081cb7b-ec39-4994-b812-ae737c980b44 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:22.968825 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7af7ef-b076-4297-ab98-9d500cb99831 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:23.052830 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:23.058010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:23.061102 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081cb7b-ec39-4994-b812-ae737c980b44 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:23.069515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7af7ef-b076-4297-ab98-9d500cb99831 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:23.095065 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded14a50-00fa-4567-908d-73caf5efd03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:23.095711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded14a50-00fa-4567-908d-73caf5efd03a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:23.095991 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded14a50-00fa-4567-908d-73caf5efd03a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:23.096264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded14a50-00fa-4567-908d-73caf5efd03a None admin] PATH_INFO: `/v3/projects/15cc215116554404bac2356c0e03667b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:23.097454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded14a50-00fa-4567-908d-73caf5efd03a None admin] RBAC: Authorizing `identity:get_project(project_id=15cc215116554404bac2356c0e03667b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:23.098964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded14a50-00fa-4567-908d-73caf5efd03a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:23.101004 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 546/1099] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:33:22 2022] GET /identity/v3/projects/15cc215116554404bac2356c0e03667b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:23.102380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe4b76-ec82-4041-8a67-76b6d7d4dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:23.103000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe4b76-ec82-4041-8a67-76b6d7d4dae0 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:23.103277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe4b76-ec82-4041-8a67-76b6d7d4dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:23.103544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe4b76-ec82-4041-8a67-76b6d7d4dae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:23.106986 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded14a50-00fa-4567-908d-73caf5efd03a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:23.172621 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe4b76-ec82-4041-8a67-76b6d7d4dae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:23.174112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe4b76-ec82-4041-8a67-76b6d7d4dae0 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:23.202200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded14a50-00fa-4567-908d-73caf5efd03a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:23.237088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619607e-c147-4510-959b-60b1d50e8851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:23.237768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619607e-c147-4510-959b-60b1d50e8851 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:23.238043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619607e-c147-4510-959b-60b1d50e8851 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:23.238315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619607e-c147-4510-959b-60b1d50e8851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:23.239093 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619607e-c147-4510-959b-60b1d50e8851 None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=15cc215116554404bac2356c0e03667b, user.id=22fc3488b5b449928e9a2f7ee0abf732) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:23.239399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619607e-c147-4510-959b-60b1d50e8851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:23.240863 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619607e-c147-4510-959b-60b1d50e8851 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:23.246989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 547/1100] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:33:23 2022] GET /identity/v3/role_assignments?user.id=22fc3488b5b449928e9a2f7ee0abf732&scope.project.id=15cc215116554404bac2356c0e03667b&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:23.258702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:23.281145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 554/1101] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:33:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:33:23.282508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619607e-c147-4510-959b-60b1d50e8851 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:23.314710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:23.390703 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619607e-c147-4510-959b-60b1d50e8851 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:23.425710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbe799-62b7-4046-bd2e-c33ece940989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:23.426355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbe799-62b7-4046-bd2e-c33ece940989 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:23.426634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbe799-62b7-4046-bd2e-c33ece940989 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:23.426873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbe799-62b7-4046-bd2e-c33ece940989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:23.437672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbe799-62b7-4046-bd2e-c33ece940989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:23.439133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecbe799-62b7-4046-bd2e-c33ece940989 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-cecbe799-62b7-4046-bd2e-c33ece940989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:33:23.453377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:23.454305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:23.455192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:33:23.455192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:33:23.455192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:33:23.455192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:23.455192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 548/1102] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:23.460721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe4b76-ec82-4041-8a67-76b6d7d4dae0 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:23.561186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe4b76-ec82-4041-8a67-76b6d7d4dae0 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:23.597444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc407a6-c27a-431e-be85-94e7d6494879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:23.597970 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc407a6-c27a-431e-be85-94e7d6494879 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:23.598272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc407a6-c27a-431e-be85-94e7d6494879 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:23.598534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc407a6-c27a-431e-be85-94e7d6494879 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:23.599221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc407a6-c27a-431e-be85-94e7d6494879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:23.599525 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc407a6-c27a-431e-be85-94e7d6494879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:23.601256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc407a6-c27a-431e-be85-94e7d6494879 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:23.615137 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 555/1103] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:23.620839 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbe799-62b7-4046-bd2e-c33ece940989 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:23.705398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:23.725212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbe799-62b7-4046-bd2e-c33ece940989 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:23.760637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac978-e104-498e-af8d-231349872796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:23.761269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac978-e104-498e-af8d-231349872796 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:23.761565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac978-e104-498e-af8d-231349872796 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:23.761830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ac978-e104-498e-af8d-231349872796 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:23.768595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ac978-e104-498e-af8d-231349872796 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:23.770063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ac978-e104-498e-af8d-231349872796 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-6b0ac978-e104-498e-af8d-231349872796 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:33:23.781429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:23.782385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:23.783270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:33:23.783270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:33:23.783270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:33:23.783270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:33:23.783270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:33:23.783270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:33:23.783270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:33:23.783270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:23.785462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 549/1104] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:23.788436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc407a6-c27a-431e-be85-94e7d6494879 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:23.834485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:23.891150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc407a6-c27a-431e-be85-94e7d6494879 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:23.925707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f21b8e-025e-409e-989b-f0111ead8f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:23.926329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f21b8e-025e-409e-989b-f0111ead8f7b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:23.926579 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f21b8e-025e-409e-989b-f0111ead8f7b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:23.926847 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f21b8e-025e-409e-989b-f0111ead8f7b None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:23.927592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f21b8e-025e-409e-989b-f0111ead8f7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:23.927894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f21b8e-025e-409e-989b-f0111ead8f7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:23.929317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f21b8e-025e-409e-989b-f0111ead8f7b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:23.941706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 556/1105] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:23.947780 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac978-e104-498e-af8d-231349872796 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:24.048238 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ac978-e104-498e-af8d-231349872796 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:24.082177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146e56d-9e78-4f7c-80b1-638517705e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:24.082789 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146e56d-9e78-4f7c-80b1-638517705e01 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:24.083067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146e56d-9e78-4f7c-80b1-638517705e01 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:24.083332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146e56d-9e78-4f7c-80b1-638517705e01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:24.084114 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146e56d-9e78-4f7c-80b1-638517705e01 None admin] RBAC: Adding query filter params (role.id=ad2dba59bed14bb1b37cab7b9d4ef96d, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=338b2744014940ca96c08d4e9262697b) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:24.084421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146e56d-9e78-4f7c-80b1-638517705e01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:24.085894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146e56d-9e78-4f7c-80b1-638517705e01 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:24.091804 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 550/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:33:23 2022] GET /identity/v3/role_assignments?user.id=338b2744014940ca96c08d4e9262697b&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=ad2dba59bed14bb1b37cab7b9d4ef96d => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:25.261092 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0001b0-61c1-45e6-8c3a-717952567087 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:25.261779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0001b0-61c1-45e6-8c3a-717952567087 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:25.261779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0001b0-61c1-45e6-8c3a-717952567087 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:25.263792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 557/1107] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:25.272645 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea405451-3f1b-413e-88ff-5fedc3534a49 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:25.273041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea405451-3f1b-413e-88ff-5fedc3534a49 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:25.273252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea405451-3f1b-413e-88ff-5fedc3534a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:25.287742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:25.293396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ea405451-3f1b-413e-88ff-5fedc3534a49 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:25.294595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ea405451-3f1b-413e-88ff-5fedc3534a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:25.365195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 551/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:25.390232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0001b0-61c1-45e6-8c3a-717952567087 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:25.501502 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0001b0-61c1-45e6-8c3a-717952567087 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:25.503825 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:25.546790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093d43f-c553-4642-b119-063dbde6c8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:25.547349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093d43f-c553-4642-b119-063dbde6c8fa None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:25.547623 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093d43f-c553-4642-b119-063dbde6c8fa None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:25.547885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093d43f-c553-4642-b119-063dbde6c8fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:25.549156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093d43f-c553-4642-b119-063dbde6c8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:25.550631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093d43f-c553-4642-b119-063dbde6c8fa None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:25.552208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 558/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:25.558431 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea405451-3f1b-413e-88ff-5fedc3534a49 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:25.661585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea405451-3f1b-413e-88ff-5fedc3534a49 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:25.696277 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0839e-7947-47a0-b6d4-0a5b8d59d35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:25.696936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0839e-7947-47a0-b6d4-0a5b8d59d35e None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:25.697213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0839e-7947-47a0-b6d4-0a5b8d59d35e None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:25.697510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0839e-7947-47a0-b6d4-0a5b8d59d35e None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:25.698212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0839e-7947-47a0-b6d4-0a5b8d59d35e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:25.699650 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0839e-7947-47a0-b6d4-0a5b8d59d35e None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:25.708467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:25.723812 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 552/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:33:25 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:33:27.706427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f45a5-d61b-4bea-9250-45096aed1a2a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:27.707284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f45a5-d61b-4bea-9250-45096aed1a2a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:27.707284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f45a5-d61b-4bea-9250-45096aed1a2a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:27.709531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 559/1111] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:27.717253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec5bb7-8005-46cf-ab3a-e6a4f7a7157b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:27.717679 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec5bb7-8005-46cf-ab3a-e6a4f7a7157b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:27.717852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec5bb7-8005-46cf-ab3a-e6a4f7a7157b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:27.746291 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-98ec5bb7-8005-46cf-ab3a-e6a4f7a7157b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:27.747483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-98ec5bb7-8005-46cf-ab3a-e6a4f7a7157b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:27.827050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 553/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:27.850595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f45a5-d61b-4bea-9250-45096aed1a2a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:27.954932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f45a5-d61b-4bea-9250-45096aed1a2a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:27.990347 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e783a-0664-4108-a753-e1a1cebab2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:27.990969 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e783a-0664-4108-a753-e1a1cebab2de None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:27.991241 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e783a-0664-4108-a753-e1a1cebab2de None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:27.991508 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e783a-0664-4108-a753-e1a1cebab2de None admin] PATH_INFO: `/v3/roles/506da913e25f44b1854b24215eb447fc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:27.993061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e783a-0664-4108-a753-e1a1cebab2de None admin] RBAC: Authorizing `identity:get_role(role_id=506da913e25f44b1854b24215eb447fc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:27.994514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e783a-0664-4108-a753-e1a1cebab2de None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:27.995837 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 560/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:33:27 2022] GET /identity/v3/roles/506da913e25f44b1854b24215eb447fc => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:28.002591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec5bb7-8005-46cf-ab3a-e6a4f7a7157b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:28.109203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec5bb7-8005-46cf-ab3a-e6a4f7a7157b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:28.134427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:28.148477 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2386a1f-d876-479b-8d0c-bc75bf0ae318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:28.149110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2386a1f-d876-479b-8d0c-bc75bf0ae318 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:28.149410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2386a1f-d876-479b-8d0c-bc75bf0ae318 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:28.149677 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2386a1f-d876-479b-8d0c-bc75bf0ae318 None admin] PATH_INFO: `/v3/users/b84bd28eb73941288328c941c4a95923` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:28.162816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2386a1f-d876-479b-8d0c-bc75bf0ae318 None admin] RBAC: Authorizing `identity:get_user(user_id=b84bd28eb73941288328c941c4a95923)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:28.164267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2386a1f-d876-479b-8d0c-bc75bf0ae318 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:28.165996 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 554/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:33:28 2022] GET /identity/v3/users/b84bd28eb73941288328c941c4a95923 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:28.172090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e783a-0664-4108-a753-e1a1cebab2de None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:28.217109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:28.276274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e783a-0664-4108-a753-e1a1cebab2de None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:28.315158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59554e5f-1d00-404a-972d-08cc978bd143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:28.315764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59554e5f-1d00-404a-972d-08cc978bd143 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:28.316045 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59554e5f-1d00-404a-972d-08cc978bd143 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:28.316316 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59554e5f-1d00-404a-972d-08cc978bd143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:28.386422 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59554e5f-1d00-404a-972d-08cc978bd143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:28.387878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59554e5f-1d00-404a-972d-08cc978bd143 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:28.428701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:28.491815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 561/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:33:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:33:28.501346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2386a1f-d876-479b-8d0c-bc75bf0ae318 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:28.610612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2386a1f-d876-479b-8d0c-bc75bf0ae318 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:28.651456 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de380b38-941c-495f-9f56-791bf4e20dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:28.652093 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de380b38-941c-495f-9f56-791bf4e20dd9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:28.652373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de380b38-941c-495f-9f56-791bf4e20dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:28.652639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de380b38-941c-495f-9f56-791bf4e20dd9 None admin] PATH_INFO: `/v3/projects/15cc215116554404bac2356c0e03667b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:28.653877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de380b38-941c-495f-9f56-791bf4e20dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=15cc215116554404bac2356c0e03667b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:28.655315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de380b38-941c-495f-9f56-791bf4e20dd9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:28.656974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 555/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:33:28 2022] GET /identity/v3/projects/15cc215116554404bac2356c0e03667b => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:28.663407 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59554e5f-1d00-404a-972d-08cc978bd143 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:28.768824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59554e5f-1d00-404a-972d-08cc978bd143 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:28.804204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44389e4-ea08-4fa3-af75-7c5245f46656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:28.804803 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44389e4-ea08-4fa3-af75-7c5245f46656 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:28.805082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44389e4-ea08-4fa3-af75-7c5245f46656 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:28.805381 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44389e4-ea08-4fa3-af75-7c5245f46656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:28.806193 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44389e4-ea08-4fa3-af75-7c5245f46656 None admin] RBAC: Adding query filter params (role.id=506da913e25f44b1854b24215eb447fc, scope.project.id=15cc215116554404bac2356c0e03667b, user.id=b84bd28eb73941288328c941c4a95923) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:28.806502 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44389e4-ea08-4fa3-af75-7c5245f46656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:28.807929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44389e4-ea08-4fa3-af75-7c5245f46656 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:28.813433 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 562/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:33:28 2022] GET /identity/v3/role_assignments?user.id=b84bd28eb73941288328c941c4a95923&scope.project.id=15cc215116554404bac2356c0e03667b&role.id=506da913e25f44b1854b24215eb447fc => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:30.751653 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362675a-163d-412b-94b7-47b46ac753bd None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:30.752267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362675a-163d-412b-94b7-47b46ac753bd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:30.752267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362675a-163d-412b-94b7-47b46ac753bd None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:30.753575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 556/1118] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:30.760014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b627541-00fd-4232-87a9-44217b91688b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:30.760745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b627541-00fd-4232-87a9-44217b91688b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:30.760914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b627541-00fd-4232-87a9-44217b91688b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:30.773409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:30.785560 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5b627541-00fd-4232-87a9-44217b91688b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:30.786768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5b627541-00fd-4232-87a9-44217b91688b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:30.856708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 563/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:30.878800 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362675a-163d-412b-94b7-47b46ac753bd None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:30.932889 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:30.991842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362675a-163d-412b-94b7-47b46ac753bd None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:31.026835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937ff7c-5765-4524-b3a1-16261e8efa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:31.027465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937ff7c-5765-4524-b3a1-16261e8efa1c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:31.027739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937ff7c-5765-4524-b3a1-16261e8efa1c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:31.028006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937ff7c-5765-4524-b3a1-16261e8efa1c None admin] PATH_INFO: `/v3/roles/506da913e25f44b1854b24215eb447fc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:31.030462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937ff7c-5765-4524-b3a1-16261e8efa1c None admin] RBAC: Authorizing `identity:get_role(role_id=506da913e25f44b1854b24215eb447fc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:31.032617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937ff7c-5765-4524-b3a1-16261e8efa1c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:31.034864 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 557/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:33:30 2022] GET /identity/v3/roles/506da913e25f44b1854b24215eb447fc => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:31.041176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b627541-00fd-4232-87a9-44217b91688b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:31.138843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b627541-00fd-4232-87a9-44217b91688b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:31.173850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e322f6e-b07e-43cc-8890-37617616a404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:31.174475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e322f6e-b07e-43cc-8890-37617616a404 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:31.174753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e322f6e-b07e-43cc-8890-37617616a404 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:31.175021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e322f6e-b07e-43cc-8890-37617616a404 None admin] PATH_INFO: `/v3/users/b84bd28eb73941288328c941c4a95923` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:31.176301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e322f6e-b07e-43cc-8890-37617616a404 None admin] RBAC: Authorizing `identity:get_user(user_id=b84bd28eb73941288328c941c4a95923)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:31.177760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e322f6e-b07e-43cc-8890-37617616a404 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:31.179377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 564/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:33:31 2022] GET /identity/v3/users/b84bd28eb73941288328c941c4a95923 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:31.186148 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937ff7c-5765-4524-b3a1-16261e8efa1c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:31.309159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937ff7c-5765-4524-b3a1-16261e8efa1c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:31.326399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:31.347051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89536afd-0a14-416d-8005-382df269ee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:31.347951 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89536afd-0a14-416d-8005-382df269ee31 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:31.348329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89536afd-0a14-416d-8005-382df269ee31 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:31.348704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89536afd-0a14-416d-8005-382df269ee31 None admin] PATH_INFO: `/v3/projects/15cc215116554404bac2356c0e03667b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:31.350995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89536afd-0a14-416d-8005-382df269ee31 None admin] RBAC: Authorizing `identity:get_project(project_id=15cc215116554404bac2356c0e03667b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:31.353509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89536afd-0a14-416d-8005-382df269ee31 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:31.356034 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 558/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:33:31 2022] GET /identity/v3/projects/15cc215116554404bac2356c0e03667b => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:31.365017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e322f6e-b07e-43cc-8890-37617616a404 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:31.368084 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:31.485524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e322f6e-b07e-43cc-8890-37617616a404 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:31.521482 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c16b64-982a-4851-8df6-1266b28da9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:31.522149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16b64-982a-4851-8df6-1266b28da9c2 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:31.522426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16b64-982a-4851-8df6-1266b28da9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:31.522699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c16b64-982a-4851-8df6-1266b28da9c2 None admin] PATH_INFO: `/v3/projects/15cc215116554404bac2356c0e03667b/users/b84bd28eb73941288328c941c4a95923/roles/506da913e25f44b1854b24215eb447fc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:31.525256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16b64-982a-4851-8df6-1266b28da9c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=15cc215116554404bac2356c0e03667b, user_id=b84bd28eb73941288328c941c4a95923, role_id=506da913e25f44b1854b24215eb447fc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:31.526711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c16b64-982a-4851-8df6-1266b28da9c2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:31.541515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 565/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:33:31 2022] PUT /identity/v3/projects/15cc215116554404bac2356c0e03667b/users/b84bd28eb73941288328c941c4a95923/roles/506da913e25f44b1854b24215eb447fc => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:33:33.507335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58acf2-b1e3-436e-9fda-7a36b3eda218 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:33.507959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58acf2-b1e3-436e-9fda-7a36b3eda218 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:33.507959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58acf2-b1e3-436e-9fda-7a36b3eda218 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:33.509309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 559/1124] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:33.515758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e337f4-7c49-42a9-97bb-686a0a9a175a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:33.516427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e337f4-7c49-42a9-97bb-686a0a9a175a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:33.516618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e337f4-7c49-42a9-97bb-686a0a9a175a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:33.538649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-71e337f4-7c49-42a9-97bb-686a0a9a175a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:33.539831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-71e337f4-7c49-42a9-97bb-686a0a9a175a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:33.598136 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:33.609598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 566/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:33.632920 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58acf2-b1e3-436e-9fda-7a36b3eda218 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:33.738849 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58acf2-b1e3-436e-9fda-7a36b3eda218 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:33.773560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b88a7-2fd2-49dd-a9c2-61ba0d63de3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:33.774115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b88a7-2fd2-49dd-a9c2-61ba0d63de3f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:33.774448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b88a7-2fd2-49dd-a9c2-61ba0d63de3f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:33.774705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b88a7-2fd2-49dd-a9c2-61ba0d63de3f None admin] PATH_INFO: `/v3/roles/506da913e25f44b1854b24215eb447fc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:33.776167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b88a7-2fd2-49dd-a9c2-61ba0d63de3f None admin] RBAC: Authorizing `identity:get_role(role_id=506da913e25f44b1854b24215eb447fc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:33.777567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b88a7-2fd2-49dd-a9c2-61ba0d63de3f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:33.778888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 560/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:33:33 2022] GET /identity/v3/roles/506da913e25f44b1854b24215eb447fc => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:33.784908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e337f4-7c49-42a9-97bb-686a0a9a175a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:33.884534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e337f4-7c49-42a9-97bb-686a0a9a175a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:33.924046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faca98-153f-4107-83a1-9a82a4519e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:33.924673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faca98-153f-4107-83a1-9a82a4519e50 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:33.924951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faca98-153f-4107-83a1-9a82a4519e50 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:33.925227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faca98-153f-4107-83a1-9a82a4519e50 None admin] PATH_INFO: `/v3/users/b84bd28eb73941288328c941c4a95923` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:33.926542 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faca98-153f-4107-83a1-9a82a4519e50 None admin] RBAC: Authorizing `identity:get_user(user_id=b84bd28eb73941288328c941c4a95923)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:33.927999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faca98-153f-4107-83a1-9a82a4519e50 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:33.929646 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 567/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:33:33 2022] GET /identity/v3/users/b84bd28eb73941288328c941c4a95923 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:33.935540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b88a7-2fd2-49dd-a9c2-61ba0d63de3f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:33.991590 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:34.049851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b88a7-2fd2-49dd-a9c2-61ba0d63de3f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:34.091172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2286c1-c4ff-420b-8cb4-acdda8013cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:34.091797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2286c1-c4ff-420b-8cb4-acdda8013cd5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:34.092080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2286c1-c4ff-420b-8cb4-acdda8013cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:34.092356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2286c1-c4ff-420b-8cb4-acdda8013cd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:34.162350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2286c1-c4ff-420b-8cb4-acdda8013cd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:34.163797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2286c1-c4ff-420b-8cb4-acdda8013cd5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:34.214376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:34.272426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 561/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:33:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:33:34.279540 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faca98-153f-4107-83a1-9a82a4519e50 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:34.348520 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:34.391181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faca98-153f-4107-83a1-9a82a4519e50 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:34.426301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2dfc32-9cb8-4485-a9bf-0755668f218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:34.427054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dfc32-9cb8-4485-a9bf-0755668f218b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:34.427338 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dfc32-9cb8-4485-a9bf-0755668f218b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:34.427611 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dfc32-9cb8-4485-a9bf-0755668f218b None admin] PATH_INFO: `/v3/projects/15cc215116554404bac2356c0e03667b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:34.428888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2dfc32-9cb8-4485-a9bf-0755668f218b None admin] RBAC: Authorizing `identity:get_project(project_id=15cc215116554404bac2356c0e03667b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:34.430353 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2dfc32-9cb8-4485-a9bf-0755668f218b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:34.432087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 568/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:33:34 2022] GET /identity/v3/projects/15cc215116554404bac2356c0e03667b => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:34.439493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2286c1-c4ff-420b-8cb4-acdda8013cd5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:34.558777 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2286c1-c4ff-420b-8cb4-acdda8013cd5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:34.596044 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83edae6-c836-43de-aaad-0a4de98abfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:34.596922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83edae6-c836-43de-aaad-0a4de98abfca None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:34.597351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83edae6-c836-43de-aaad-0a4de98abfca None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:34.597703 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83edae6-c836-43de-aaad-0a4de98abfca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:34.599008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83edae6-c836-43de-aaad-0a4de98abfca None admin] RBAC: Adding query filter params (role.id=506da913e25f44b1854b24215eb447fc, scope.project.id=15cc215116554404bac2356c0e03667b, user.id=b84bd28eb73941288328c941c4a95923) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:34.599333 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83edae6-c836-43de-aaad-0a4de98abfca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:34.602042 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83edae6-c836-43de-aaad-0a4de98abfca None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:34.614659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 562/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:33:34 2022] GET /identity/v3/role_assignments?user.id=b84bd28eb73941288328c941c4a95923&scope.project.id=15cc215116554404bac2356c0e03667b&role.id=506da913e25f44b1854b24215eb447fc => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:36.613092 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad10c6e-f4d4-4795-9aa6-89a50f5d72e8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:36.613726 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad10c6e-f4d4-4795-9aa6-89a50f5d72e8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:36.613726 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad10c6e-f4d4-4795-9aa6-89a50f5d72e8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:36.615042 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 569/1131] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:36.620674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde1d67-62ab-494b-9b2c-829d2611e1b6 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:36.621104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde1d67-62ab-494b-9b2c-829d2611e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:36.621213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde1d67-62ab-494b-9b2c-829d2611e1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:36.641500 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-dfde1d67-62ab-494b-9b2c-829d2611e1b6 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:36.642704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-dfde1d67-62ab-494b-9b2c-829d2611e1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:36.655770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:36.720555 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 563/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:36.743894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad10c6e-f4d4-4795-9aa6-89a50f5d72e8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:36.851422 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad10c6e-f4d4-4795-9aa6-89a50f5d72e8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:36.877900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:36.886398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662b236-8d09-46c7-8874-bf828e85535e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:36.887026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b236-8d09-46c7-8874-bf828e85535e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:36.887295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b236-8d09-46c7-8874-bf828e85535e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:36.887562 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b236-8d09-46c7-8874-bf828e85535e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:36.888689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662b236-8d09-46c7-8874-bf828e85535e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:36.890135 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662b236-8d09-46c7-8874-bf828e85535e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:36.891717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 570/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:36.897874 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde1d67-62ab-494b-9b2c-829d2611e1b6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:37.001621 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde1d67-62ab-494b-9b2c-829d2611e1b6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:37.037395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bcad0-a2e4-42e8-a395-f9638d47cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:37.038013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bcad0-a2e4-42e8-a395-f9638d47cae9 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:37.038292 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bcad0-a2e4-42e8-a395-f9638d47cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:37.038565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bcad0-a2e4-42e8-a395-f9638d47cae9 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:37.039245 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bcad0-a2e4-42e8-a395-f9638d47cae9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:37.040767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0bcad0-a2e4-42e8-a395-f9638d47cae9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:37.063296 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:37.070767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 564/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:33:36 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:33:39.081477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f962a-c8a9-4162-bd61-6907ca84d82a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:39.082351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f962a-c8a9-4162-bd61-6907ca84d82a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:39.082351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f962a-c8a9-4162-bd61-6907ca84d82a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:39.084415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 571/1135] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:39.090767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e3ffb-493a-4e5d-aafa-13c05ecc9e8c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:39.091220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e3ffb-493a-4e5d-aafa-13c05ecc9e8c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:39.091327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e3ffb-493a-4e5d-aafa-13c05ecc9e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:39.120779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c56e3ffb-493a-4e5d-aafa-13c05ecc9e8c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:39.121989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c56e3ffb-493a-4e5d-aafa-13c05ecc9e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:39.189197 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 565/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:39.214495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f962a-c8a9-4162-bd61-6907ca84d82a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:39.332281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f962a-c8a9-4162-bd61-6907ca84d82a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:39.370618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae911fb-aa2f-4204-89ce-636d2bcfd27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:39.371253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae911fb-aa2f-4204-89ce-636d2bcfd27f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:39.371527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae911fb-aa2f-4204-89ce-636d2bcfd27f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:39.371795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae911fb-aa2f-4204-89ce-636d2bcfd27f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:39.373069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae911fb-aa2f-4204-89ce-636d2bcfd27f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:39.374536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae911fb-aa2f-4204-89ce-636d2bcfd27f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:39.376160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 572/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:33:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:39.382773 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e3ffb-493a-4e5d-aafa-13c05ecc9e8c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:39.488373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e3ffb-493a-4e5d-aafa-13c05ecc9e8c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:39.525039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:39.534306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c252b-596d-4e68-9197-c93df5cf2d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:39.534923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c252b-596d-4e68-9197-c93df5cf2d1a None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:39.535207 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c252b-596d-4e68-9197-c93df5cf2d1a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:39.535480 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c252b-596d-4e68-9197-c93df5cf2d1a None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:39.536165 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c252b-596d-4e68-9197-c93df5cf2d1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:39.537634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c252b-596d-4e68-9197-c93df5cf2d1a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:39.562988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 566/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:33:39 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:33:41.575664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a031-e0e2-4b0d-b211-a4b8364f18f5 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:41.576565 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a031-e0e2-4b0d-b211-a4b8364f18f5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:41.576565 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1a031-e0e2-4b0d-b211-a4b8364f18f5 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:41.578735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 573/1139] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:41.587575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b5be5-ffa5-42fd-9df8-2f1667d935e3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:41.588325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b5be5-ffa5-42fd-9df8-2f1667d935e3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:41.588487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b5be5-ffa5-42fd-9df8-2f1667d935e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:41.613435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f40b5be5-ffa5-42fd-9df8-2f1667d935e3 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:41.614646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f40b5be5-ffa5-42fd-9df8-2f1667d935e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:41.684076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 567/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:41.707402 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1a031-e0e2-4b0d-b211-a4b8364f18f5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:41.777469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:41.816865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1a031-e0e2-4b0d-b211-a4b8364f18f5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:41.852455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95add72-64e8-4906-ae2e-3ca442902675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:41.853011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95add72-64e8-4906-ae2e-3ca442902675 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:41.853329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95add72-64e8-4906-ae2e-3ca442902675 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:41.853616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95add72-64e8-4906-ae2e-3ca442902675 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:41.863907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95add72-64e8-4906-ae2e-3ca442902675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-e95add72-64e8-4906-ae2e-3ca442902675 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:33:41.868921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:41.870075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:41.870983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:41.870983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:41.870983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:41.870983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:41.870983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:33:41.870983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:33:41.870983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:33:41.870983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:33:41.870983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:33:41.870983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:33:41.870983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:33:41.870983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:41.870983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 574/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:33:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:41.878770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b5be5-ffa5-42fd-9df8-2f1667d935e3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:41.986414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b5be5-ffa5-42fd-9df8-2f1667d935e3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:42.000367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:42.021794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7d17c-925b-4c30-9890-787da7d6ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:42.022406 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d17c-925b-4c30-9890-787da7d6ce00 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:42.022690 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d17c-925b-4c30-9890-787da7d6ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:42.022962 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d17c-925b-4c30-9890-787da7d6ce00 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:42.023682 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7d17c-925b-4c30-9890-787da7d6ce00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:42.023986 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7d17c-925b-4c30-9890-787da7d6ce00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:42.025399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7d17c-925b-4c30-9890-787da7d6ce00 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:42.033719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 568/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:33:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:42.039661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95add72-64e8-4906-ae2e-3ca442902675 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:42.144955 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95add72-64e8-4906-ae2e-3ca442902675 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:42.168536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:42.180959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc625d-dbf8-4e25-883c-b809006f6168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:42.181627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc625d-dbf8-4e25-883c-b809006f6168 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:42.181902 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc625d-dbf8-4e25-883c-b809006f6168 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:42.182169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc625d-dbf8-4e25-883c-b809006f6168 None admin] PATH_INFO: `/v3/users/44be6441ef434e158bb0baa12d16595a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:42.197548 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc625d-dbf8-4e25-883c-b809006f6168 None admin] RBAC: Authorizing `identity:get_user(user_id=44be6441ef434e158bb0baa12d16595a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:42.199090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc625d-dbf8-4e25-883c-b809006f6168 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:42.200701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 575/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:33:42 2022] GET /identity/v3/users/44be6441ef434e158bb0baa12d16595a => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:42.207396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7d17c-925b-4c30-9890-787da7d6ce00 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:42.316162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7d17c-925b-4c30-9890-787da7d6ce00 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:42.351072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61801b-dc96-4496-b8cb-8bdb1898c7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:42.351736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61801b-dc96-4496-b8cb-8bdb1898c7ca None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:42.352082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61801b-dc96-4496-b8cb-8bdb1898c7ca None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:42.352447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61801b-dc96-4496-b8cb-8bdb1898c7ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:42.397351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:42.428984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61801b-dc96-4496-b8cb-8bdb1898c7ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:42.430494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61801b-dc96-4496-b8cb-8bdb1898c7ca None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:42.531155 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 569/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:33:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:33:42.538101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc625d-dbf8-4e25-883c-b809006f6168 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:42.647040 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc625d-dbf8-4e25-883c-b809006f6168 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:42.681444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5458a-c8e5-4374-9525-fb65617d186b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:42.682000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5458a-c8e5-4374-9525-fb65617d186b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:42.682273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5458a-c8e5-4374-9525-fb65617d186b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:42.682536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5458a-c8e5-4374-9525-fb65617d186b None admin] PATH_INFO: `/v3/projects/5e7764ee1d0d4522b5287add02797641` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:42.683745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5458a-c8e5-4374-9525-fb65617d186b None admin] RBAC: Authorizing `identity:get_project(project_id=5e7764ee1d0d4522b5287add02797641)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:42.685165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5458a-c8e5-4374-9525-fb65617d186b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:42.686842 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 576/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:33:42 2022] GET /identity/v3/projects/5e7764ee1d0d4522b5287add02797641 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:42.696964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61801b-dc96-4496-b8cb-8bdb1898c7ca None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:42.788191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:42.812020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61801b-dc96-4496-b8cb-8bdb1898c7ca None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:42.846877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27fea8-cd89-4699-9326-c0db3b350025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:42.847482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27fea8-cd89-4699-9326-c0db3b350025 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:42.847765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27fea8-cd89-4699-9326-c0db3b350025 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:42.848035 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27fea8-cd89-4699-9326-c0db3b350025 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:42.848818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27fea8-cd89-4699-9326-c0db3b350025 None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=5e7764ee1d0d4522b5287add02797641, user.id=44be6441ef434e158bb0baa12d16595a) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:42.849490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27fea8-cd89-4699-9326-c0db3b350025 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:42.850950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27fea8-cd89-4699-9326-c0db3b350025 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:42.856430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 570/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:33:42 2022] GET /identity/v3/role_assignments?user.id=44be6441ef434e158bb0baa12d16595a&scope.project.id=5e7764ee1d0d4522b5287add02797641&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:44.823347 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed6c44-31e3-4293-ae67-0d39a6696b01 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:44.824218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed6c44-31e3-4293-ae67-0d39a6696b01 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:44.824218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed6c44-31e3-4293-ae67-0d39a6696b01 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:44.826454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 577/1147] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:44.835158 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265d90c-fa90-43a3-b798-b23b50d30b37 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:44.835582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265d90c-fa90-43a3-b798-b23b50d30b37 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:44.835726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265d90c-fa90-43a3-b798-b23b50d30b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:44.857825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d265d90c-fa90-43a3-b798-b23b50d30b37 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:44.859023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d265d90c-fa90-43a3-b798-b23b50d30b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:44.931849 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 571/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:44.954655 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed6c44-31e3-4293-ae67-0d39a6696b01 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:45.016845 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:45.073945 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed6c44-31e3-4293-ae67-0d39a6696b01 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:45.109614 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cbe85-68d8-4218-8753-4360136caa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:45.110240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cbe85-68d8-4218-8753-4360136caa3a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:45.110515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cbe85-68d8-4218-8753-4360136caa3a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:45.110788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cbe85-68d8-4218-8753-4360136caa3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:45.121570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cbe85-68d8-4218-8753-4360136caa3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b98cbe85-68d8-4218-8753-4360136caa3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:33:45.126462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:45.127511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:45.128479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:45.128479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:45.128479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:45.128479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:45.128479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:33:45.128479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:33:45.128479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:33:45.128479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:33:45.128479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:33:45.128479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:33:45.128479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:33:45.128479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:45.132507 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 578/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:33:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:45.133714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265d90c-fa90-43a3-b798-b23b50d30b37 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:45.207999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:45.241573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265d90c-fa90-43a3-b798-b23b50d30b37 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:45.281958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75460b3-e89d-4dcb-bbcd-bfbe732e04be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:45.282831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75460b3-e89d-4dcb-bbcd-bfbe732e04be None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:45.283204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75460b3-e89d-4dcb-bbcd-bfbe732e04be None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:45.283569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75460b3-e89d-4dcb-bbcd-bfbe732e04be None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:45.284642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75460b3-e89d-4dcb-bbcd-bfbe732e04be None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:45.285032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75460b3-e89d-4dcb-bbcd-bfbe732e04be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:45.287217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75460b3-e89d-4dcb-bbcd-bfbe732e04be None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:45.297894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 572/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:33:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:33:45.303857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cbe85-68d8-4218-8753-4360136caa3a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:45.409158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cbe85-68d8-4218-8753-4360136caa3a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:45.419863 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:45.455725 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c7979-489d-464d-b059-60ec22cb7e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:45.456349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c7979-489d-464d-b059-60ec22cb7e19 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:45.456625 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c7979-489d-464d-b059-60ec22cb7e19 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:45.456897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c7979-489d-464d-b059-60ec22cb7e19 None admin] PATH_INFO: `/v3/users/44be6441ef434e158bb0baa12d16595a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:45.458151 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c7979-489d-464d-b059-60ec22cb7e19 None admin] RBAC: Authorizing `identity:get_user(user_id=44be6441ef434e158bb0baa12d16595a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:45.459515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c7979-489d-464d-b059-60ec22cb7e19 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:45.461108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 579/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:33:45 2022] GET /identity/v3/users/44be6441ef434e158bb0baa12d16595a => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:45.467648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75460b3-e89d-4dcb-bbcd-bfbe732e04be None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:45.597212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75460b3-e89d-4dcb-bbcd-bfbe732e04be None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:45.628654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:45.635000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2efd3-1584-4bef-82af-b72a0db17670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:45.635662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2efd3-1584-4bef-82af-b72a0db17670 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:45.635943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2efd3-1584-4bef-82af-b72a0db17670 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:45.636209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2efd3-1584-4bef-82af-b72a0db17670 None admin] PATH_INFO: `/v3/projects/5e7764ee1d0d4522b5287add02797641` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:45.637470 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2efd3-1584-4bef-82af-b72a0db17670 None admin] RBAC: Authorizing `identity:get_project(project_id=5e7764ee1d0d4522b5287add02797641)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:45.638928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2efd3-1584-4bef-82af-b72a0db17670 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:45.640601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 573/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:33:45 2022] GET /identity/v3/projects/5e7764ee1d0d4522b5287add02797641 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:45.646967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c7979-489d-464d-b059-60ec22cb7e19 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:45.756748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c7979-489d-464d-b059-60ec22cb7e19 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:45.801427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3d775-17f7-4560-8121-61feb15290b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:45.802091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3d775-17f7-4560-8121-61feb15290b9 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:45.802370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3d775-17f7-4560-8121-61feb15290b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:45.802644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3d775-17f7-4560-8121-61feb15290b9 None admin] PATH_INFO: `/v3/projects/5e7764ee1d0d4522b5287add02797641/users/44be6441ef434e158bb0baa12d16595a/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:45.804861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3d775-17f7-4560-8121-61feb15290b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e7764ee1d0d4522b5287add02797641, user_id=44be6441ef434e158bb0baa12d16595a, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:45.806325 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3d775-17f7-4560-8121-61feb15290b9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:45.821688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 580/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:33:45 2022] PUT /identity/v3/projects/5e7764ee1d0d4522b5287add02797641/users/44be6441ef434e158bb0baa12d16595a/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:33:47.789565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb2236-2ba4-4115-ae43-724d1143b977 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:47.790395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb2236-2ba4-4115-ae43-724d1143b977 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:47.790395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb2236-2ba4-4115-ae43-724d1143b977 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:47.792637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 574/1154] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:47.801431 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38f66d-afd0-4a07-8555-c2ad5740dc41 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:47.801870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38f66d-afd0-4a07-8555-c2ad5740dc41 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:47.802018 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38f66d-afd0-4a07-8555-c2ad5740dc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:47.823107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-eb38f66d-afd0-4a07-8555-c2ad5740dc41 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:47.824302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eb38f66d-afd0-4a07-8555-c2ad5740dc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:47.855115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:47.894785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 581/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:47.918076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb2236-2ba4-4115-ae43-724d1143b977 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:48.031124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bb2236-2ba4-4115-ae43-724d1143b977 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:48.066365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39310813-16a3-4507-b326-83a14e4c9f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:48.066987 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39310813-16a3-4507-b326-83a14e4c9f7c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:48.067266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39310813-16a3-4507-b326-83a14e4c9f7c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:48.067537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39310813-16a3-4507-b326-83a14e4c9f7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:48.078469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39310813-16a3-4507-b326-83a14e4c9f7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-39310813-16a3-4507-b326-83a14e4c9f7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:33:48.083377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:48.084482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:48.085411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:48.085411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:48.085411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:48.085411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:48.085411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:33:48.085411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:33:48.085411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:33:48.085411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:33:48.085411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:33:48.085411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:33:48.085411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:33:48.085411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:33:48.085411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 575/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:33:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:48.092421 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38f66d-afd0-4a07-8555-c2ad5740dc41 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:48.191941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38f66d-afd0-4a07-8555-c2ad5740dc41 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:48.228187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74571e-0a4d-43cf-8779-bda2bb1066d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:48.228799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74571e-0a4d-43cf-8779-bda2bb1066d6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:48.229076 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74571e-0a4d-43cf-8779-bda2bb1066d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:48.229388 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74571e-0a4d-43cf-8779-bda2bb1066d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:48.230148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74571e-0a4d-43cf-8779-bda2bb1066d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:48.230453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74571e-0a4d-43cf-8779-bda2bb1066d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:48.231852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74571e-0a4d-43cf-8779-bda2bb1066d6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:48.239987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 582/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:33:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:48.246065 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39310813-16a3-4507-b326-83a14e4c9f7c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:48.306391 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:48.349725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39310813-16a3-4507-b326-83a14e4c9f7c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:48.385905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d242b-7373-42f8-acc7-03e167bcc8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:48.386623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d242b-7373-42f8-acc7-03e167bcc8d8 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:48.386938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d242b-7373-42f8-acc7-03e167bcc8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:48.387295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d242b-7373-42f8-acc7-03e167bcc8d8 None admin] PATH_INFO: `/v3/users/44be6441ef434e158bb0baa12d16595a` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:48.389336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d242b-7373-42f8-acc7-03e167bcc8d8 None admin] RBAC: Authorizing `identity:get_user(user_id=44be6441ef434e158bb0baa12d16595a)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:48.391513 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d242b-7373-42f8-acc7-03e167bcc8d8 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:48.393139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 576/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:33:48 2022] GET /identity/v3/users/44be6441ef434e158bb0baa12d16595a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:48.400735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74571e-0a4d-43cf-8779-bda2bb1066d6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:48.436837 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:48.514874 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74571e-0a4d-43cf-8779-bda2bb1066d6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:48.550740 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c735ff4-9e7c-4c5f-8383-ec0558e461e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:48.551351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c735ff4-9e7c-4c5f-8383-ec0558e461e4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:48.551626 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c735ff4-9e7c-4c5f-8383-ec0558e461e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:48.551898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c735ff4-9e7c-4c5f-8383-ec0558e461e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:48.623219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c735ff4-9e7c-4c5f-8383-ec0558e461e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:48.624671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c735ff4-9e7c-4c5f-8383-ec0558e461e4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:48.661890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:48.732769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 583/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:33:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:33:48.739253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d242b-7373-42f8-acc7-03e167bcc8d8 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:48.844948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d242b-7373-42f8-acc7-03e167bcc8d8 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:48.872573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:48.881869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c242dc-4c0a-47bd-ab1f-8cfb89adf3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:48.882506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c242dc-4c0a-47bd-ab1f-8cfb89adf3da None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:48.882787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c242dc-4c0a-47bd-ab1f-8cfb89adf3da None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:48.883059 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c242dc-4c0a-47bd-ab1f-8cfb89adf3da None admin] PATH_INFO: `/v3/projects/5e7764ee1d0d4522b5287add02797641` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:48.884270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c242dc-4c0a-47bd-ab1f-8cfb89adf3da None admin] RBAC: Authorizing `identity:get_project(project_id=5e7764ee1d0d4522b5287add02797641)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:48.885757 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c242dc-4c0a-47bd-ab1f-8cfb89adf3da None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:48.887503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 577/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:33:48 2022] GET /identity/v3/projects/5e7764ee1d0d4522b5287add02797641 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:48.894536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c735ff4-9e7c-4c5f-8383-ec0558e461e4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:49.002091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c735ff4-9e7c-4c5f-8383-ec0558e461e4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:49.030984 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:49.037535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba8851-7c90-4b19-a8da-8ad3f73f3f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:49.038141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba8851-7c90-4b19-a8da-8ad3f73f3f5b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:49.038420 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba8851-7c90-4b19-a8da-8ad3f73f3f5b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:49.038694 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba8851-7c90-4b19-a8da-8ad3f73f3f5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:49.039471 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba8851-7c90-4b19-a8da-8ad3f73f3f5b None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=5e7764ee1d0d4522b5287add02797641, user.id=44be6441ef434e158bb0baa12d16595a) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:49.039781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba8851-7c90-4b19-a8da-8ad3f73f3f5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:49.041201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba8851-7c90-4b19-a8da-8ad3f73f3f5b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:49.047615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 584/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:33:48 2022] GET /identity/v3/role_assignments?user.id=44be6441ef434e158bb0baa12d16595a&scope.project.id=5e7764ee1d0d4522b5287add02797641&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:51.023432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df24480-d866-4f74-a7a8-7a8341c25706 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:51.024276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df24480-d866-4f74-a7a8-7a8341c25706 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:51.024276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df24480-d866-4f74-a7a8-7a8341c25706 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:51.026442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 578/1162] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:51.031923 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2fa26-f1db-48f1-9ba8-91539f2285ff None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:51.032343 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2fa26-f1db-48f1-9ba8-91539f2285ff None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:51.032451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2fa26-f1db-48f1-9ba8-91539f2285ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:51.052485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b3e2fa26-f1db-48f1-9ba8-91539f2285ff None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:51.053701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b3e2fa26-f1db-48f1-9ba8-91539f2285ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:51.121563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 585/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:51.143952 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df24480-d866-4f74-a7a8-7a8341c25706 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:51.262105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df24480-d866-4f74-a7a8-7a8341c25706 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:51.299621 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be40e4c-4d07-4dad-9f7a-8016128e6c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:51.300159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be40e4c-4d07-4dad-9f7a-8016128e6c5c None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:51.300442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be40e4c-4d07-4dad-9f7a-8016128e6c5c None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:51.300718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be40e4c-4d07-4dad-9f7a-8016128e6c5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:51.370892 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:51.379174 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be40e4c-4d07-4dad-9f7a-8016128e6c5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:51.380664 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be40e4c-4d07-4dad-9f7a-8016128e6c5c None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:51.480743 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 579/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:33:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:33:51.487536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2fa26-f1db-48f1-9ba8-91539f2285ff None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:51.598264 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2fa26-f1db-48f1-9ba8-91539f2285ff None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:51.625811 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:51.637728 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2c1ab-9e28-4779-9403-2c505e702119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:51.638373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2c1ab-9e28-4779-9403-2c505e702119 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:51.638651 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2c1ab-9e28-4779-9403-2c505e702119 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:51.638922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2c1ab-9e28-4779-9403-2c505e702119 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:51.645739 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2c1ab-9e28-4779-9403-2c505e702119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:51.647187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2c1ab-9e28-4779-9403-2c505e702119 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-02f2c1ab-9e28-4779-9403-2c505e702119 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:33:51.658835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:33:51.660003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:33:51.661199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 586/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 02:33:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:33:51.666189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be40e4c-4d07-4dad-9f7a-8016128e6c5c None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:51.767140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:51.773706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be40e4c-4d07-4dad-9f7a-8016128e6c5c None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:51.808354 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891ae47-0e98-4148-baf6-d302bead5486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:51.808980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891ae47-0e98-4148-baf6-d302bead5486 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:51.809258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891ae47-0e98-4148-baf6-d302bead5486 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:51.809562 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891ae47-0e98-4148-baf6-d302bead5486 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:51.810249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891ae47-0e98-4148-baf6-d302bead5486 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:33:51.810539 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891ae47-0e98-4148-baf6-d302bead5486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:51.811908 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891ae47-0e98-4148-baf6-d302bead5486 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:51.819181 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 580/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 02:33:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:53.774454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5951c3-df9b-472d-86b7-f64db641d50c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:53.775277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5951c3-df9b-472d-86b7-f64db641d50c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:53.775277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5951c3-df9b-472d-86b7-f64db641d50c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:53.777240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 587/1167] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:53.782661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf0dd9-c6b6-4706-945b-e657150a59c3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:53.783119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf0dd9-c6b6-4706-945b-e657150a59c3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:53.783213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf0dd9-c6b6-4706-945b-e657150a59c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:53.803070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e5cf0dd9-c6b6-4706-945b-e657150a59c3 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:53.804243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e5cf0dd9-c6b6-4706-945b-e657150a59c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:53.884729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 581/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:53.913178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5951c3-df9b-472d-86b7-f64db641d50c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:54.024674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5951c3-df9b-472d-86b7-f64db641d50c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:54.059841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43860f-4511-4b4d-9dc0-29aa9d34e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:54.060439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43860f-4511-4b4d-9dc0-29aa9d34e3a1 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:54.060718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43860f-4511-4b4d-9dc0-29aa9d34e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:54.060989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43860f-4511-4b4d-9dc0-29aa9d34e3a1 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:54.061723 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43860f-4511-4b4d-9dc0-29aa9d34e3a1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:54.063099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43860f-4511-4b4d-9dc0-29aa9d34e3a1 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:54.082878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 588/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Tue Jul 26 02:33:53 2022] POST /identity/v3/domains => generated 267 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:33:56.103570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d4567-f412-4a5c-b4a5-942feb7d1a6f None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:56.104080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d4567-f412-4a5c-b4a5-942feb7d1a6f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:56.104080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d4567-f412-4a5c-b4a5-942feb7d1a6f None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:56.106202 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 582/1170] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:56.115091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ee318-b150-4fb6-8d32-af1ce9b6d9a5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:56.115509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ee318-b150-4fb6-8d32-af1ce9b6d9a5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:56.115710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ee318-b150-4fb6-8d32-af1ce9b6d9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:56.137112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ed2ee318-b150-4fb6-8d32-af1ce9b6d9a5 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:56.138360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ed2ee318-b150-4fb6-8d32-af1ce9b6d9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:56.180960 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:56.209983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 589/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:56.234243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d4567-f412-4a5c-b4a5-942feb7d1a6f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:56.341478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:56.358960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d4567-f412-4a5c-b4a5-942feb7d1a6f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:56.396446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f21c7-a77f-4297-8ae9-9e41e6328f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:56.397091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f21c7-a77f-4297-8ae9-9e41e6328f34 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:56.397407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f21c7-a77f-4297-8ae9-9e41e6328f34 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:56.397677 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f21c7-a77f-4297-8ae9-9e41e6328f34 None admin] PATH_INFO: `/v3/domains/20a5b527c97c44af8cd5c84c2506c013` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:56.408797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f21c7-a77f-4297-8ae9-9e41e6328f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=20a5b527c97c44af8cd5c84c2506c013)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:56.410295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f21c7-a77f-4297-8ae9-9e41e6328f34 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:56.411897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 583/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Tue Jul 26 02:33:56 2022] GET /identity/v3/domains/20a5b527c97c44af8cd5c84c2506c013 => generated 267 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:56.418326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ee318-b150-4fb6-8d32-af1ce9b6d9a5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:56.522154 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ee318-b150-4fb6-8d32-af1ce9b6d9a5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:56.559792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7630c4-1217-4a3f-abc9-032cf38867c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:56.560396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7630c4-1217-4a3f-abc9-032cf38867c6 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:56.560674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7630c4-1217-4a3f-abc9-032cf38867c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:56.560944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7630c4-1217-4a3f-abc9-032cf38867c6 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:56.561650 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7630c4-1217-4a3f-abc9-032cf38867c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:56.563086 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7630c4-1217-4a3f-abc9-032cf38867c6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:56.594108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 590/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:33:56 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:33:58.618975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba76ff7-5c65-444b-b083-8a7cc3e09657 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:58.619865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba76ff7-5c65-444b-b083-8a7cc3e09657 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:58.619865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba76ff7-5c65-444b-b083-8a7cc3e09657 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:58.622076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 584/1174] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:33:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:33:58.630564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2189e1-27bc-4427-b433-e938c2b8ca56 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:58.631001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2189e1-27bc-4427-b433-e938c2b8ca56 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:58.631278 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2189e1-27bc-4427-b433-e938c2b8ca56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:58.651852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4c2189e1-27bc-4427-b433-e938c2b8ca56 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:33:58.653077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4c2189e1-27bc-4427-b433-e938c2b8ca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:33:58.674442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:33:58.732383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 591/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:33:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:33:58.770209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba76ff7-5c65-444b-b083-8a7cc3e09657 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:58.883221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba76ff7-5c65-444b-b083-8a7cc3e09657 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:58.921710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9d7d3-0724-4e4b-88fd-4f9285b078d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:58.922311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9d7d3-0724-4e4b-88fd-4f9285b078d1 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:58.922619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9d7d3-0724-4e4b-88fd-4f9285b078d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:58.922895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9d7d3-0724-4e4b-88fd-4f9285b078d1 None admin] PATH_INFO: `/v3/domains/20a5b527c97c44af8cd5c84c2506c013` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:58.924173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f9d7d3-0724-4e4b-88fd-4f9285b078d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=20a5b527c97c44af8cd5c84c2506c013)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:58.925652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f9d7d3-0724-4e4b-88fd-4f9285b078d1 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:58.927224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 585/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Tue Jul 26 02:33:58 2022] GET /identity/v3/domains/20a5b527c97c44af8cd5c84c2506c013 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:33:58.933320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2189e1-27bc-4427-b433-e938c2b8ca56 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:33:59.040032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2189e1-27bc-4427-b433-e938c2b8ca56 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:33:59.077203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e1284-7a99-4948-92d5-454b24386f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:33:59.077830 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e1284-7a99-4948-92d5-454b24386f2f None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:33:59.078102 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e1284-7a99-4948-92d5-454b24386f2f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:33:59.078367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e1284-7a99-4948-92d5-454b24386f2f None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:33:59.079041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e1284-7a99-4948-92d5-454b24386f2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:33:59.080469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e1284-7a99-4948-92d5-454b24386f2f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:33:59.105707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 592/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:33:58 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:34:01.142164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f777b1-eb03-44a3-9269-820652006125 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:01.143166 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f777b1-eb03-44a3-9269-820652006125 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:01.143166 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f777b1-eb03-44a3-9269-820652006125 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:01.145161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 586/1178] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:34:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:34:01.153802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b413e4-9219-4aea-9ef8-dea0b4df9f25 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:01.154233 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b413e4-9219-4aea-9ef8-dea0b4df9f25 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:01.154374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b413e4-9219-4aea-9ef8-dea0b4df9f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:01.179100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-60b413e4-9219-4aea-9ef8-dea0b4df9f25 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:34:01.180314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-60b413e4-9219-4aea-9ef8-dea0b4df9f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:34:01.187777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:01.254518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 593/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:34:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:34:01.277714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f777b1-eb03-44a3-9269-820652006125 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:01.299692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:01.396559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f777b1-eb03-44a3-9269-820652006125 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:01.434720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146be355-935b-46ba-a44c-722562bf790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:01.435355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146be355-935b-46ba-a44c-722562bf790a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:01.435639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146be355-935b-46ba-a44c-722562bf790a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:01.435912 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146be355-935b-46ba-a44c-722562bf790a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:01.446813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146be355-935b-46ba-a44c-722562bf790a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-146be355-935b-46ba-a44c-722562bf790a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:34:01.451742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:34:01.452883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:34:01.454377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:34:01.454377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:34:01.454377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:34:01.454377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:34:01.454377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:34:01.454377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:34:01.454377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:34:01.454377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:34:01.454377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:34:01.454377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:34:01.454377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:34:01.454377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:34:01.454377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 587/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:34:01.462950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b413e4-9219-4aea-9ef8-dea0b4df9f25 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:01.570825 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b413e4-9219-4aea-9ef8-dea0b4df9f25 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:01.607568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad9ec9-f7ef-4ca3-a535-7bec385a92be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:01.608202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad9ec9-f7ef-4ca3-a535-7bec385a92be None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:01.608483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad9ec9-f7ef-4ca3-a535-7bec385a92be None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:01.608755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad9ec9-f7ef-4ca3-a535-7bec385a92be None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:01.609506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad9ec9-f7ef-4ca3-a535-7bec385a92be None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:34:01.609806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad9ec9-f7ef-4ca3-a535-7bec385a92be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:01.611185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad9ec9-f7ef-4ca3-a535-7bec385a92be None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:01.620083 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 594/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:34:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:34:01.629048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146be355-935b-46ba-a44c-722562bf790a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:01.713869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:01.741337 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146be355-935b-46ba-a44c-722562bf790a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:01.775973 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957320d-1bba-46d1-8fd2-17bf1d1dcef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:01.776604 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957320d-1bba-46d1-8fd2-17bf1d1dcef3 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:01.776881 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957320d-1bba-46d1-8fd2-17bf1d1dcef3 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:01.777149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957320d-1bba-46d1-8fd2-17bf1d1dcef3 None admin] PATH_INFO: `/v3/users/b3537aa2ac154886a439d120400f7dc1` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:01.790425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957320d-1bba-46d1-8fd2-17bf1d1dcef3 None admin] RBAC: Authorizing `identity:get_user(user_id=b3537aa2ac154886a439d120400f7dc1)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:01.791948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957320d-1bba-46d1-8fd2-17bf1d1dcef3 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:01.793601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 588/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:34:01 2022] GET /identity/v3/users/b3537aa2ac154886a439d120400f7dc1 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:34:01.799786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad9ec9-f7ef-4ca3-a535-7bec385a92be None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:01.804075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:01.905601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad9ec9-f7ef-4ca3-a535-7bec385a92be None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:01.940115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae6be-ec9d-4a4f-b262-85d1240fb7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:01.940711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae6be-ec9d-4a4f-b262-85d1240fb7cc None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:01.940989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae6be-ec9d-4a4f-b262-85d1240fb7cc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:01.941257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ae6be-ec9d-4a4f-b262-85d1240fb7cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:02.010130 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ae6be-ec9d-4a4f-b262-85d1240fb7cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:02.011520 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ae6be-ec9d-4a4f-b262-85d1240fb7cc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:02.014126 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:02.118987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 595/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:34:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:34:02.125313 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957320d-1bba-46d1-8fd2-17bf1d1dcef3 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:02.236013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957320d-1bba-46d1-8fd2-17bf1d1dcef3 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:02.270393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188a4e7-94b7-462f-96ed-083c775c4cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:02.270956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a4e7-94b7-462f-96ed-083c775c4cbb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:02.271228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a4e7-94b7-462f-96ed-083c775c4cbb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:02.271499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188a4e7-94b7-462f-96ed-083c775c4cbb None admin] PATH_INFO: `/v3/projects/de746780c3b24c25b4b509840fa3ad07` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:02.272695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188a4e7-94b7-462f-96ed-083c775c4cbb None admin] RBAC: Authorizing `identity:get_project(project_id=de746780c3b24c25b4b509840fa3ad07)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:02.274156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188a4e7-94b7-462f-96ed-083c775c4cbb None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:02.275785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 589/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:34:02 2022] GET /identity/v3/projects/de746780c3b24c25b4b509840fa3ad07 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:34:02.285511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae6be-ec9d-4a4f-b262-85d1240fb7cc None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:02.400742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ae6be-ec9d-4a4f-b262-85d1240fb7cc None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:02.403217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:02.437156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa26b7f-bb1d-4cb2-8f81-7e8309c28bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:02.437809 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa26b7f-bb1d-4cb2-8f81-7e8309c28bf9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:02.438086 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa26b7f-bb1d-4cb2-8f81-7e8309c28bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:02.438357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa26b7f-bb1d-4cb2-8f81-7e8309c28bf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:02.439153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa26b7f-bb1d-4cb2-8f81-7e8309c28bf9 None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=de746780c3b24c25b4b509840fa3ad07, user.id=b3537aa2ac154886a439d120400f7dc1) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:34:02.439465 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa26b7f-bb1d-4cb2-8f81-7e8309c28bf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:02.440894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa26b7f-bb1d-4cb2-8f81-7e8309c28bf9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:02.446879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 596/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:34:02 2022] GET /identity/v3/role_assignments?user.id=b3537aa2ac154886a439d120400f7dc1&scope.project.id=de746780c3b24c25b4b509840fa3ad07&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:34:04.405334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62885dd5-a221-4dd1-8560-5ba27e70895d None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:04.406244 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62885dd5-a221-4dd1-8560-5ba27e70895d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:04.406244 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62885dd5-a221-4dd1-8560-5ba27e70895d None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:04.408375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 590/1186] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:34:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:34:04.414756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7953efb-00d0-48a4-8143-0e5e3b3edc28 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:04.415215 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7953efb-00d0-48a4-8143-0e5e3b3edc28 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:04.415326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7953efb-00d0-48a4-8143-0e5e3b3edc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:04.440563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d7953efb-00d0-48a4-8143-0e5e3b3edc28 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:34:04.441808 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d7953efb-00d0-48a4-8143-0e5e3b3edc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:34:04.511797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 597/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:34:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:34:04.539475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62885dd5-a221-4dd1-8560-5ba27e70895d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:04.543978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:04.647454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62885dd5-a221-4dd1-8560-5ba27e70895d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:04.683286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc2652-6da8-42b1-930c-d77f00d778bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:04.683839 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc2652-6da8-42b1-930c-d77f00d778bc None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:04.684113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc2652-6da8-42b1-930c-d77f00d778bc None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:04.684382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc2652-6da8-42b1-930c-d77f00d778bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:04.695220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc2652-6da8-42b1-930c-d77f00d778bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-20cc2652-6da8-42b1-930c-d77f00d778bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:34:04.700159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:34:04.701346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:34:04.702674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:34:04.702674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:34:04.702674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:34:04.702674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:34:04.702674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:34:04.702674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:34:04.702674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:34:04.702674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:34:04.702674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:34:04.702674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:34:04.702674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:34:04.702674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:34:04.702674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 591/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:34:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:34:04.707626 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7953efb-00d0-48a4-8143-0e5e3b3edc28 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:04.811087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:04.815028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7953efb-00d0-48a4-8143-0e5e3b3edc28 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:04.853959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720b0b2-6802-4235-97da-62eec4e98943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:04.854649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720b0b2-6802-4235-97da-62eec4e98943 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:04.854931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720b0b2-6802-4235-97da-62eec4e98943 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:04.855205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720b0b2-6802-4235-97da-62eec4e98943 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:04.855952 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720b0b2-6802-4235-97da-62eec4e98943 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:34:04.856265 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720b0b2-6802-4235-97da-62eec4e98943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:04.857660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720b0b2-6802-4235-97da-62eec4e98943 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:04.865848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 598/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:34:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:34:04.871945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc2652-6da8-42b1-930c-d77f00d778bc None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:04.937707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:04.979204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc2652-6da8-42b1-930c-d77f00d778bc None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:05.019755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea43e5-c6f6-430c-ba57-bbbf0754b40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:05.020392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea43e5-c6f6-430c-ba57-bbbf0754b40d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:05.020767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea43e5-c6f6-430c-ba57-bbbf0754b40d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:05.021049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea43e5-c6f6-430c-ba57-bbbf0754b40d None admin] PATH_INFO: `/v3/users/b3537aa2ac154886a439d120400f7dc1` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:05.022514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea43e5-c6f6-430c-ba57-bbbf0754b40d None admin] RBAC: Authorizing `identity:get_user(user_id=b3537aa2ac154886a439d120400f7dc1)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:05.023966 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea43e5-c6f6-430c-ba57-bbbf0754b40d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:05.025599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 592/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:34:04 2022] GET /identity/v3/users/b3537aa2ac154886a439d120400f7dc1 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:34:05.031692 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720b0b2-6802-4235-97da-62eec4e98943 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:05.140263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720b0b2-6802-4235-97da-62eec4e98943 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:05.175240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d1741-b1a9-40d7-aad8-a58c9a5e7d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:05.175883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1741-b1a9-40d7-aad8-a58c9a5e7d4d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:05.176162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1741-b1a9-40d7-aad8-a58c9a5e7d4d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:05.176433 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d1741-b1a9-40d7-aad8-a58c9a5e7d4d None admin] PATH_INFO: `/v3/projects/de746780c3b24c25b4b509840fa3ad07` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:05.177727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d1741-b1a9-40d7-aad8-a58c9a5e7d4d None admin] RBAC: Authorizing `identity:get_project(project_id=de746780c3b24c25b4b509840fa3ad07)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:05.179146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d1741-b1a9-40d7-aad8-a58c9a5e7d4d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:05.180815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 599/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:34:05 2022] GET /identity/v3/projects/de746780c3b24c25b4b509840fa3ad07 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:34:05.189907 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea43e5-c6f6-430c-ba57-bbbf0754b40d None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:05.307595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea43e5-c6f6-430c-ba57-bbbf0754b40d None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:05.338140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:05.344199 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fc667-3e45-4e30-b519-b5c97b4d39a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:05.344960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fc667-3e45-4e30-b519-b5c97b4d39a5 None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:05.345253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fc667-3e45-4e30-b519-b5c97b4d39a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:05.345576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fc667-3e45-4e30-b519-b5c97b4d39a5 None admin] PATH_INFO: `/v3/projects/de746780c3b24c25b4b509840fa3ad07/users/b3537aa2ac154886a439d120400f7dc1/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:05.347981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fc667-3e45-4e30-b519-b5c97b4d39a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=de746780c3b24c25b4b509840fa3ad07, user_id=b3537aa2ac154886a439d120400f7dc1, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:05.349948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fc667-3e45-4e30-b519-b5c97b4d39a5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:05.365298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 593/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:34:05 2022] PUT /identity/v3/projects/de746780c3b24c25b4b509840fa3ad07/users/b3537aa2ac154886a439d120400f7dc1/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:34:07.320617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79965ac6-bff6-4935-a325-5569df238507 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:07.321515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79965ac6-bff6-4935-a325-5569df238507 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:07.321675 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79965ac6-bff6-4935-a325-5569df238507 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:07.323885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 600/1193] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:34:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:34:07.329228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0751449-b65b-4862-b61f-f436342300af None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:07.329686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0751449-b65b-4862-b61f-f436342300af None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:07.329777 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0751449-b65b-4862-b61f-f436342300af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:07.349501 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b0751449-b65b-4862-b61f-f436342300af None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:34:07.350707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b0751449-b65b-4862-b61f-f436342300af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:34:07.418549 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 594/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:34:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:34:07.441919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79965ac6-bff6-4935-a325-5569df238507 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:07.473952 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:07.553501 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79965ac6-bff6-4935-a325-5569df238507 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:07.590690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963b8d0-b10f-4ac3-973d-bf11303bb95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:07.591249 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963b8d0-b10f-4ac3-973d-bf11303bb95b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:07.591529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963b8d0-b10f-4ac3-973d-bf11303bb95b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:07.591798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963b8d0-b10f-4ac3-973d-bf11303bb95b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:07.603518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963b8d0-b10f-4ac3-973d-bf11303bb95b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0963b8d0-b10f-4ac3-973d-bf11303bb95b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:34:07.608401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:34:07.609436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:34:07.610427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:34:07.610427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:34:07.610427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:34:07.610427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:34:07.610427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:34:07.610427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:34:07.610427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:34:07.610427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:34:07.610427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:34:07.610427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:34:07.610427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:34:07.610427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:34:07.610427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 601/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:34:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:34:07.616414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0751449-b65b-4862-b61f-f436342300af None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:07.724423 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0751449-b65b-4862-b61f-f436342300af None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:07.747315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:07.761197 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75292ed-3056-46e4-a628-d34fc52ff399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:07.761853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75292ed-3056-46e4-a628-d34fc52ff399 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:07.762119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75292ed-3056-46e4-a628-d34fc52ff399 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:07.762389 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75292ed-3056-46e4-a628-d34fc52ff399 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:07.763100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75292ed-3056-46e4-a628-d34fc52ff399 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:34:07.763398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75292ed-3056-46e4-a628-d34fc52ff399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:07.764771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75292ed-3056-46e4-a628-d34fc52ff399 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:07.772948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 595/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:34:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:34:07.778965 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963b8d0-b10f-4ac3-973d-bf11303bb95b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:07.870241 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:07.883257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963b8d0-b10f-4ac3-973d-bf11303bb95b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:07.917709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3ff70-b3d9-4985-92fe-cbd49b6bef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:07.918336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3ff70-b3d9-4985-92fe-cbd49b6bef20 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:07.918625 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3ff70-b3d9-4985-92fe-cbd49b6bef20 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:07.918902 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3ff70-b3d9-4985-92fe-cbd49b6bef20 None admin] PATH_INFO: `/v3/users/b3537aa2ac154886a439d120400f7dc1` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:07.920103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3ff70-b3d9-4985-92fe-cbd49b6bef20 None admin] RBAC: Authorizing `identity:get_user(user_id=b3537aa2ac154886a439d120400f7dc1)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:07.921568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3ff70-b3d9-4985-92fe-cbd49b6bef20 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:07.923177 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 602/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 02:34:07 2022] GET /identity/v3/users/b3537aa2ac154886a439d120400f7dc1 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:34:07.929901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75292ed-3056-46e4-a628-d34fc52ff399 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:08.039152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75292ed-3056-46e4-a628-d34fc52ff399 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:08.073891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d13cc7-84dd-4902-9bc0-e1ce7c7fe24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:08.074489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d13cc7-84dd-4902-9bc0-e1ce7c7fe24b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:08.074766 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d13cc7-84dd-4902-9bc0-e1ce7c7fe24b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:08.075035 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d13cc7-84dd-4902-9bc0-e1ce7c7fe24b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:08.130083 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:08.154122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d13cc7-84dd-4902-9bc0-e1ce7c7fe24b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:08.155576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d13cc7-84dd-4902-9bc0-e1ce7c7fe24b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:08.252324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 596/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:34:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:34:08.258549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3ff70-b3d9-4985-92fe-cbd49b6bef20 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:08.362328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3ff70-b3d9-4985-92fe-cbd49b6bef20 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:08.397261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c60df-ba88-4ee2-b4fa-0b2f3a227d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:08.397855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c60df-ba88-4ee2-b4fa-0b2f3a227d7a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:08.398141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c60df-ba88-4ee2-b4fa-0b2f3a227d7a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:08.398406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c60df-ba88-4ee2-b4fa-0b2f3a227d7a None admin] PATH_INFO: `/v3/projects/de746780c3b24c25b4b509840fa3ad07` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:08.399616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c60df-ba88-4ee2-b4fa-0b2f3a227d7a None admin] RBAC: Authorizing `identity:get_project(project_id=de746780c3b24c25b4b509840fa3ad07)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:08.401077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c60df-ba88-4ee2-b4fa-0b2f3a227d7a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:08.402754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 603/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 02:34:08 2022] GET /identity/v3/projects/de746780c3b24c25b4b509840fa3ad07 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:34:08.409656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d13cc7-84dd-4902-9bc0-e1ce7c7fe24b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:34:08.499223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:08.516104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d13cc7-84dd-4902-9bc0-e1ce7c7fe24b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:34:08.550676 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17334ea0-195a-49ca-9be6-25d7b9436c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:34:08.551316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17334ea0-195a-49ca-9be6-25d7b9436c68 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:34:08.551597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17334ea0-195a-49ca-9be6-25d7b9436c68 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:34:08.551869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17334ea0-195a-49ca-9be6-25d7b9436c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:34:08.552656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17334ea0-195a-49ca-9be6-25d7b9436c68 None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=de746780c3b24c25b4b509840fa3ad07, user.id=b3537aa2ac154886a439d120400f7dc1) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:34:08.552967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17334ea0-195a-49ca-9be6-25d7b9436c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:34:08.554454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17334ea0-195a-49ca-9be6-25d7b9436c68 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:34:08.560130 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 597/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:34:08 2022] GET /identity/v3/role_assignments?user.id=b3537aa2ac154886a439d120400f7dc1&scope.project.id=de746780c3b24c25b4b509840fa3ad07&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:34:18.392747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:34:18.557547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=26 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:03.337805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d281a1-6f68-4c9d-b332-0ec167039c09 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:03.337805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d281a1-6f68-4c9d-b332-0ec167039c09 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:03.337805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d281a1-6f68-4c9d-b332-0ec167039c09 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:03.337805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 604/1201] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:35:03.343064 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018590b3-a4c6-4e56-807d-f3df7995b486 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:03.343610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018590b3-a4c6-4e56-807d-f3df7995b486 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:03.343699 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018590b3-a4c6-4e56-807d-f3df7995b486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:03.370131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-018590b3-a4c6-4e56-807d-f3df7995b486 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:35:03.371580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-018590b3-a4c6-4e56-807d-f3df7995b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:35:03.458282 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 598/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:35:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:35:03.488793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d281a1-6f68-4c9d-b332-0ec167039c09 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:03.633339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d281a1-6f68-4c9d-b332-0ec167039c09 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:03.674648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892df35-7218-4141-a05d-b4b359413559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:03.675303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892df35-7218-4141-a05d-b4b359413559 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:03.675584 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892df35-7218-4141-a05d-b4b359413559 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:03.675891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892df35-7218-4141-a05d-b4b359413559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:03.688394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892df35-7218-4141-a05d-b4b359413559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:03.689978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892df35-7218-4141-a05d-b4b359413559 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2892df35-7218-4141-a05d-b4b359413559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:35:03.707616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:03.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:03.710400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:35:03.710400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:35:03.710400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:03.710400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:03.717319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 605/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:03.717482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018590b3-a4c6-4e56-807d-f3df7995b486 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:03.842628 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018590b3-a4c6-4e56-807d-f3df7995b486 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:03.885564 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:03.895198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd307045-5bc8-4f25-9ef5-20580f43afd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:03.896194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd307045-5bc8-4f25-9ef5-20580f43afd7 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:03.896483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd307045-5bc8-4f25-9ef5-20580f43afd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:03.896788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd307045-5bc8-4f25-9ef5-20580f43afd7 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:03.897629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd307045-5bc8-4f25-9ef5-20580f43afd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:03.897962 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd307045-5bc8-4f25-9ef5-20580f43afd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:03.899581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd307045-5bc8-4f25-9ef5-20580f43afd7 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:03.922070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 599/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:03.923889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892df35-7218-4141-a05d-b4b359413559 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:03.993255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:04.056700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892df35-7218-4141-a05d-b4b359413559 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:04.098349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479012e-b92b-4565-b884-089e9cf24c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:04.098980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479012e-b92b-4565-b884-089e9cf24c0b None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:04.099257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479012e-b92b-4565-b884-089e9cf24c0b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:04.099619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479012e-b92b-4565-b884-089e9cf24c0b None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:04.100352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479012e-b92b-4565-b884-089e9cf24c0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:04.101828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479012e-b92b-4565-b884-089e9cf24c0b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:04.127140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 606/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 02:35:03 2022] POST /identity/v3/users => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:35:06.436296 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e0fc8-4029-4f62-aac8-5dacd2de00f4 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:06.436897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e0fc8-4029-4f62-aac8-5dacd2de00f4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:06.436897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e0fc8-4029-4f62-aac8-5dacd2de00f4 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:06.438237 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 600/1206] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:35:06.444028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c14099-9867-42e9-b720-80d8201b2ab2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:06.444461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c14099-9867-42e9-b720-80d8201b2ab2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:06.444620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c14099-9867-42e9-b720-80d8201b2ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:06.463810 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-92c14099-9867-42e9-b720-80d8201b2ab2 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:35:06.465111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-92c14099-9867-42e9-b720-80d8201b2ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:35:06.549693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 607/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:35:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:35:06.567334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e0fc8-4029-4f62-aac8-5dacd2de00f4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:06.703793 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e0fc8-4029-4f62-aac8-5dacd2de00f4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:06.743677 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d09d2-fea7-4741-aea3-0ce4d30d60d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:06.744310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d09d2-fea7-4741-aea3-0ce4d30d60d5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:06.744712 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d09d2-fea7-4741-aea3-0ce4d30d60d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:06.744950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d09d2-fea7-4741-aea3-0ce4d30d60d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:06.756160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d09d2-fea7-4741-aea3-0ce4d30d60d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-6c9d09d2-fea7-4741-aea3-0ce4d30d60d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:35:06.761729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:06.762784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:06.763879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:06.763879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:06.763879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:06.763879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:06.763879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:35:06.763879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:35:06.763879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:35:06.763879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:35:06.763879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:35:06.763879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:35:06.763879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:35:06.763879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:06.763879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 601/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:35:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:06.769504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c14099-9867-42e9-b720-80d8201b2ab2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:06.816925 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:06.894277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c14099-9867-42e9-b720-80d8201b2ab2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:06.933599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255c815-b7b7-41e7-86d2-90414c499096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:06.934524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c815-b7b7-41e7-86d2-90414c499096 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:06.934970 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c815-b7b7-41e7-86d2-90414c499096 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:06.935459 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255c815-b7b7-41e7-86d2-90414c499096 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:06.936336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255c815-b7b7-41e7-86d2-90414c499096 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:06.936591 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255c815-b7b7-41e7-86d2-90414c499096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:06.938108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255c815-b7b7-41e7-86d2-90414c499096 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:06.947706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 608/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:35:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:06.953765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d09d2-fea7-4741-aea3-0ce4d30d60d5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:07.009794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:07.076912 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d09d2-fea7-4741-aea3-0ce4d30d60d5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:07.123438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5461ee-3e24-41b1-a3c2-e411921121bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:07.124093 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5461ee-3e24-41b1-a3c2-e411921121bb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:07.124416 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5461ee-3e24-41b1-a3c2-e411921121bb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:07.124689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5461ee-3e24-41b1-a3c2-e411921121bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:07.136772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5461ee-3e24-41b1-a3c2-e411921121bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:07.138465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5461ee-3e24-41b1-a3c2-e411921121bb None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-3f5461ee-3e24-41b1-a3c2-e411921121bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:35:07.155872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:07.156978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:07.157901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:35:07.157901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:35:07.157901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:07.157901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:07.157901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 602/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:07.163058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255c815-b7b7-41e7-86d2-90414c499096 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:07.277888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:07.280884 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255c815-b7b7-41e7-86d2-90414c499096 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:07.322377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7f2bb-da75-40d4-b6a5-4e52b2ab129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:07.323005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7f2bb-da75-40d4-b6a5-4e52b2ab129b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:07.323289 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7f2bb-da75-40d4-b6a5-4e52b2ab129b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:07.323617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7f2bb-da75-40d4-b6a5-4e52b2ab129b None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:07.324256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7f2bb-da75-40d4-b6a5-4e52b2ab129b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:07.324628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7f2bb-da75-40d4-b6a5-4e52b2ab129b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:07.326078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7f2bb-da75-40d4-b6a5-4e52b2ab129b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:07.338656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 609/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:35:07.344488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5461ee-3e24-41b1-a3c2-e411921121bb None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:07.459619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5461ee-3e24-41b1-a3c2-e411921121bb None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:07.461262 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:07.498706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c3311-8770-40db-8127-93d3f4b5e8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:07.499356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c3311-8770-40db-8127-93d3f4b5e8fa None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:07.499635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c3311-8770-40db-8127-93d3f4b5e8fa None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:07.499905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c3311-8770-40db-8127-93d3f4b5e8fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:07.508861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c3311-8770-40db-8127-93d3f4b5e8fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:07.510395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c3311-8770-40db-8127-93d3f4b5e8fa None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-1c2c3311-8770-40db-8127-93d3f4b5e8fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:35:07.522403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:07.523442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:07.524914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:07.524914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:07.524914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:35:07.524914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:35:07.524914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:35:07.524914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:35:07.524914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:35:07.524914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:35:07.524914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 02:35:07.524914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:07.524914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 603/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:07.530093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7f2bb-da75-40d4-b6a5-4e52b2ab129b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:07.636686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7f2bb-da75-40d4-b6a5-4e52b2ab129b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:07.673019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba0872-6239-484c-8c0a-8cc19d12c176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:07.675331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba0872-6239-484c-8c0a-8cc19d12c176 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:07.675331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba0872-6239-484c-8c0a-8cc19d12c176 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:07.675331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba0872-6239-484c-8c0a-8cc19d12c176 None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:07.675331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba0872-6239-484c-8c0a-8cc19d12c176 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:07.675331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba0872-6239-484c-8c0a-8cc19d12c176 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:07.676670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba0872-6239-484c-8c0a-8cc19d12c176 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:07.694626 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 610/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Tue Jul 26 02:35:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:07.700746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c3311-8770-40db-8127-93d3f4b5e8fa None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:07.823647 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c3311-8770-40db-8127-93d3f4b5e8fa None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:07.868866 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ded6e0-d217-47c1-8390-3814e9586ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:07.869545 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded6e0-d217-47c1-8390-3814e9586ea9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:07.869824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded6e0-d217-47c1-8390-3814e9586ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:07.870094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ded6e0-d217-47c1-8390-3814e9586ea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:07.903729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:07.950449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ded6e0-d217-47c1-8390-3814e9586ea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:07.953266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ded6e0-d217-47c1-8390-3814e9586ea9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:08.065943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 604/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:35:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 02:35:08.071917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba0872-6239-484c-8c0a-8cc19d12c176 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:08.091716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:08.181204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba0872-6239-484c-8c0a-8cc19d12c176 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:08.225487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b617493-dd4b-414a-9f0c-c8adc2354f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:08.226215 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b617493-dd4b-414a-9f0c-c8adc2354f11 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:08.226508 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b617493-dd4b-414a-9f0c-c8adc2354f11 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:08.226798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b617493-dd4b-414a-9f0c-c8adc2354f11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:08.239345 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b617493-dd4b-414a-9f0c-c8adc2354f11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:08.241132 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b617493-dd4b-414a-9f0c-c8adc2354f11 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-2b617493-dd4b-414a-9f0c-c8adc2354f11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:35:08.259752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:08.261204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:08.262160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:35:08.262160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:35:08.262160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:08.262160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:08.262160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 611/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:08.267209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ded6e0-d217-47c1-8390-3814e9586ea9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:08.334413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:08.381001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ded6e0-d217-47c1-8390-3814e9586ea9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:08.422170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480217a-79aa-442e-b87c-184d9ce0eb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:08.422836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480217a-79aa-442e-b87c-184d9ce0eb63 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:08.423182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480217a-79aa-442e-b87c-184d9ce0eb63 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:08.423487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480217a-79aa-442e-b87c-184d9ce0eb63 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:08.424343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480217a-79aa-442e-b87c-184d9ce0eb63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:08.424723 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480217a-79aa-442e-b87c-184d9ce0eb63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:08.426493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480217a-79aa-442e-b87c-184d9ce0eb63 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:08.439160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 605/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:08.444928 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b617493-dd4b-414a-9f0c-c8adc2354f11 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:08.524774 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:08.560910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b617493-dd4b-414a-9f0c-c8adc2354f11 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:08.598749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebfb8e-c881-4437-8e60-cd29876e4bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:08.599457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebfb8e-c881-4437-8e60-cd29876e4bb9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:08.599742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebfb8e-c881-4437-8e60-cd29876e4bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:08.600047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebfb8e-c881-4437-8e60-cd29876e4bb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:08.608360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebfb8e-c881-4437-8e60-cd29876e4bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:08.610844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebfb8e-c881-4437-8e60-cd29876e4bb9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-0eebfb8e-c881-4437-8e60-cd29876e4bb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:35:08.623299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:08.624664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:08.625632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:35:08.625632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:35:08.625632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:35:08.625632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:35:08.625632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:35:08.625632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:35:08.625632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:35:08.625632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:08.625632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 612/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:35:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:08.631807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480217a-79aa-442e-b87c-184d9ce0eb63 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:08.740336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480217a-79aa-442e-b87c-184d9ce0eb63 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:08.764461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:08.778268 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2387826-5347-437d-a0cd-a7efb9d5afe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:08.779357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387826-5347-437d-a0cd-a7efb9d5afe9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:08.779357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387826-5347-437d-a0cd-a7efb9d5afe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:08.779620 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387826-5347-437d-a0cd-a7efb9d5afe9 None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:08.780427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2387826-5347-437d-a0cd-a7efb9d5afe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:08.780983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2387826-5347-437d-a0cd-a7efb9d5afe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:08.782475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2387826-5347-437d-a0cd-a7efb9d5afe9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:08.795368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 606/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:35:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:08.802179 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebfb8e-c881-4437-8e60-cd29876e4bb9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:08.909659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebfb8e-c881-4437-8e60-cd29876e4bb9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:08.942917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:08.949552 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1ab89-a15c-42f8-ab3c-8e28de6c38e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:08.950180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1ab89-a15c-42f8-ab3c-8e28de6c38e9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:08.950455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1ab89-a15c-42f8-ab3c-8e28de6c38e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:08.950724 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1ab89-a15c-42f8-ab3c-8e28de6c38e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:08.951543 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1ab89-a15c-42f8-ab3c-8e28de6c38e9 None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=629b38364f6a414aa14123c0749ba164) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:08.951847 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1ab89-a15c-42f8-ab3c-8e28de6c38e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:08.953668 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1ab89-a15c-42f8-ab3c-8e28de6c38e9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:08.969615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 613/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:35:08 2022] GET /identity/v3/role_assignments?user.id=629b38364f6a414aa14123c0749ba164&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:10.943939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3fda3-72c9-4bb1-b6ad-5491f5b34d79 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:10.944467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3fda3-72c9-4bb1-b6ad-5491f5b34d79 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:10.944467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd3fda3-72c9-4bb1-b6ad-5491f5b34d79 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:10.945786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 607/1220] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:35:10.951352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777296e8-1cc1-4d8b-940a-30e64c4720a4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:10.951809 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777296e8-1cc1-4d8b-940a-30e64c4720a4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:10.951900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777296e8-1cc1-4d8b-940a-30e64c4720a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:10.971728 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-777296e8-1cc1-4d8b-940a-30e64c4720a4 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:35:10.972910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-777296e8-1cc1-4d8b-940a-30e64c4720a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:35:11.048120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 614/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:35:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:35:11.080542 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3fda3-72c9-4bb1-b6ad-5491f5b34d79 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:11.192643 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd3fda3-72c9-4bb1-b6ad-5491f5b34d79 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:11.230842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5aa0e-f008-42d2-abf4-b8eee2a35802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:11.231388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5aa0e-f008-42d2-abf4-b8eee2a35802 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:11.231662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5aa0e-f008-42d2-abf4-b8eee2a35802 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:11.231930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5aa0e-f008-42d2-abf4-b8eee2a35802 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:11.243244 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c5aa0e-f008-42d2-abf4-b8eee2a35802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-75c5aa0e-f008-42d2-abf4-b8eee2a35802 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:35:11.248099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:11.249119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:11.250000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:11.250000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:11.250000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:11.250000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:11.250000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:35:11.250000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:35:11.250000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:35:11.250000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:35:11.250000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:35:11.250000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:35:11.250000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:35:11.250000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:11.250000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 608/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:35:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:11.256154 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777296e8-1cc1-4d8b-940a-30e64c4720a4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:11.367441 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777296e8-1cc1-4d8b-940a-30e64c4720a4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:11.395035 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:11.408332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed2a7e-ba63-4bc5-8b6d-8ebca4ab4ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:11.408954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed2a7e-ba63-4bc5-8b6d-8ebca4ab4ab9 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:11.409226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed2a7e-ba63-4bc5-8b6d-8ebca4ab4ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:11.409516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed2a7e-ba63-4bc5-8b6d-8ebca4ab4ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:11.410233 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed2a7e-ba63-4bc5-8b6d-8ebca4ab4ab9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:11.410527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed2a7e-ba63-4bc5-8b6d-8ebca4ab4ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:11.411887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed2a7e-ba63-4bc5-8b6d-8ebca4ab4ab9 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:11.420034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 615/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:35:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:11.426744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5aa0e-f008-42d2-abf4-b8eee2a35802 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:11.475065 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:11.535326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c5aa0e-f008-42d2-abf4-b8eee2a35802 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:11.568413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005c598-1c43-414c-9eaf-5b59d35b4ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:11.569060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005c598-1c43-414c-9eaf-5b59d35b4ab6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:11.569375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005c598-1c43-414c-9eaf-5b59d35b4ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:11.569648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005c598-1c43-414c-9eaf-5b59d35b4ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:11.580032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005c598-1c43-414c-9eaf-5b59d35b4ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:11.581525 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005c598-1c43-414c-9eaf-5b59d35b4ab6 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-8005c598-1c43-414c-9eaf-5b59d35b4ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:35:11.596173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:11.597217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:11.598781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:35:11.598781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:35:11.598781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:11.598781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:11.598781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 609/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:11.603414 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed2a7e-ba63-4bc5-8b6d-8ebca4ab4ab9 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:11.710296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed2a7e-ba63-4bc5-8b6d-8ebca4ab4ab9 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:11.748702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d0310-17a3-43cb-bed3-af76fb60b88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:11.749353 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d0310-17a3-43cb-bed3-af76fb60b88c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:11.749633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d0310-17a3-43cb-bed3-af76fb60b88c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:11.749899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d0310-17a3-43cb-bed3-af76fb60b88c None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:11.750586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d0310-17a3-43cb-bed3-af76fb60b88c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:11.750886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d0310-17a3-43cb-bed3-af76fb60b88c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:11.752251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d0310-17a3-43cb-bed3-af76fb60b88c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:11.763895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 616/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:11.769758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005c598-1c43-414c-9eaf-5b59d35b4ab6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:11.870117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:11.877789 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005c598-1c43-414c-9eaf-5b59d35b4ab6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:11.912528 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a14692-c9d9-491a-930e-4fd0c99886e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:11.913180 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14692-c9d9-491a-930e-4fd0c99886e4 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:11.913490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14692-c9d9-491a-930e-4fd0c99886e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:11.913763 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a14692-c9d9-491a-930e-4fd0c99886e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:11.921677 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a14692-c9d9-491a-930e-4fd0c99886e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:11.923133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a14692-c9d9-491a-930e-4fd0c99886e4 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-26a14692-c9d9-491a-930e-4fd0c99886e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:35:11.934505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:11.935700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:11.936823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:11.936823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:11.936823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:35:11.936823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:35:11.936823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:35:11.936823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:35:11.936823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:35:11.936823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:35:11.936823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 02:35:11.936823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:11.936823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 610/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:11.941826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d0310-17a3-43cb-bed3-af76fb60b88c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:11.993437 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:12.053275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d0310-17a3-43cb-bed3-af76fb60b88c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:12.091068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c35c4-d386-4184-a3d9-4dddfdd3831f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:12.091773 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c35c4-d386-4184-a3d9-4dddfdd3831f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:12.092056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c35c4-d386-4184-a3d9-4dddfdd3831f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:12.092347 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c35c4-d386-4184-a3d9-4dddfdd3831f None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:12.093420 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c35c4-d386-4184-a3d9-4dddfdd3831f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:12.093818 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c35c4-d386-4184-a3d9-4dddfdd3831f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:12.095433 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c35c4-d386-4184-a3d9-4dddfdd3831f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:12.113651 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 617/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Tue Jul 26 02:35:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:12.119661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a14692-c9d9-491a-930e-4fd0c99886e4 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:12.227666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a14692-c9d9-491a-930e-4fd0c99886e4 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:12.261514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e365b-4022-431c-9d2c-08f0a46eec78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:12.262165 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e365b-4022-431c-9d2c-08f0a46eec78 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:12.262476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e365b-4022-431c-9d2c-08f0a46eec78 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:12.262744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e365b-4022-431c-9d2c-08f0a46eec78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:12.273895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e365b-4022-431c-9d2c-08f0a46eec78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:12.275600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e365b-4022-431c-9d2c-08f0a46eec78 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-465e365b-4022-431c-9d2c-08f0a46eec78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:35:12.290430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:12.291551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:12.292700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:35:12.292700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:35:12.292700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:12.292700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:12.293770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 611/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:12.299695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c35c4-d386-4184-a3d9-4dddfdd3831f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:12.409075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c35c4-d386-4184-a3d9-4dddfdd3831f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:12.413042 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:12.451660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a82334-9153-4635-8304-10e713c06da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:12.452351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a82334-9153-4635-8304-10e713c06da8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:12.452630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a82334-9153-4635-8304-10e713c06da8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:12.452924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a82334-9153-4635-8304-10e713c06da8 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:12.453726 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a82334-9153-4635-8304-10e713c06da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:12.454028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a82334-9153-4635-8304-10e713c06da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:12.455399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a82334-9153-4635-8304-10e713c06da8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:12.468975 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 618/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:12.476099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e365b-4022-431c-9d2c-08f0a46eec78 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:12.486634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:12.587344 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e365b-4022-431c-9d2c-08f0a46eec78 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:12.625656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f3779-5889-4fdf-9f85-008df341b9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:12.626400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f3779-5889-4fdf-9f85-008df341b9ce None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:12.626676 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f3779-5889-4fdf-9f85-008df341b9ce None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:12.626940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f3779-5889-4fdf-9f85-008df341b9ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:12.634258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f3779-5889-4fdf-9f85-008df341b9ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:12.635722 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f3779-5889-4fdf-9f85-008df341b9ce None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d35f3779-5889-4fdf-9f85-008df341b9ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:35:12.647324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:12.648519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:12.649771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:35:12.649771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:35:12.649771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:35:12.649771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:35:12.649771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:35:12.649771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:35:12.649771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:35:12.649771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:12.649771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 612/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:35:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:12.654619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a82334-9153-4635-8304-10e713c06da8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:12.765892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a82334-9153-4635-8304-10e713c06da8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:12.804732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324a761-f676-4616-80b4-156d5a0dd45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:12.805452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324a761-f676-4616-80b4-156d5a0dd45e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:12.805730 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324a761-f676-4616-80b4-156d5a0dd45e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:12.805996 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324a761-f676-4616-80b4-156d5a0dd45e None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:12.806757 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324a761-f676-4616-80b4-156d5a0dd45e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:12.807050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324a761-f676-4616-80b4-156d5a0dd45e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:12.808674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4324a761-f676-4616-80b4-156d5a0dd45e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:12.823105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 619/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:35:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:35:12.829305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f3779-5889-4fdf-9f85-008df341b9ce None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:12.896990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:12.935299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f3779-5889-4fdf-9f85-008df341b9ce None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:12.969249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7332a06-f9b7-4c14-bb8c-6b7cb124030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:12.969973 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7332a06-f9b7-4c14-bb8c-6b7cb124030b None admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:12.970239 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7332a06-f9b7-4c14-bb8c-6b7cb124030b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:12.970549 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7332a06-f9b7-4c14-bb8c-6b7cb124030b None admin] PATH_INFO: `/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/629b38364f6a414aa14123c0749ba164/roles/4afb03ef7ba64a1fabaf9b59249d9a15` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:12.986327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7332a06-f9b7-4c14-bb8c-6b7cb124030b None admin] RBAC: Authorizing `identity:create_grant(project_id=b017927d64b44db8a1611f20e6e3b6f5, user_id=629b38364f6a414aa14123c0749ba164, role_id=4afb03ef7ba64a1fabaf9b59249d9a15)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:12.987908 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7332a06-f9b7-4c14-bb8c-6b7cb124030b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:13.001948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 613/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:35:12 2022] PUT /identity/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/629b38364f6a414aa14123c0749ba164/roles/4afb03ef7ba64a1fabaf9b59249d9a15 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:35:15.292304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34a610-a132-4adf-99a3-7ef6307be85d None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:15.292917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34a610-a132-4adf-99a3-7ef6307be85d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:15.292917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34a610-a132-4adf-99a3-7ef6307be85d None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:15.294461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 620/1233] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:35:15.300774 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b431cc7-357c-4fab-8d85-c552038f74ea None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:15.301246 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b431cc7-357c-4fab-8d85-c552038f74ea None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:15.301367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b431cc7-357c-4fab-8d85-c552038f74ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:15.322125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7b431cc7-357c-4fab-8d85-c552038f74ea None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:35:15.323492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7b431cc7-357c-4fab-8d85-c552038f74ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:35:15.396063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 614/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:35:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:35:15.418904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34a610-a132-4adf-99a3-7ef6307be85d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:15.444895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:15.524563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34a610-a132-4adf-99a3-7ef6307be85d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:15.561826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828113-7a02-4e7c-9bae-a205bbbb7241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:15.562403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828113-7a02-4e7c-9bae-a205bbbb7241 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:15.562702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828113-7a02-4e7c-9bae-a205bbbb7241 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:15.563051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828113-7a02-4e7c-9bae-a205bbbb7241 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:15.574446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0828113-7a02-4e7c-9bae-a205bbbb7241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-b0828113-7a02-4e7c-9bae-a205bbbb7241 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:35:15.579627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:15.580822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:15.581840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:15.581840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:15.581840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:15.581840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:15.581840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:35:15.581840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:35:15.581840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:35:15.581840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:35:15.581840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:35:15.581840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:35:15.581840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 02:35:15.581840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:15.581840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 621/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 02:35:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:15.587184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b431cc7-357c-4fab-8d85-c552038f74ea None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:15.640479 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:15.696767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b431cc7-357c-4fab-8d85-c552038f74ea None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:15.733000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa3e53-63b5-4112-9588-40731da13463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:15.733655 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa3e53-63b5-4112-9588-40731da13463 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:15.733934 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa3e53-63b5-4112-9588-40731da13463 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:15.734203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa3e53-63b5-4112-9588-40731da13463 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:15.734923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa3e53-63b5-4112-9588-40731da13463 None admin] RBAC: Adding query filter params (name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:15.735223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa3e53-63b5-4112-9588-40731da13463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:15.736604 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa3e53-63b5-4112-9588-40731da13463 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:15.744516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 615/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 02:35:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:15.750444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828113-7a02-4e7c-9bae-a205bbbb7241 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:15.846041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:15.862532 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828113-7a02-4e7c-9bae-a205bbbb7241 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:15.899931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465920b7-479c-435b-9586-c0ef8bc9828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:15.900792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465920b7-479c-435b-9586-c0ef8bc9828c None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:15.901077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465920b7-479c-435b-9586-c0ef8bc9828c None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:15.901377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465920b7-479c-435b-9586-c0ef8bc9828c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:15.912094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465920b7-479c-435b-9586-c0ef8bc9828c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:15.913570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465920b7-479c-435b-9586-c0ef8bc9828c None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-465920b7-479c-435b-9586-c0ef8bc9828c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:35:15.928105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:15.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:15.930187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:35:15.930187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:35:15.930187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:15.930187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:15.930187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 622/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:35:15.935696 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa3e53-63b5-4112-9588-40731da13463 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:16.044165 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa3e53-63b5-4112-9588-40731da13463 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:16.053668 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:16.078857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061f080-aa29-4119-a4ac-cb147b38247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:16.079487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061f080-aa29-4119-a4ac-cb147b38247a None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:16.079768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061f080-aa29-4119-a4ac-cb147b38247a None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:16.080059 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061f080-aa29-4119-a4ac-cb147b38247a None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:16.080761 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061f080-aa29-4119-a4ac-cb147b38247a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:16.081037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061f080-aa29-4119-a4ac-cb147b38247a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:16.082499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061f080-aa29-4119-a4ac-cb147b38247a None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:16.097367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 616/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:16.103290 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465920b7-479c-435b-9586-c0ef8bc9828c None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:16.217024 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465920b7-479c-435b-9586-c0ef8bc9828c None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:16.252134 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073f259-9a4e-4090-a7e9-448d46084e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:16.252776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073f259-9a4e-4090-a7e9-448d46084e17 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:16.253059 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073f259-9a4e-4090-a7e9-448d46084e17 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:16.253358 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073f259-9a4e-4090-a7e9-448d46084e17 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:16.256148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:16.261621 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073f259-9a4e-4090-a7e9-448d46084e17 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:16.263265 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073f259-9a4e-4090-a7e9-448d46084e17 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-9073f259-9a4e-4090-a7e9-448d46084e17 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:35:16.274530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:16.275671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:16.281504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:16.281504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:16.281504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:35:16.281504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:35:16.281504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:35:16.281504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:35:16.281504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:35:16.281504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:35:16.281504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 02:35:16.281504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:16.281504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 623/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:16.282137 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061f080-aa29-4119-a4ac-cb147b38247a None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:16.394975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061f080-aa29-4119-a4ac-cb147b38247a None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:16.431511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c875d-a1bc-4669-8ae3-9e8c6e775fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:16.432141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c875d-a1bc-4669-8ae3-9e8c6e775fb9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:16.432421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c875d-a1bc-4669-8ae3-9e8c6e775fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:16.432691 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c875d-a1bc-4669-8ae3-9e8c6e775fb9 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:16.433527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c875d-a1bc-4669-8ae3-9e8c6e775fb9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:16.433836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c875d-a1bc-4669-8ae3-9e8c6e775fb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:16.435282 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c875d-a1bc-4669-8ae3-9e8c6e775fb9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:16.452390 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 617/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Tue Jul 26 02:35:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:16.458460 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073f259-9a4e-4090-a7e9-448d46084e17 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:16.563764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073f259-9a4e-4090-a7e9-448d46084e17 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:16.600853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957d61a-e1eb-4d12-a577-79d1b7dd26b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:16.601528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957d61a-e1eb-4d12-a577-79d1b7dd26b6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:16.601807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957d61a-e1eb-4d12-a577-79d1b7dd26b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:16.602113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957d61a-e1eb-4d12-a577-79d1b7dd26b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:16.668322 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:16.674925 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957d61a-e1eb-4d12-a577-79d1b7dd26b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:16.676985 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957d61a-e1eb-4d12-a577-79d1b7dd26b6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:16.782525 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 624/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:35:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 02:35:16.788552 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c875d-a1bc-4669-8ae3-9e8c6e775fb9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:16.820213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:16.900221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c875d-a1bc-4669-8ae3-9e8c6e775fb9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:16.939653 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b9c11-267a-44ea-9f33-5c6c941f6b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:16.940205 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b9c11-267a-44ea-9f33-5c6c941f6b80 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:16.940546 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b9c11-267a-44ea-9f33-5c6c941f6b80 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:16.940768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b9c11-267a-44ea-9f33-5c6c941f6b80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:16.951149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b9c11-267a-44ea-9f33-5c6c941f6b80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:16.952747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b9c11-267a-44ea-9f33-5c6c941f6b80 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-246b9c11-267a-44ea-9f33-5c6c941f6b80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:35:16.968594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:16.969747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:16.971076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:35:16.971076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:35:16.971076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:16.971076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:16.971076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 618/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:16.977526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957d61a-e1eb-4d12-a577-79d1b7dd26b6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:17.080297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:17.087765 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957d61a-e1eb-4d12-a577-79d1b7dd26b6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:17.125255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800a5d0-5a89-4d82-93e5-1efdcf20755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:17.125946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800a5d0-5a89-4d82-93e5-1efdcf20755a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:17.126229 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800a5d0-5a89-4d82-93e5-1efdcf20755a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:17.126509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800a5d0-5a89-4d82-93e5-1efdcf20755a None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:17.127222 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800a5d0-5a89-4d82-93e5-1efdcf20755a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:17.127544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800a5d0-5a89-4d82-93e5-1efdcf20755a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:17.128910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800a5d0-5a89-4d82-93e5-1efdcf20755a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:17.141802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 625/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:17.147837 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b9c11-267a-44ea-9f33-5c6c941f6b80 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:17.234461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:17.263120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b9c11-267a-44ea-9f33-5c6c941f6b80 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:17.297308 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b7e4d-0f37-4d6e-94dd-d46cdff24c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:17.298151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b7e4d-0f37-4d6e-94dd-d46cdff24c94 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:17.298432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b7e4d-0f37-4d6e-94dd-d46cdff24c94 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:17.298705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b7e4d-0f37-4d6e-94dd-d46cdff24c94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:17.307138 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b7e4d-0f37-4d6e-94dd-d46cdff24c94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:17.309028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b7e4d-0f37-4d6e-94dd-d46cdff24c94 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-186b7e4d-0f37-4d6e-94dd-d46cdff24c94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:35:17.321824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:17.323483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:17.324779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:35:17.324779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:35:17.324779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:35:17.324779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:35:17.324779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:35:17.324779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:35:17.324779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:35:17.324779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:17.324779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 619/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:35:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:17.329166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800a5d0-5a89-4d82-93e5-1efdcf20755a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:17.440143 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800a5d0-5a89-4d82-93e5-1efdcf20755a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:17.478275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee6035-eae6-4353-9c50-db09c2ab8594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:17.479008 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee6035-eae6-4353-9c50-db09c2ab8594 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:17.479176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee6035-eae6-4353-9c50-db09c2ab8594 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:17.479555 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee6035-eae6-4353-9c50-db09c2ab8594 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:17.480210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee6035-eae6-4353-9c50-db09c2ab8594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:17.480513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee6035-eae6-4353-9c50-db09c2ab8594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:17.481995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee6035-eae6-4353-9c50-db09c2ab8594 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:17.494848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 626/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:35:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:35:17.501222 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b7e4d-0f37-4d6e-94dd-d46cdff24c94 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:17.621468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b7e4d-0f37-4d6e-94dd-d46cdff24c94 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:17.660219 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd364758-f895-4468-aeb9-0e73dc5c146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:17.660798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364758-f895-4468-aeb9-0e73dc5c146d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:17.661076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364758-f895-4468-aeb9-0e73dc5c146d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:17.661381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd364758-f895-4468-aeb9-0e73dc5c146d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:17.662171 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd364758-f895-4468-aeb9-0e73dc5c146d None admin] RBAC: Adding query filter params (role.id=4afb03ef7ba64a1fabaf9b59249d9a15, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=629b38364f6a414aa14123c0749ba164) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:17.662478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd364758-f895-4468-aeb9-0e73dc5c146d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:17.663961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd364758-f895-4468-aeb9-0e73dc5c146d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:17.685318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 620/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:35:17 2022] GET /identity/v3/role_assignments?user.id=629b38364f6a414aa14123c0749ba164&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=4afb03ef7ba64a1fabaf9b59249d9a15 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:35:19.971357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f7a58-d3e0-48f7-99e1-eaaf99372e7d None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:19.971891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f7a58-d3e0-48f7-99e1-eaaf99372e7d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:19.971891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f7a58-d3e0-48f7-99e1-eaaf99372e7d None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:19.973273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 627/1247] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:35:19.979341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97f4be-62c6-4f7b-8110-daa2b6983640 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:19.979874 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97f4be-62c6-4f7b-8110-daa2b6983640 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:19.979874 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97f4be-62c6-4f7b-8110-daa2b6983640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:19.987744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:20.001429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1b97f4be-62c6-4f7b-8110-daa2b6983640 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:35:20.002731 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1b97f4be-62c6-4f7b-8110-daa2b6983640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:35:20.076263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 621/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:35:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:35:20.099653 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f7a58-d3e0-48f7-99e1-eaaf99372e7d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:20.119488 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:20.206551 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f7a58-d3e0-48f7-99e1-eaaf99372e7d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:20.242970 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff53b5c-d948-4b70-8a9e-3b5f711bd06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:20.243521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff53b5c-d948-4b70-8a9e-3b5f711bd06e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:20.243793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff53b5c-d948-4b70-8a9e-3b5f711bd06e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:20.244065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff53b5c-d948-4b70-8a9e-3b5f711bd06e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:20.254864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff53b5c-d948-4b70-8a9e-3b5f711bd06e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-fff53b5c-d948-4b70-8a9e-3b5f711bd06e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:35:20.260479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:20.261759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:20.262798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:20.262798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:20.262798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:20.262798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:20.262798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:35:20.262798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:35:20.262798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:35:20.262798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:35:20.262798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:35:20.262798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:35:20.262798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:35:20.262798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:20.262798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 628/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:35:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:20.267945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97f4be-62c6-4f7b-8110-daa2b6983640 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:20.382867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97f4be-62c6-4f7b-8110-daa2b6983640 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:20.419225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:20.424598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19576f1-3b86-4af1-8485-a191886f5ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:20.425225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19576f1-3b86-4af1-8485-a191886f5ba5 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:20.425536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19576f1-3b86-4af1-8485-a191886f5ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:20.425809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19576f1-3b86-4af1-8485-a191886f5ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:20.426533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19576f1-3b86-4af1-8485-a191886f5ba5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:20.426836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19576f1-3b86-4af1-8485-a191886f5ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:20.428356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19576f1-3b86-4af1-8485-a191886f5ba5 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:20.440034 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 622/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:35:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:35:20.446006 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff53b5c-d948-4b70-8a9e-3b5f711bd06e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:20.533791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:20.562501 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff53b5c-d948-4b70-8a9e-3b5f711bd06e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:20.601391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af5c9c-8e24-4165-9430-64ad82f7e1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:20.602187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af5c9c-8e24-4165-9430-64ad82f7e1b2 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:20.602473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af5c9c-8e24-4165-9430-64ad82f7e1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:20.602737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af5c9c-8e24-4165-9430-64ad82f7e1b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:20.614407 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af5c9c-8e24-4165-9430-64ad82f7e1b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:20.615972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af5c9c-8e24-4165-9430-64ad82f7e1b2 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-74af5c9c-8e24-4165-9430-64ad82f7e1b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:35:20.638610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:20.639620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:20.640744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:35:20.640744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:35:20.640744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:20.640744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:20.640744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 629/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:20.648154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19576f1-3b86-4af1-8485-a191886f5ba5 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:20.759314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19576f1-3b86-4af1-8485-a191886f5ba5 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:20.796337 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98c580-6769-4972-99ef-087f244a3fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:20.796906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98c580-6769-4972-99ef-087f244a3fac None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:20.797192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98c580-6769-4972-99ef-087f244a3fac None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:20.797494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98c580-6769-4972-99ef-087f244a3fac None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:20.798225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98c580-6769-4972-99ef-087f244a3fac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:20.798531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98c580-6769-4972-99ef-087f244a3fac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:20.800085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98c580-6769-4972-99ef-087f244a3fac None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:20.813882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 623/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:35:20.819752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af5c9c-8e24-4165-9430-64ad82f7e1b2 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:20.937680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af5c9c-8e24-4165-9430-64ad82f7e1b2 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:20.966267 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:20.975685 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9075be7-69bb-4984-a2ec-bb3651db019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:20.976391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9075be7-69bb-4984-a2ec-bb3651db019b None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:20.976697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9075be7-69bb-4984-a2ec-bb3651db019b None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:20.977052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9075be7-69bb-4984-a2ec-bb3651db019b None admin] PATH_INFO: `/v3/users/placement` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:20.985779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9075be7-69bb-4984-a2ec-bb3651db019b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:20.987229 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9075be7-69bb-4984-a2ec-bb3651db019b None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-a9075be7-69bb-4984-a2ec-bb3651db019b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:35:21.001706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:21.002891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:21.004003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:21.004003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:21.004003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:35:21.004003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:35:21.004003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:35:21.004003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:35:21.004003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:35:21.004003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:35:21.004003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 02:35:21.004003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:21.004003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 630/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:21.008928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98c580-6769-4972-99ef-087f244a3fac None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:21.070140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:21.115566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98c580-6769-4972-99ef-087f244a3fac None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:21.154986 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc33ed-1dc0-4a31-9e2b-cb462f49bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:21.155834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc33ed-1dc0-4a31-9e2b-cb462f49bb36 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:21.156185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc33ed-1dc0-4a31-9e2b-cb462f49bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:21.156460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc33ed-1dc0-4a31-9e2b-cb462f49bb36 None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:21.157399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc33ed-1dc0-4a31-9e2b-cb462f49bb36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:21.157705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc33ed-1dc0-4a31-9e2b-cb462f49bb36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:21.159256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc33ed-1dc0-4a31-9e2b-cb462f49bb36 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:21.177898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 624/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Tue Jul 26 02:35:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:35:21.184283 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9075be7-69bb-4984-a2ec-bb3651db019b None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:21.297253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9075be7-69bb-4984-a2ec-bb3651db019b None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:21.335415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd273f1f-9669-4523-ab1e-cdea79db502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:21.336499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd273f1f-9669-4523-ab1e-cdea79db502e None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:21.336829 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd273f1f-9669-4523-ab1e-cdea79db502e None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:21.337106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd273f1f-9669-4523-ab1e-cdea79db502e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:21.404995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:21.420336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd273f1f-9669-4523-ab1e-cdea79db502e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:21.421901 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd273f1f-9669-4523-ab1e-cdea79db502e None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:21.529972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 631/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:35:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:35:21.537219 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc33ed-1dc0-4a31-9e2b-cb462f49bb36 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:21.661165 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc33ed-1dc0-4a31-9e2b-cb462f49bb36 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:21.675563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:21.700650 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01e685-75ae-47be-a3b4-80dfd78aaafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:21.701331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01e685-75ae-47be-a3b4-80dfd78aaafb None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:21.701613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01e685-75ae-47be-a3b4-80dfd78aaafb None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:21.701882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01e685-75ae-47be-a3b4-80dfd78aaafb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:21.713243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01e685-75ae-47be-a3b4-80dfd78aaafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:21.714786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01e685-75ae-47be-a3b4-80dfd78aaafb None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-5e01e685-75ae-47be-a3b4-80dfd78aaafb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:35:21.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:21.731607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:21.732709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:35:21.732709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:35:21.732709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:21.732709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:21.737968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 625/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:21.738099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd273f1f-9669-4523-ab1e-cdea79db502e None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:21.827898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:21.840938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd273f1f-9669-4523-ab1e-cdea79db502e None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:21.879174 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecb96e-80f2-4b1d-b5f4-386d30798ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:21.879799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecb96e-80f2-4b1d-b5f4-386d30798ea4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:21.880078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecb96e-80f2-4b1d-b5f4-386d30798ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:21.880345 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecb96e-80f2-4b1d-b5f4-386d30798ea4 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:21.881030 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ecb96e-80f2-4b1d-b5f4-386d30798ea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:21.881362 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ecb96e-80f2-4b1d-b5f4-386d30798ea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:21.882797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ecb96e-80f2-4b1d-b5f4-386d30798ea4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:21.895226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 632/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:21.901067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01e685-75ae-47be-a3b4-80dfd78aaafb None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:22.003835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01e685-75ae-47be-a3b4-80dfd78aaafb None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:22.043159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db3307-e073-49eb-8e48-4a10566a262f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:22.043859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db3307-e073-49eb-8e48-4a10566a262f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:22.044077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db3307-e073-49eb-8e48-4a10566a262f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:22.044351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db3307-e073-49eb-8e48-4a10566a262f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:22.051378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db3307-e073-49eb-8e48-4a10566a262f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:22.052852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db3307-e073-49eb-8e48-4a10566a262f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a8db3307-e073-49eb-8e48-4a10566a262f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:35:22.064356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:22.065432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:22.066335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:35:22.066335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:35:22.066335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:35:22.066335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:35:22.066335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:35:22.066335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:35:22.066335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:35:22.066335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:22.066335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 626/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:35:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:22.071765 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecb96e-80f2-4b1d-b5f4-386d30798ea4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:22.181815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecb96e-80f2-4b1d-b5f4-386d30798ea4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:22.221110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a115b-6b6d-43bd-a564-b7e896941ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:22.221766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a115b-6b6d-43bd-a564-b7e896941ef5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:22.222046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a115b-6b6d-43bd-a564-b7e896941ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:22.222379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a115b-6b6d-43bd-a564-b7e896941ef5 None admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:22.223214 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a115b-6b6d-43bd-a564-b7e896941ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:22.223620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a115b-6b6d-43bd-a564-b7e896941ef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:22.225324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a115b-6b6d-43bd-a564-b7e896941ef5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:22.245766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 633/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:35:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:22.252107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db3307-e073-49eb-8e48-4a10566a262f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:22.281078 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:22.376329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db3307-e073-49eb-8e48-4a10566a262f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:22.425821 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b73e96-9056-4983-acfb-e82209926886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:22.426473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b73e96-9056-4983-acfb-e82209926886 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:22.426780 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b73e96-9056-4983-acfb-e82209926886 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:22.427073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b73e96-9056-4983-acfb-e82209926886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:22.427925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b73e96-9056-4983-acfb-e82209926886 None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=629b38364f6a414aa14123c0749ba164) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:22.428274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b73e96-9056-4983-acfb-e82209926886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:22.429852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b73e96-9056-4983-acfb-e82209926886 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:22.435675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 627/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:35:22 2022] GET /identity/v3/role_assignments?user.id=629b38364f6a414aa14123c0749ba164&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:24.393301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f3745-b6da-4c26-8612-1f8102a6d155 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:24.393855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f3745-b6da-4c26-8612-1f8102a6d155 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:24.393964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f3745-b6da-4c26-8612-1f8102a6d155 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:24.395501 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 634/1261] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:35:24.401865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a834c-3547-4e6a-bee0-0df78b462ef7 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:24.402298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a834c-3547-4e6a-bee0-0df78b462ef7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:24.402443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a834c-3547-4e6a-bee0-0df78b462ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:24.423783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f79a834c-3547-4e6a-bee0-0df78b462ef7 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:35:24.424972 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f79a834c-3547-4e6a-bee0-0df78b462ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:35:24.494669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 628/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:35:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:35:24.517110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f3745-b6da-4c26-8612-1f8102a6d155 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:24.529561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:24.628328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f3745-b6da-4c26-8612-1f8102a6d155 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:24.664484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949725c8-5403-44de-948d-c4929667e3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:24.665052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949725c8-5403-44de-948d-c4929667e3b4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:24.665305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949725c8-5403-44de-948d-c4929667e3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:24.665692 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949725c8-5403-44de-948d-c4929667e3b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:24.676391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949725c8-5403-44de-948d-c4929667e3b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-949725c8-5403-44de-948d-c4929667e3b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:35:24.681369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:24.682438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:24.683355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:24.683355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:24.683355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:24.683355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:24.683355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:35:24.683355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:35:24.683355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:35:24.683355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:35:24.683355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:35:24.683355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:35:24.683355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:35:24.683355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:24.683355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 635/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:35:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:24.688863 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a834c-3547-4e6a-bee0-0df78b462ef7 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:24.710792 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:24.795046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a834c-3547-4e6a-bee0-0df78b462ef7 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:24.832202 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85cbf5-981f-4f1e-81a8-e57514930571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:24.832828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85cbf5-981f-4f1e-81a8-e57514930571 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:24.833106 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85cbf5-981f-4f1e-81a8-e57514930571 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:24.833426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85cbf5-981f-4f1e-81a8-e57514930571 None admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:24.834138 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85cbf5-981f-4f1e-81a8-e57514930571 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:24.834446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85cbf5-981f-4f1e-81a8-e57514930571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:24.835831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85cbf5-981f-4f1e-81a8-e57514930571 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:24.844025 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 629/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:35:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:24.850817 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949725c8-5403-44de-948d-c4929667e3b4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:24.925108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:24.961320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949725c8-5403-44de-948d-c4929667e3b4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:24.998787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419392d2-6b34-438b-99eb-5a7bc78dfb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:24.999410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419392d2-6b34-438b-99eb-5a7bc78dfb25 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:24.999691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419392d2-6b34-438b-99eb-5a7bc78dfb25 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:24.999959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419392d2-6b34-438b-99eb-5a7bc78dfb25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:25.010430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419392d2-6b34-438b-99eb-5a7bc78dfb25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:25.011870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419392d2-6b34-438b-99eb-5a7bc78dfb25 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-419392d2-6b34-438b-99eb-5a7bc78dfb25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:35:25.026553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:25.027563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:25.028787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:35:25.028787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:35:25.028787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:25.028787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:25.028787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 636/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:25.033765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85cbf5-981f-4f1e-81a8-e57514930571 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:25.119595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:25.140188 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85cbf5-981f-4f1e-81a8-e57514930571 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:25.173012 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573bf50-a261-4b61-8397-d3d1a26ec097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:25.173649 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573bf50-a261-4b61-8397-d3d1a26ec097 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:25.173930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573bf50-a261-4b61-8397-d3d1a26ec097 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:25.174204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573bf50-a261-4b61-8397-d3d1a26ec097 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:25.174895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573bf50-a261-4b61-8397-d3d1a26ec097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:25.175251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573bf50-a261-4b61-8397-d3d1a26ec097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:25.176578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4573bf50-a261-4b61-8397-d3d1a26ec097 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:25.189331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 630/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:25.195772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419392d2-6b34-438b-99eb-5a7bc78dfb25 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:25.301675 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419392d2-6b34-438b-99eb-5a7bc78dfb25 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:25.321687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:25.338713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2052d-47aa-48b3-863d-a610c4aef0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:25.339351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2052d-47aa-48b3-863d-a610c4aef0c6 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:25.339631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2052d-47aa-48b3-863d-a610c4aef0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:25.339898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2052d-47aa-48b3-863d-a610c4aef0c6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:25.348599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2052d-47aa-48b3-863d-a610c4aef0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:25.350088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2052d-47aa-48b3-863d-a610c4aef0c6 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-90c2052d-47aa-48b3-863d-a610c4aef0c6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:35:25.361403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:25.362536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:25.363697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:25.363697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:25.363697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:35:25.363697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:35:25.363697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:35:25.363697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:35:25.363697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:35:25.363697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:35:25.363697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 02:35:25.363697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:25.363697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 637/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:25.368819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573bf50-a261-4b61-8397-d3d1a26ec097 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:25.485456 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573bf50-a261-4b61-8397-d3d1a26ec097 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:25.520311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbd639-2b8e-4971-9b64-abfa8708ed1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:25.520917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbd639-2b8e-4971-9b64-abfa8708ed1f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:25.521198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbd639-2b8e-4971-9b64-abfa8708ed1f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:25.521506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbd639-2b8e-4971-9b64-abfa8708ed1f None admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:25.522299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbd639-2b8e-4971-9b64-abfa8708ed1f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:25.522601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbd639-2b8e-4971-9b64-abfa8708ed1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:25.524434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbd639-2b8e-4971-9b64-abfa8708ed1f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:25.533042 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:25.547368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 631/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Tue Jul 26 02:35:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:25.556205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2052d-47aa-48b3-863d-a610c4aef0c6 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:25.666160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2052d-47aa-48b3-863d-a610c4aef0c6 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:25.700950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef451b1d-235f-442c-818a-963e9210125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:25.701608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef451b1d-235f-442c-818a-963e9210125d None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:25.701887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef451b1d-235f-442c-818a-963e9210125d None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:25.702156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef451b1d-235f-442c-818a-963e9210125d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:25.713111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef451b1d-235f-442c-818a-963e9210125d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:25.714591 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef451b1d-235f-442c-818a-963e9210125d None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-ef451b1d-235f-442c-818a-963e9210125d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:35:25.729801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:25.730841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:25.731875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:35:25.731875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:35:25.731875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:25.731875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:25.731875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 638/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:25.736940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbd639-2b8e-4971-9b64-abfa8708ed1f None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:25.840333 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbd639-2b8e-4971-9b64-abfa8708ed1f None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:25.876163 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdc5f6-1f20-4085-aa3b-d5a5fc91d33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:25.876775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdc5f6-1f20-4085-aa3b-d5a5fc91d33b None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:25.877053 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdc5f6-1f20-4085-aa3b-d5a5fc91d33b None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:25.877329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdc5f6-1f20-4085-aa3b-d5a5fc91d33b None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:25.878048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdc5f6-1f20-4085-aa3b-d5a5fc91d33b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:25.878359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdc5f6-1f20-4085-aa3b-d5a5fc91d33b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:25.879727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcdc5f6-1f20-4085-aa3b-d5a5fc91d33b None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:25.890971 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 632/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:25.899503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef451b1d-235f-442c-818a-963e9210125d None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:25.933835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:26.004351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef451b1d-235f-442c-818a-963e9210125d None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:26.038978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667a02a-5dea-4e8f-9f85-72225c7c77ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:26.039627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667a02a-5dea-4e8f-9f85-72225c7c77ee None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:26.039906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667a02a-5dea-4e8f-9f85-72225c7c77ee None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:26.040175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667a02a-5dea-4e8f-9f85-72225c7c77ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:26.047184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667a02a-5dea-4e8f-9f85-72225c7c77ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:26.048631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667a02a-5dea-4e8f-9f85-72225c7c77ee None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-6667a02a-5dea-4e8f-9f85-72225c7c77ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:35:26.060295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:26.061333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:26.062392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:35:26.062392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:35:26.062392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:35:26.062392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:35:26.062392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:35:26.062392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:35:26.062392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:35:26.062392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:26.062392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 639/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:26.067702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdc5f6-1f20-4085-aa3b-d5a5fc91d33b None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:26.132733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:26.178002 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdc5f6-1f20-4085-aa3b-d5a5fc91d33b None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:26.213313 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899c168-d0b4-412c-a825-f1ae13622f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:26.213917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899c168-d0b4-412c-a825-f1ae13622f4d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:26.214195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899c168-d0b4-412c-a825-f1ae13622f4d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:26.214465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899c168-d0b4-412c-a825-f1ae13622f4d None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:26.215212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899c168-d0b4-412c-a825-f1ae13622f4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:26.215516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899c168-d0b4-412c-a825-f1ae13622f4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:26.216952 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899c168-d0b4-412c-a825-f1ae13622f4d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:26.229254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 633/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:35:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:26.235814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667a02a-5dea-4e8f-9f85-72225c7c77ee None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:26.324666 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:26.333834 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667a02a-5dea-4e8f-9f85-72225c7c77ee None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:26.367951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750da4fc-2160-4ef0-a95c-8fb36302d428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:26.368498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750da4fc-2160-4ef0-a95c-8fb36302d428 None admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:26.368761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750da4fc-2160-4ef0-a95c-8fb36302d428 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:26.369026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750da4fc-2160-4ef0-a95c-8fb36302d428 None admin] PATH_INFO: `/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/629b38364f6a414aa14123c0749ba164/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:26.371010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750da4fc-2160-4ef0-a95c-8fb36302d428 None admin] RBAC: Authorizing `identity:create_grant(project_id=b017927d64b44db8a1611f20e6e3b6f5, user_id=629b38364f6a414aa14123c0749ba164, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:26.372426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750da4fc-2160-4ef0-a95c-8fb36302d428 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:26.387293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 640/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 02:35:26 2022] PUT /identity/v3/projects/b017927d64b44db8a1611f20e6e3b6f5/users/629b38364f6a414aa14123c0749ba164/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:35:28.362833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04f72a-d114-4ea2-8fe3-4e9e4b4f9359 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:28.363394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04f72a-d114-4ea2-8fe3-4e9e4b4f9359 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:28.363394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04f72a-d114-4ea2-8fe3-4e9e4b4f9359 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:28.364855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 634/1274] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:35:28.371317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dc28e-acc3-4a94-90d4-6e3612968b5d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:28.371785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dc28e-acc3-4a94-90d4-6e3612968b5d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:28.371997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dc28e-acc3-4a94-90d4-6e3612968b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:28.396228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b99dc28e-acc3-4a94-90d4-6e3612968b5d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:35:28.399100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b99dc28e-acc3-4a94-90d4-6e3612968b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:35:28.471249 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 641/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:35:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:35:28.497891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04f72a-d114-4ea2-8fe3-4e9e4b4f9359 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:28.613178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04f72a-d114-4ea2-8fe3-4e9e4b4f9359 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:28.630871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:28.648447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91343fca-2c3a-450e-8158-c1b00f692dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:28.649088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91343fca-2c3a-450e-8158-c1b00f692dd6 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:28.649394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91343fca-2c3a-450e-8158-c1b00f692dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:28.649662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91343fca-2c3a-450e-8158-c1b00f692dd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:28.660253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91343fca-2c3a-450e-8158-c1b00f692dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-91343fca-2c3a-450e-8158-c1b00f692dd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 02:35:28.665225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:28.666369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:28.667250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:28.667250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:28.667250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:28.667250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:28.667250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 02:35:28.667250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 02:35:28.667250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 02:35:28.667250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 02:35:28.667250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 02:35:28.667250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 02:35:28.667250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 02:35:28.667250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:28.667250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 635/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 02:35:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:28.674539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dc28e-acc3-4a94-90d4-6e3612968b5d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:28.762243 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:28.785255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dc28e-acc3-4a94-90d4-6e3612968b5d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:28.823096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eef403-5e72-4b5b-bd89-698be91083a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:28.823712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef403-5e72-4b5b-bd89-698be91083a8 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:28.823989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef403-5e72-4b5b-bd89-698be91083a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:28.824260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef403-5e72-4b5b-bd89-698be91083a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:28.824981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eef403-5e72-4b5b-bd89-698be91083a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:28.825252 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eef403-5e72-4b5b-bd89-698be91083a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:28.827023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eef403-5e72-4b5b-bd89-698be91083a8 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:28.835271 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 642/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 02:35:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:35:28.841396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91343fca-2c3a-450e-8158-c1b00f692dd6 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:28.944967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91343fca-2c3a-450e-8158-c1b00f692dd6 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:28.989116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1547c-280e-4f64-9b63-c7ddfa9f3857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:28.990116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1547c-280e-4f64-9b63-c7ddfa9f3857 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:28.990855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1547c-280e-4f64-9b63-c7ddfa9f3857 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:28.991230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1547c-280e-4f64-9b63-c7ddfa9f3857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:29.002950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1547c-280e-4f64-9b63-c7ddfa9f3857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:29.004409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1547c-280e-4f64-9b63-c7ddfa9f3857 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-d6b1547c-280e-4f64-9b63-c7ddfa9f3857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:35:29.019990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:29.021015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:29.022271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:35:29.022271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:35:29.022271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:29.022271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:29.022271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 636/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:29.027099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eef403-5e72-4b5b-bd89-698be91083a8 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:29.139012 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eef403-5e72-4b5b-bd89-698be91083a8 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:29.177418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ad99e-bfbb-42fd-9f1c-b26294b805f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:29.178046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ad99e-bfbb-42fd-9f1c-b26294b805f4 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:29.178326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ad99e-bfbb-42fd-9f1c-b26294b805f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:29.178596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ad99e-bfbb-42fd-9f1c-b26294b805f4 None admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:29.179289 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ad99e-bfbb-42fd-9f1c-b26294b805f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:29.179599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ad99e-bfbb-42fd-9f1c-b26294b805f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:29.181085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ad99e-bfbb-42fd-9f1c-b26294b805f4 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:29.192906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 643/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:29.199030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1547c-280e-4f64-9b63-c7ddfa9f3857 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:29.234872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:29.313540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1547c-280e-4f64-9b63-c7ddfa9f3857 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:29.348907 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9aaad-4c70-48c3-b6a7-6dc2cc1dad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:29.349561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9aaad-4c70-48c3-b6a7-6dc2cc1dad26 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:29.349845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9aaad-4c70-48c3-b6a7-6dc2cc1dad26 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:29.350117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9aaad-4c70-48c3-b6a7-6dc2cc1dad26 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:29.357735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9aaad-4c70-48c3-b6a7-6dc2cc1dad26 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:29.359202 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9aaad-4c70-48c3-b6a7-6dc2cc1dad26 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-58e9aaad-4c70-48c3-b6a7-6dc2cc1dad26 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 02:35:29.383050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:29.384614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:29.385822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:29.385822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:29.385822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 02:35:29.385822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 02:35:29.385822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 02:35:29.385822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 02:35:29.385822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 02:35:29.385822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 02:35:29.385822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 02:35:29.385822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:29.385822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 637/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:29.391639 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ad99e-bfbb-42fd-9f1c-b26294b805f4 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:29.396729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:29.514689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ad99e-bfbb-42fd-9f1c-b26294b805f4 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:29.554158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40891e3d-6679-48ad-bba5-4dcb4f918e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:29.555145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40891e3d-6679-48ad-bba5-4dcb4f918e5a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:29.555614 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40891e3d-6679-48ad-bba5-4dcb4f918e5a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:29.556067 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40891e3d-6679-48ad-bba5-4dcb4f918e5a None admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:29.557359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40891e3d-6679-48ad-bba5-4dcb4f918e5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:29.557787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40891e3d-6679-48ad-bba5-4dcb4f918e5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:29.560065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40891e3d-6679-48ad-bba5-4dcb4f918e5a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:29.581090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 644/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Tue Jul 26 02:35:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:35:29.587396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9aaad-4c70-48c3-b6a7-6dc2cc1dad26 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:29.683311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:29.694847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9aaad-4c70-48c3-b6a7-6dc2cc1dad26 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:29.731772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847502df-fccd-4708-9f64-feab89afd393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:29.732378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847502df-fccd-4708-9f64-feab89afd393 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:29.732666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847502df-fccd-4708-9f64-feab89afd393 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:29.732935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847502df-fccd-4708-9f64-feab89afd393 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:29.801538 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847502df-fccd-4708-9f64-feab89afd393 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:29.802919 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847502df-fccd-4708-9f64-feab89afd393 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:29.894245 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:29.904701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 638/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 02:35:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 02:35:29.910818 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40891e3d-6679-48ad-bba5-4dcb4f918e5a None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:29.974229 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:30.013782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40891e3d-6679-48ad-bba5-4dcb4f918e5a None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:30.048485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f48355-5b3b-4967-a50a-87c8daaa6bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:30.049106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f48355-5b3b-4967-a50a-87c8daaa6bfc None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:30.049416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f48355-5b3b-4967-a50a-87c8daaa6bfc None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:30.049686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f48355-5b3b-4967-a50a-87c8daaa6bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:30.060399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f48355-5b3b-4967-a50a-87c8daaa6bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:30.061812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f48355-5b3b-4967-a50a-87c8daaa6bfc None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-00f48355-5b3b-4967-a50a-87c8daaa6bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 02:35:30.076645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:30.077707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:30.078736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 02:35:30.078736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 02:35:30.078736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 02:35:30.078736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:30.078736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 645/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 02:35:30.085775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847502df-fccd-4708-9f64-feab89afd393 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:30.186866 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847502df-fccd-4708-9f64-feab89afd393 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:30.225764 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bca46-2cd6-4284-8d9d-f5cd9ee3e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:30.226366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bca46-2cd6-4284-8d9d-f5cd9ee3e527 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:30.226677 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bca46-2cd6-4284-8d9d-f5cd9ee3e527 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:30.226984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bca46-2cd6-4284-8d9d-f5cd9ee3e527 None admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:30.227671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bca46-2cd6-4284-8d9d-f5cd9ee3e527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:30.227974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bca46-2cd6-4284-8d9d-f5cd9ee3e527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:30.229334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bca46-2cd6-4284-8d9d-f5cd9ee3e527 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:30.240548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 639/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 02:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:30.249567 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f48355-5b3b-4967-a50a-87c8daaa6bfc None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:30.370268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f48355-5b3b-4967-a50a-87c8daaa6bfc None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:30.384840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:30.406737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815607b3-9955-45a1-b3e3-a4134c30e2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:30.407370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815607b3-9955-45a1-b3e3-a4134c30e2e5 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:30.407642 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815607b3-9955-45a1-b3e3-a4134c30e2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:30.407913 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815607b3-9955-45a1-b3e3-a4134c30e2e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:30.414813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815607b3-9955-45a1-b3e3-a4134c30e2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:30.416268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815607b3-9955-45a1-b3e3-a4134c30e2e5 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application [None req-815607b3-9955-45a1-b3e3-a4134c30e2e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 02:35:30.428582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:30.429608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:30.430583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 02:35:30.430583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 02:35:30.430583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 02:35:30.430583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 02:35:30.430583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 02:35:30.430583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 02:35:30.430583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 02:35:30.430583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: ERROR keystone.server.flask.application Jul 26 02:35:30.430583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 646/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 02:35:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:30.436122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bca46-2cd6-4284-8d9d-f5cd9ee3e527 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:30.494161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:30.555621 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bca46-2cd6-4284-8d9d-f5cd9ee3e527 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:30.592031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e449b2-edd5-4150-a9d7-06c389d5194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:30.592647 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e449b2-edd5-4150-a9d7-06c389d5194d None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:30.592932 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e449b2-edd5-4150-a9d7-06c389d5194d None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:30.593203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e449b2-edd5-4150-a9d7-06c389d5194d None admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:30.593992 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e449b2-edd5-4150-a9d7-06c389d5194d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:30.594303 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e449b2-edd5-4150-a9d7-06c389d5194d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:30.596095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e449b2-edd5-4150-a9d7-06c389d5194d None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:30.608066 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 640/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 02:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:30.614410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815607b3-9955-45a1-b3e3-a4134c30e2e5 None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:30.714625 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815607b3-9955-45a1-b3e3-a4134c30e2e5 None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:30.749426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4daa98-80d7-4a3c-bf37-56ea3de428dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:30.750041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4daa98-80d7-4a3c-bf37-56ea3de428dd None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:30.750274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4daa98-80d7-4a3c-bf37-56ea3de428dd None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:30.750556 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4daa98-80d7-4a3c-bf37-56ea3de428dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:30.751323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4daa98-80d7-4a3c-bf37-56ea3de428dd None admin] RBAC: Adding query filter params (role.id=e87a5d13c5ba4f4eabc7a23803868dbf, scope.project.id=b017927d64b44db8a1611f20e6e3b6f5, user.id=629b38364f6a414aa14123c0749ba164) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:30.751629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4daa98-80d7-4a3c-bf37-56ea3de428dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:30.753039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4daa98-80d7-4a3c-bf37-56ea3de428dd None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:30.759027 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 647/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 02:35:30 2022] GET /identity/v3/role_assignments?user.id=629b38364f6a414aa14123c0749ba164&scope.project.id=b017927d64b44db8a1611f20e6e3b6f5&role.id=e87a5d13c5ba4f4eabc7a23803868dbf => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:32.765712 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c971950-ada0-4029-ab41-85e36ffd2188 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:32.766613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c971950-ada0-4029-ab41-85e36ffd2188 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:32.766613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c971950-ada0-4029-ab41-85e36ffd2188 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:32.768882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 641/1288] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:35:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:35:32.775304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389028a-7730-4555-b089-ebbd741b3d61 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:32.775733 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389028a-7730-4555-b089-ebbd741b3d61 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:32.775843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389028a-7730-4555-b089-ebbd741b3d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:32.799829 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6389028a-7730-4555-b089-ebbd741b3d61 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:35:32.801022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6389028a-7730-4555-b089-ebbd741b3d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:35:32.832208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:32.879953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 648/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:35:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:35:32.903223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c971950-ada0-4029-ab41-85e36ffd2188 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:33.013630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c971950-ada0-4029-ab41-85e36ffd2188 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:33.024549 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:33.050558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdaf41-a113-425f-9b39-909bbb1fb4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:33.051190 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdaf41-a113-425f-9b39-909bbb1fb4f9 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:33.051468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdaf41-a113-425f-9b39-909bbb1fb4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:33.051742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdaf41-a113-425f-9b39-909bbb1fb4f9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:33.052372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdaf41-a113-425f-9b39-909bbb1fb4f9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:33.053798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdaf41-a113-425f-9b39-909bbb1fb4f9 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-a9fdaf41-a113-425f-9b39-909bbb1fb4f9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:33.063169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:33.064351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:33.065249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 642/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 02:35:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:33.070813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389028a-7730-4555-b089-ebbd741b3d61 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:33.188762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389028a-7730-4555-b089-ebbd741b3d61 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:33.227668 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1b293-eae1-4b0c-b741-1c8f5c2b8b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:33.228268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1b293-eae1-4b0c-b741-1c8f5c2b8b52 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:33.228546 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1b293-eae1-4b0c-b741-1c8f5c2b8b52 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:33.228813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1b293-eae1-4b0c-b741-1c8f5c2b8b52 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:33.229520 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1b293-eae1-4b0c-b741-1c8f5c2b8b52 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:33.229826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1b293-eae1-4b0c-b741-1c8f5c2b8b52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:33.231186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1b293-eae1-4b0c-b741-1c8f5c2b8b52 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:33.236111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 649/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Tue Jul 26 02:35:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:33.242379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdaf41-a113-425f-9b39-909bbb1fb4f9 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:33.344380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdaf41-a113-425f-9b39-909bbb1fb4f9 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:33.384627 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e99830-5e10-43fb-9346-329ad6122d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:33.385377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99830-5e10-43fb-9346-329ad6122d79 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:33.385620 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99830-5e10-43fb-9346-329ad6122d79 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:33.385895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e99830-5e10-43fb-9346-329ad6122d79 None admin] PATH_INFO: `/v3/services` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:33.386667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e99830-5e10-43fb-9346-329ad6122d79 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:33.386969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e99830-5e10-43fb-9346-329ad6122d79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:33.388578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e99830-5e10-43fb-9346-329ad6122d79 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:33.394152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 643/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Tue Jul 26 02:35:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:35.365976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef842bc-7bfa-46be-82e1-3e81807cac26 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:35.366640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef842bc-7bfa-46be-82e1-3e81807cac26 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:35.366640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef842bc-7bfa-46be-82e1-3e81807cac26 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:35.368083 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 650/1293] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:35:35.374388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94086787-8bdf-439a-af25-4f12fde02373 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:35.374841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94086787-8bdf-439a-af25-4f12fde02373 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:35.374948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94086787-8bdf-439a-af25-4f12fde02373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:35.397891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-94086787-8bdf-439a-af25-4f12fde02373 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:35:35.399108 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-94086787-8bdf-439a-af25-4f12fde02373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:35:35.433606 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:35.473149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 644/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:35:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:35:35.495753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef842bc-7bfa-46be-82e1-3e81807cac26 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:35.529917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:35.612510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef842bc-7bfa-46be-82e1-3e81807cac26 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:35.653927 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b980aaa-dd60-40c6-b759-bd9644872857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:35.654541 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980aaa-dd60-40c6-b759-bd9644872857 None admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:35.654822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980aaa-dd60-40c6-b759-bd9644872857 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:35.655092 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b980aaa-dd60-40c6-b759-bd9644872857 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:35.655887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b980aaa-dd60-40c6-b759-bd9644872857 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:35.657265 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b980aaa-dd60-40c6-b759-bd9644872857 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:35.674227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 651/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 02:35:35 2022] POST /identity/v3/services => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:35:37.689508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7165f8-b986-410e-bdf1-e69a6bd051c9 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:37.690285 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7165f8-b986-410e-bdf1-e69a6bd051c9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:37.690409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7165f8-b986-410e-bdf1-e69a6bd051c9 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:37.692572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 645/1296] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:35:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:35:37.698939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7496d-0194-4414-be55-9d8c3e1e8226 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:37.699374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7496d-0194-4414-be55-9d8c3e1e8226 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:37.699492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7496d-0194-4414-be55-9d8c3e1e8226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:37.727860 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-31e7496d-0194-4414-be55-9d8c3e1e8226 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:35:37.729068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-31e7496d-0194-4414-be55-9d8c3e1e8226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:35:37.805028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 652/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:35:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:35:37.827803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7165f8-b986-410e-bdf1-e69a6bd051c9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:37.937078 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7165f8-b986-410e-bdf1-e69a6bd051c9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:37.971929 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e2822-10a5-4daa-a7ce-7dc4977fd959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:37.972557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e2822-10a5-4daa-a7ce-7dc4977fd959 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:37.972831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e2822-10a5-4daa-a7ce-7dc4977fd959 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:37.973094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e2822-10a5-4daa-a7ce-7dc4977fd959 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:37.973751 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e2822-10a5-4daa-a7ce-7dc4977fd959 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:37.975107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067e2822-10a5-4daa-a7ce-7dc4977fd959 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-067e2822-10a5-4daa-a7ce-7dc4977fd959 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:37.984122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:37.985263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:37.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 646/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 02:35:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:37.991700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7496d-0194-4414-be55-9d8c3e1e8226 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:38.010743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:38.099649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7496d-0194-4414-be55-9d8c3e1e8226 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:38.136718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b66fac-c243-4c5f-9815-1e814456d36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:38.137333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66fac-c243-4c5f-9815-1e814456d36f None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:38.137630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66fac-c243-4c5f-9815-1e814456d36f None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:38.137910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66fac-c243-4c5f-9815-1e814456d36f None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:38.138593 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b66fac-c243-4c5f-9815-1e814456d36f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:38.138899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b66fac-c243-4c5f-9815-1e814456d36f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:38.140266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b66fac-c243-4c5f-9815-1e814456d36f None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:38.145677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 653/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Tue Jul 26 02:35:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:38.152867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e2822-10a5-4daa-a7ce-7dc4977fd959 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:38.187465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:38.260160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e2822-10a5-4daa-a7ce-7dc4977fd959 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:38.296520 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75b0cd-5051-440e-87d7-8e9e2e39ea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:38.297134 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75b0cd-5051-440e-87d7-8e9e2e39ea1f None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:38.297447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75b0cd-5051-440e-87d7-8e9e2e39ea1f None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:38.297717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75b0cd-5051-440e-87d7-8e9e2e39ea1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:38.298465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75b0cd-5051-440e-87d7-8e9e2e39ea1f None admin] RBAC: Adding query filter params (interface=public, service_id=40fbedeae60f46ec9584ca161f388101, region_id=RegionOne) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:38.298768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75b0cd-5051-440e-87d7-8e9e2e39ea1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:38.300141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75b0cd-5051-440e-87d7-8e9e2e39ea1f None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:38.305452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 647/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 02:35:38 2022] GET /identity/v3/endpoints?service_id=40fbedeae60f46ec9584ca161f388101&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:38.311468 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b66fac-c243-4c5f-9815-1e814456d36f None admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:38.405219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:38.426793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b66fac-c243-4c5f-9815-1e814456d36f None admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:38.468657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e42b0-e166-4553-87ff-a41df24ba123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:38.469202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e42b0-e166-4553-87ff-a41df24ba123 None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:38.469514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e42b0-e166-4553-87ff-a41df24ba123 None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:38.470141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e42b0-e166-4553-87ff-a41df24ba123 None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:38.470796 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e42b0-e166-4553-87ff-a41df24ba123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:38.472163 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e42b0-e166-4553-87ff-a41df24ba123 None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:38.479138 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 654/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 02:35:38 2022] GET /identity/v3/services => generated 2191 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:35:40.446285 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e8b4-1b8b-4ebc-8825-8cb9c1d66ad2 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:40.447206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e8b4-1b8b-4ebc-8825-8cb9c1d66ad2 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:40.447206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e8b4-1b8b-4ebc-8825-8cb9c1d66ad2 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:40.449340 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 648/1302] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:35:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:35:40.455562 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db6816-aebe-47d1-b38c-94be610e653c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:40.456343 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db6816-aebe-47d1-b38c-94be610e653c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:40.456500 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db6816-aebe-47d1-b38c-94be610e653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:40.477179 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-59db6816-aebe-47d1-b38c-94be610e653c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:35:40.478395 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-59db6816-aebe-47d1-b38c-94be610e653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:35:40.547887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 655/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:35:40 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 02:35:40.573531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3e8b4-1b8b-4ebc-8825-8cb9c1d66ad2 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:40.684101 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:40.696465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3e8b4-1b8b-4ebc-8825-8cb9c1d66ad2 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:40.733203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6f91-6235-44ca-9e98-adac10109c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:40.733869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6f91-6235-44ca-9e98-adac10109c99 None admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:40.734151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6f91-6235-44ca-9e98-adac10109c99 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:40.734427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6f91-6235-44ca-9e98-adac10109c99 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:40.735056 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa6f91-6235-44ca-9e98-adac10109c99 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:40.736436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa6f91-6235-44ca-9e98-adac10109c99 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application [None req-b8fa6f91-6235-44ca-9e98-adac10109c99 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 02:35:40.749678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 02:35:40.750819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application with Lock( Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self._enter() Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application return self.creator() Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application created_value = creator( Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: ERROR keystone.server.flask.application Jul 26 02:35:40.751702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 649/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 02:35:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 02:35:40.758826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db6816-aebe-47d1-b38c-94be610e653c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:40.837840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:40.862346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db6816-aebe-47d1-b38c-94be610e653c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:40.897573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb6885-1a20-4371-8ee3-ddaba6a0a30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:40.898212 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb6885-1a20-4371-8ee3-ddaba6a0a30a None admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:40.898490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb6885-1a20-4371-8ee3-ddaba6a0a30a None admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:40.898764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb6885-1a20-4371-8ee3-ddaba6a0a30a None admin] PATH_INFO: `/v3/services` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:40.899435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb6885-1a20-4371-8ee3-ddaba6a0a30a None admin] RBAC: Adding query filter params (name=placement) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:35:40.899738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb6885-1a20-4371-8ee3-ddaba6a0a30a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:40.901102 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb6885-1a20-4371-8ee3-ddaba6a0a30a None admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:40.906475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 656/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Tue Jul 26 02:35:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:35:40.915456 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6f91-6235-44ca-9e98-adac10109c99 None admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:35:41.029264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6f91-6235-44ca-9e98-adac10109c99 None admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:35:41.064160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336875a5-15d9-4ca5-a806-65c719ddf831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:35:41.064768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336875a5-15d9-4ca5-a806-65c719ddf831 None admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:35:41.065047 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336875a5-15d9-4ca5-a806-65c719ddf831 None admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:35:41.065332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336875a5-15d9-4ca5-a806-65c719ddf831 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:35:41.066053 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336875a5-15d9-4ca5-a806-65c719ddf831 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:35:41.067428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336875a5-15d9-4ca5-a806-65c719ddf831 None admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:35:41.091461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 650/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:35:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:35:50.903513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=30 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:35:51.086843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:36:43.932393 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c645f-fed2-4e10-af83-55143421dfbc None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:43.932970 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c645f-fed2-4e10-af83-55143421dfbc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:43.932970 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c645f-fed2-4e10-af83-55143421dfbc None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:43.939693 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917c5ef-7f9a-44a0-b714-369c5281d643 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:43.940146 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917c5ef-7f9a-44a0-b714-369c5281d643 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:43.940236 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917c5ef-7f9a-44a0-b714-369c5281d643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:43.945307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 657/1307] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:36:43 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:36:44.080271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4917c5ef-7f9a-44a0-b714-369c5281d643 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:36:44.082096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4917c5ef-7f9a-44a0-b714-369c5281d643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:44.234827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 651/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:36:44.274808 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0c63c-dfa7-44be-8343-c0f916179565 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:44.275133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0c63c-dfa7-44be-8343-c0f916179565 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:44.275508 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0c63c-dfa7-44be-8343-c0f916179565 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:44.277217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 658/1309] 10.222.0.39 () {54 vars in 965 bytes} [Tue Jul 26 02:36:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:36:44.283469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6b12c-4eb5-4f92-bf30-7fcefea576a9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:44.283959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6b12c-4eb5-4f92-bf30-7fcefea576a9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:44.284368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6b12c-4eb5-4f92-bf30-7fcefea576a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:44.400477 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d4c6b12c-4eb5-4f92-bf30-7fcefea576a9 None None] MFA Rules not processed for user `fe228871a7fd4a9bb15645955ff365c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:36:44.401888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d4c6b12c-4eb5-4f92-bf30-7fcefea576a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:44.427626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:36:44.501907 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 652/1310] 10.222.0.39 () {58 vars in 1062 bytes} [Tue Jul 26 02:36:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:36:44.511056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0c63c-dfa7-44be-8343-c0f916179565 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:36:44.513019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c1c0c63c-dfa7-44be-8343-c0f916179565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:44.646243 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0c63c-dfa7-44be-8343-c0f916179565 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:36:44.727728 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bb149-58c9-4e20-8090-43cca66a7296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:36:44.728540 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb149-58c9-4e20-8090-43cca66a7296 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:44.728925 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb149-58c9-4e20-8090-43cca66a7296 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:44.729313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bb149-58c9-4e20-8090-43cca66a7296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:44.731186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d73bb149-58c9-4e20-8090-43cca66a7296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:44.790208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:36:44.850446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bb149-58c9-4e20-8090-43cca66a7296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:36:44.852082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bb149-58c9-4e20-8090-43cca66a7296 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:36:44.874695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 659/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:36:47.208202 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b9678-2545-4515-875b-c5eb57304beb None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:47.208807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b9678-2545-4515-875b-c5eb57304beb None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:47.208807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b9678-2545-4515-875b-c5eb57304beb None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:47.210233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 653/1312] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:36:47.215905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61281cd-2689-472d-beb4-2c8ef23a8672 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:47.216330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61281cd-2689-472d-beb4-2c8ef23a8672 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:47.216519 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61281cd-2689-472d-beb4-2c8ef23a8672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:47.301656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b61281cd-2689-472d-beb4-2c8ef23a8672 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:36:47.302889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b61281cd-2689-472d-beb4-2c8ef23a8672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:47.408246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 660/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:36:47.446908 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b9678-2545-4515-875b-c5eb57304beb None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:36:47.448468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-262b9678-2545-4515-875b-c5eb57304beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:47.557270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b9678-2545-4515-875b-c5eb57304beb None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:36:47.635420 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:36:47.638187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99bab1a-e3f2-4e22-be92-7a29016517ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:36:47.638822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bab1a-e3f2-4e22-be92-7a29016517ce service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:47.639104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bab1a-e3f2-4e22-be92-7a29016517ce service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:47.639650 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99bab1a-e3f2-4e22-be92-7a29016517ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:47.641786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f99bab1a-e3f2-4e22-be92-7a29016517ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:47.753594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bab1a-e3f2-4e22-be92-7a29016517ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:36:47.755064 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99bab1a-e3f2-4e22-be92-7a29016517ce service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:36:47.773853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 654/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:36:50.052403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168080-fa0b-426a-9760-36b23bd1d758 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:50.052916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168080-fa0b-426a-9760-36b23bd1d758 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:50.052916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29168080-fa0b-426a-9760-36b23bd1d758 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:50.054518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 661/1315] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:36:50.060032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c8728-2ed8-4007-9d73-375811dc9ef7 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:50.060504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c8728-2ed8-4007-9d73-375811dc9ef7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:50.060599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c8728-2ed8-4007-9d73-375811dc9ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:50.130615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-415c8728-2ed8-4007-9d73-375811dc9ef7 None None] MFA Rules not processed for user `1eca276b92bb4be3aaab7d47e762f25d`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:36:50.131794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-415c8728-2ed8-4007-9d73-375811dc9ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:50.185749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:36:50.232040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 655/1316] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:36:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:36:50.274873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29168080-fa0b-426a-9760-36b23bd1d758 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:36:50.277395 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-29168080-fa0b-426a-9760-36b23bd1d758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:50.291266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:36:50.391006 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29168080-fa0b-426a-9760-36b23bd1d758 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:36:50.484466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316faccd-adad-4835-bc7a-c978fb339a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:36:50.485124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316faccd-adad-4835-bc7a-c978fb339a47 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:50.485444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316faccd-adad-4835-bc7a-c978fb339a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:50.485707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316faccd-adad-4835-bc7a-c978fb339a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:50.487350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-316faccd-adad-4835-bc7a-c978fb339a47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:50.551782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:36:50.602847 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316faccd-adad-4835-bc7a-c978fb339a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:36:50.604273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316faccd-adad-4835-bc7a-c978fb339a47 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:36:50.622747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 662/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:36:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:36:53.148402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efb27d-d23f-42e8-97bd-43f55a07e3bc None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:53.149232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efb27d-d23f-42e8-97bd-43f55a07e3bc None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:53.149232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efb27d-d23f-42e8-97bd-43f55a07e3bc None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:53.151346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 656/1318] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:36:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:36:53.157692 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0efdcf-9fbe-4d1a-83b3-dcebe94ec836 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:53.158330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0efdcf-9fbe-4d1a-83b3-dcebe94ec836 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:53.158455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0efdcf-9fbe-4d1a-83b3-dcebe94ec836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:53.233840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1f0efdcf-9fbe-4d1a-83b3-dcebe94ec836 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:36:53.235078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1f0efdcf-9fbe-4d1a-83b3-dcebe94ec836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:53.334799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 663/1319] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:36:53.374058 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efb27d-d23f-42e8-97bd-43f55a07e3bc None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:36:53.375743 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-92efb27d-d23f-42e8-97bd-43f55a07e3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:53.484329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efb27d-d23f-42e8-97bd-43f55a07e3bc None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:36:53.564094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24097e15-9134-452d-88a2-686671ff104e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:36:53.564710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24097e15-9134-452d-88a2-686671ff104e service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:53.564983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24097e15-9134-452d-88a2-686671ff104e service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:53.565250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24097e15-9134-452d-88a2-686671ff104e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:53.566899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-24097e15-9134-452d-88a2-686671ff104e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:53.575694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:36:53.685097 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24097e15-9134-452d-88a2-686671ff104e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:36:53.686579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24097e15-9134-452d-88a2-686671ff104e service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:36:53.705953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 657/1320] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:36:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:36:56.391267 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7258031-6965-49b8-bff4-ac87efda3eab None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:56.391838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7258031-6965-49b8-bff4-ac87efda3eab None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:56.391838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7258031-6965-49b8-bff4-ac87efda3eab None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:56.393237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 664/1321] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:36:56.398569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9db69-581d-4b65-ab26-1ab2cf1b4214 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:56.399018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9db69-581d-4b65-ab26-1ab2cf1b4214 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:56.399126 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9db69-581d-4b65-ab26-1ab2cf1b4214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:56.466115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d2e9db69-581d-4b65-ab26-1ab2cf1b4214 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:36:56.467679 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d2e9db69-581d-4b65-ab26-1ab2cf1b4214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:56.529106 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:36:56.574531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 658/1322] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:36:56.625869 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07f2d9-f49b-44aa-8d8b-dbc37227e7fc None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:56.626150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07f2d9-f49b-44aa-8d8b-dbc37227e7fc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:56.626428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07f2d9-f49b-44aa-8d8b-dbc37227e7fc None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:56.627810 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 665/1323] 10.222.0.39 () {54 vars in 965 bytes} [Tue Jul 26 02:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:36:56.634437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d63ef-6bc0-4cc7-a4a5-e8dbf4b10cae None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:56.634727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d63ef-6bc0-4cc7-a4a5-e8dbf4b10cae None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:56.635001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d63ef-6bc0-4cc7-a4a5-e8dbf4b10cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:56.717619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2b8d63ef-6bc0-4cc7-a4a5-e8dbf4b10cae None None] MFA Rules not processed for user `fe228871a7fd4a9bb15645955ff365c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:36:56.718887 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2b8d63ef-6bc0-4cc7-a4a5-e8dbf4b10cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:56.798186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 659/1324] 10.222.0.39 () {58 vars in 1062 bytes} [Tue Jul 26 02:36:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:36:56.807589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07f2d9-f49b-44aa-8d8b-dbc37227e7fc None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:36:56.809130 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ed07f2d9-f49b-44aa-8d8b-dbc37227e7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:56.829046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:36:56.915679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07f2d9-f49b-44aa-8d8b-dbc37227e7fc None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:36:56.989909 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0a29a-8a97-4755-a849-822f49a2084d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:36:56.990486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0a29a-8a97-4755-a849-822f49a2084d service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:56.990779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0a29a-8a97-4755-a849-822f49a2084d service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:56.991047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0a29a-8a97-4755-a849-822f49a2084d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:56.992673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9de0a29a-8a97-4755-a849-822f49a2084d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:57.065116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:36:57.105070 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0a29a-8a97-4755-a849-822f49a2084d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:36:57.106596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0a29a-8a97-4755-a849-822f49a2084d service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:36:57.127128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 666/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:36:59.372140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb9e70-0a8c-4d34-a5fe-e15ad9ba913d None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:59.372806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb9e70-0a8c-4d34-a5fe-e15ad9ba913d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:59.372806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb9e70-0a8c-4d34-a5fe-e15ad9ba913d None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:59.374319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 660/1326] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:36:59.380308 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba718-3592-4b57-8d11-ff5dc8284e8b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:59.380866 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba718-3592-4b57-8d11-ff5dc8284e8b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:59.380866 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ba718-3592-4b57-8d11-ff5dc8284e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:59.448517 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-df7ba718-3592-4b57-8d11-ff5dc8284e8b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:36:59.449776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-df7ba718-3592-4b57-8d11-ff5dc8284e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:59.550067 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 667/1327] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:36:59.587252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb9e70-0a8c-4d34-a5fe-e15ad9ba913d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:36:59.588843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-61eb9e70-0a8c-4d34-a5fe-e15ad9ba913d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:59.654793 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:36:59.701710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb9e70-0a8c-4d34-a5fe-e15ad9ba913d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:36:59.778110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e5748-afc1-4312-8f0b-6ac45af7d7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:36:59.778728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e5748-afc1-4312-8f0b-6ac45af7d7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:36:59.778967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e5748-afc1-4312-8f0b-6ac45af7d7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:36:59.779270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e5748-afc1-4312-8f0b-6ac45af7d7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:36:59.780921 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-601e5748-afc1-4312-8f0b-6ac45af7d7f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:36:59.894272 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:36:59.896298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e5748-afc1-4312-8f0b-6ac45af7d7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:36:59.897996 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e5748-afc1-4312-8f0b-6ac45af7d7f9 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:36:59.917703 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 661/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:01.968509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0accd-a3b0-4f4c-982b-72b5726a2669 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:01.968962 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0accd-a3b0-4f4c-982b-72b5726a2669 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:01.969085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0accd-a3b0-4f4c-982b-72b5726a2669 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:01.970506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 668/1329] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:01.975833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9c67a-d174-4374-8ba3-5615b04a611b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:01.976283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9c67a-d174-4374-8ba3-5615b04a611b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:01.976392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9c67a-d174-4374-8ba3-5615b04a611b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:02.043170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c7c9c67a-d174-4374-8ba3-5615b04a611b None None] MFA Rules not processed for user `1eca276b92bb4be3aaab7d47e762f25d`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:02.044386 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c7c9c67a-d174-4374-8ba3-5615b04a611b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:02.164011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 662/1330] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:02.200920 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0accd-a3b0-4f4c-982b-72b5726a2669 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:02.202605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-01d0accd-a3b0-4f4c-982b-72b5726a2669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:02.239915 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:02.313383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0accd-a3b0-4f4c-982b-72b5726a2669 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:02.391338 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f256e5d-8461-476a-9372-63ad8d7c8e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:02.391962 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f256e5d-8461-476a-9372-63ad8d7c8e41 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:02.392240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f256e5d-8461-476a-9372-63ad8d7c8e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:02.392510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f256e5d-8461-476a-9372-63ad8d7c8e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:02.394297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0f256e5d-8461-476a-9372-63ad8d7c8e41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:02.478397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:02.510916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f256e5d-8461-476a-9372-63ad8d7c8e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:02.512352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f256e5d-8461-476a-9372-63ad8d7c8e41 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:02.530577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 669/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:04.918420 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36755c97-ae5a-481c-9ed8-3e68c0834f3c None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:04.919246 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36755c97-ae5a-481c-9ed8-3e68c0834f3c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:04.919246 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36755c97-ae5a-481c-9ed8-3e68c0834f3c None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:04.921359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 663/1332] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:04.930351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85af541-391e-4028-8ad4-9fd6edf2b1d5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:04.930788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85af541-391e-4028-8ad4-9fd6edf2b1d5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:04.930896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85af541-391e-4028-8ad4-9fd6edf2b1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:05.005617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e85af541-391e-4028-8ad4-9fd6edf2b1d5 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:05.006866 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e85af541-391e-4028-8ad4-9fd6edf2b1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:05.113547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 670/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:05.151198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36755c97-ae5a-481c-9ed8-3e68c0834f3c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:05.153681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-36755c97-ae5a-481c-9ed8-3e68c0834f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:05.235988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:05.271578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36755c97-ae5a-481c-9ed8-3e68c0834f3c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:05.356405 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572f3db-afff-4441-8d36-3e09955c9324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:05.357026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572f3db-afff-4441-8d36-3e09955c9324 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:05.357328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572f3db-afff-4441-8d36-3e09955c9324 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:05.357592 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572f3db-afff-4441-8d36-3e09955c9324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:05.359204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1572f3db-afff-4441-8d36-3e09955c9324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:05.490135 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572f3db-afff-4441-8d36-3e09955c9324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:05.491508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572f3db-afff-4441-8d36-3e09955c9324 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:05.501699 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:05.510996 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 664/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:07.539856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ca9d1-e39f-4a03-8cd2-657189b45009 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:07.540426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ca9d1-e39f-4a03-8cd2-657189b45009 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:07.540426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ca9d1-e39f-4a03-8cd2-657189b45009 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:07.541826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 671/1335] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:07.548046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1b5f-89a8-40fd-af0d-41f87751cb60 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:07.548754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1b5f-89a8-40fd-af0d-41f87751cb60 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:07.548895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1b5f-89a8-40fd-af0d-41f87751cb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:07.625303 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-fd4a1b5f-89a8-40fd-af0d-41f87751cb60 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:07.626818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fd4a1b5f-89a8-40fd-af0d-41f87751cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:07.724251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 665/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:07.766339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ca9d1-e39f-4a03-8cd2-657189b45009 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:07.767898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-057ca9d1-e39f-4a03-8cd2-657189b45009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:07.812325 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:07.882478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ca9d1-e39f-4a03-8cd2-657189b45009 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:07.956858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d388d-94c0-460d-8876-3cbb88a67a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:07.957492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d388d-94c0-460d-8876-3cbb88a67a20 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:07.957764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d388d-94c0-460d-8876-3cbb88a67a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:07.958059 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d388d-94c0-460d-8876-3cbb88a67a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:07.959774 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cb5d388d-94c0-460d-8876-3cbb88a67a20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:08.047471 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:08.074236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d388d-94c0-460d-8876-3cbb88a67a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:08.075607 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d388d-94c0-460d-8876-3cbb88a67a20 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:08.095266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 672/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:10.520469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26272395-ef96-469f-8d9a-768ed12bb8ab None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:10.521040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26272395-ef96-469f-8d9a-768ed12bb8ab None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:10.521040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26272395-ef96-469f-8d9a-768ed12bb8ab None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:10.522433 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 666/1338] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:10.527848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f053d8-394a-47ac-8a5b-6c7a4cb9476b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:10.528286 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f053d8-394a-47ac-8a5b-6c7a4cb9476b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:10.528380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f053d8-394a-47ac-8a5b-6c7a4cb9476b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:10.600608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-38f053d8-394a-47ac-8a5b-6c7a4cb9476b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:10.601864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-38f053d8-394a-47ac-8a5b-6c7a4cb9476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:10.703919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 673/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:10.743506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26272395-ef96-469f-8d9a-768ed12bb8ab None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:10.746029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-26272395-ef96-469f-8d9a-768ed12bb8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:10.835824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:10.866925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26272395-ef96-469f-8d9a-768ed12bb8ab None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:10.943208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18799ae1-977a-436a-9bfc-ed639e45e2ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:10.943842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18799ae1-977a-436a-9bfc-ed639e45e2ad service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:10.944118 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18799ae1-977a-436a-9bfc-ed639e45e2ad service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:10.944387 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18799ae1-977a-436a-9bfc-ed639e45e2ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:10.946049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-18799ae1-977a-436a-9bfc-ed639e45e2ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:11.059272 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18799ae1-977a-436a-9bfc-ed639e45e2ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:11.060724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18799ae1-977a-436a-9bfc-ed639e45e2ad service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:11.080280 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 667/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:15.091936 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944f93-7e6d-4366-a3fc-a46eb36e3fb6 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:15.092486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944f93-7e6d-4366-a3fc-a46eb36e3fb6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:15.092486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944f93-7e6d-4366-a3fc-a46eb36e3fb6 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:15.093883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 674/1341] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:15.099274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3e64d-0e34-4b1b-9cf6-a8409a81dd47 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:15.099722 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3e64d-0e34-4b1b-9cf6-a8409a81dd47 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:15.099824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3e64d-0e34-4b1b-9cf6-a8409a81dd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:15.105571 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:15.169023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3ef3e64d-0e34-4b1b-9cf6-a8409a81dd47 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:15.170422 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3ef3e64d-0e34-4b1b-9cf6-a8409a81dd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:15.279261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 668/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:15.322705 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e944f93-7e6d-4366-a3fc-a46eb36e3fb6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:15.324273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7e944f93-7e6d-4366-a3fc-a46eb36e3fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:15.375809 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:15.436199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e944f93-7e6d-4366-a3fc-a46eb36e3fb6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:15.514846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea18df3-e623-4d43-882c-99c1d26ebcce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:15.515471 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18df3-e623-4d43-882c-99c1d26ebcce service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:15.515743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18df3-e623-4d43-882c-99c1d26ebcce service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:15.516007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea18df3-e623-4d43-882c-99c1d26ebcce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:15.517777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fea18df3-e623-4d43-882c-99c1d26ebcce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:15.621317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:15.642509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea18df3-e623-4d43-882c-99c1d26ebcce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:15.643978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea18df3-e623-4d43-882c-99c1d26ebcce service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:15.663283 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 675/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:18.255049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81038179-7fb8-4ce7-b753-a79b20081cee None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:18.255755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81038179-7fb8-4ce7-b753-a79b20081cee None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:18.255755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81038179-7fb8-4ce7-b753-a79b20081cee None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:18.257367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 669/1344] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:37:18.263088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8925-ad40-4181-8160-e95e02763aac None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:18.263676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8925-ad40-4181-8160-e95e02763aac None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:18.263676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e8925-ad40-4181-8160-e95e02763aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:18.341585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-780e8925-ad40-4181-8160-e95e02763aac None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:18.342743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-780e8925-ad40-4181-8160-e95e02763aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:18.443814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 676/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:18.481336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81038179-7fb8-4ce7-b753-a79b20081cee None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:18.482952 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-81038179-7fb8-4ce7-b753-a79b20081cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:18.570417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:18.587679 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81038179-7fb8-4ce7-b753-a79b20081cee None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:18.666754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d7865-d86b-42a0-abfc-b8c8dae08c67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:18.667377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d7865-d86b-42a0-abfc-b8c8dae08c67 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:18.667659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d7865-d86b-42a0-abfc-b8c8dae08c67 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:18.667930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d7865-d86b-42a0-abfc-b8c8dae08c67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:18.669646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-275d7865-d86b-42a0-abfc-b8c8dae08c67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:18.782101 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d7865-d86b-42a0-abfc-b8c8dae08c67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:18.783563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d7865-d86b-42a0-abfc-b8c8dae08c67 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:18.802333 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 670/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:22.768746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bd871-086f-40ec-868a-a52b09467154 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:22.769335 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bd871-086f-40ec-868a-a52b09467154 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:22.769335 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bd871-086f-40ec-868a-a52b09467154 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:22.770734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 677/1347] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:22.776209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e5843-731a-4a94-95e4-36448e808218 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:22.776686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e5843-731a-4a94-95e4-36448e808218 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:22.776767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e5843-731a-4a94-95e4-36448e808218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:22.792489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:22.851534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a12e5843-731a-4a94-95e4-36448e808218 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:22.852356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a12e5843-731a-4a94-95e4-36448e808218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:22.981461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 671/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:23.019492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bd871-086f-40ec-868a-a52b09467154 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:23.021103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f85bd871-086f-40ec-868a-a52b09467154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:23.082552 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:23.134370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bd871-086f-40ec-868a-a52b09467154 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:23.211672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55fc35-b145-4830-83f6-0ad815f3ab9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:23.212306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55fc35-b145-4830-83f6-0ad815f3ab9a service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:23.212589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55fc35-b145-4830-83f6-0ad815f3ab9a service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:23.212896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55fc35-b145-4830-83f6-0ad815f3ab9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:23.214596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ba55fc35-b145-4830-83f6-0ad815f3ab9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:23.327351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:23.331548 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55fc35-b145-4830-83f6-0ad815f3ab9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:23.333014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55fc35-b145-4830-83f6-0ad815f3ab9a service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:23.352259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 678/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:28.119904 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8de3d-1285-429d-9d31-6b5fddeb3824 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:28.120442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8de3d-1285-429d-9d31-6b5fddeb3824 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:28.120710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8de3d-1285-429d-9d31-6b5fddeb3824 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:28.122200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 672/1350] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 02:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:28.134345 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28824816-4f57-445b-bf2d-244bc7045b40 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:28.134801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28824816-4f57-445b-bf2d-244bc7045b40 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:28.135185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28824816-4f57-445b-bf2d-244bc7045b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:28.259558 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-28824816-4f57-445b-bf2d-244bc7045b40 None None] MFA Rules not processed for user `629b38364f6a414aa14123c0749ba164`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:28.261038 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-28824816-4f57-445b-bf2d-244bc7045b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:28.375451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 679/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 02:37:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:37:32.350285 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6a656-04c2-4186-a118-3d2637507e92 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:32.352827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6a656-04c2-4186-a118-3d2637507e92 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:32.352827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6a656-04c2-4186-a118-3d2637507e92 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:32.353254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 673/1352] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 02:37:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:32.358599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6ec49-a309-4e76-9b0e-f4f34c65b931 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:32.359068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6ec49-a309-4e76-9b0e-f4f34c65b931 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:32.359178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6ec49-a309-4e76-9b0e-f4f34c65b931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:32.413872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:32.439064 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-34d6ec49-a309-4e76-9b0e-f4f34c65b931 None None] MFA Rules not processed for user `629b38364f6a414aa14123c0749ba164`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:32.440269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-34d6ec49-a309-4e76-9b0e-f4f34c65b931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:32.550415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 680/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 02:37:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:37:32.975994 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=59 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:33.998223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685ce3a-d322-43c7-8d8b-558f5924d362 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:33.998846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685ce3a-d322-43c7-8d8b-558f5924d362 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:33.998846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685ce3a-d322-43c7-8d8b-558f5924d362 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:34.000011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 674/1354] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 02:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:34.005596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceedeb2-ab59-4ae8-aaf3-b4da68bc3312 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:34.006064 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceedeb2-ab59-4ae8-aaf3-b4da68bc3312 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:34.006162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceedeb2-ab59-4ae8-aaf3-b4da68bc3312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:34.082403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-aceedeb2-ab59-4ae8-aaf3-b4da68bc3312 None None] MFA Rules not processed for user `629b38364f6a414aa14123c0749ba164`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:34.083642 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aceedeb2-ab59-4ae8-aaf3-b4da68bc3312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:34.126272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:34.193641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 681/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 02:37:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:37.572599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17982bb-556f-4bc2-9347-229473aa2d95 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:37.573649 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17982bb-556f-4bc2-9347-229473aa2d95 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:37.574088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17982bb-556f-4bc2-9347-229473aa2d95 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:37.576011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 675/1356] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:37.581050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50531a-6c1c-466e-b98f-a68f56253e3a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:37.581911 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50531a-6c1c-466e-b98f-a68f56253e3a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:37.582183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50531a-6c1c-466e-b98f-a68f56253e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:37.676014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4c50531a-6c1c-466e-b98f-a68f56253e3a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:37.677734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4c50531a-6c1c-466e-b98f-a68f56253e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:37.784780 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 682/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:37.837423 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d086a-67f9-4d95-8085-2219bbc112dc None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:37.838300 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d086a-67f9-4d95-8085-2219bbc112dc None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:37.838946 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d086a-67f9-4d95-8085-2219bbc112dc None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:37.840999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 676/1358] 10.222.0.39 () {54 vars in 962 bytes} [Tue Jul 26 02:37:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:37.849891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d7fb-563d-4528-a4c2-8dacc6f3e69e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:37.850172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d7fb-563d-4528-a4c2-8dacc6f3e69e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:37.850447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d7fb-563d-4528-a4c2-8dacc6f3e69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:37.870274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:37.939174 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2e70d7fb-563d-4528-a4c2-8dacc6f3e69e None None] MFA Rules not processed for user `338b2744014940ca96c08d4e9262697b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:37.940374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2e70d7fb-563d-4528-a4c2-8dacc6f3e69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:38.073668 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 683/1359] 10.222.0.39 () {58 vars in 1059 bytes} [Tue Jul 26 02:37:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:38.081678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d086a-67f9-4d95-8085-2219bbc112dc None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:38.083575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e27d086a-67f9-4d95-8085-2219bbc112dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:38.232954 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d086a-67f9-4d95-8085-2219bbc112dc None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:38.308184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:38.353157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31ac31-71f6-4c16-b46e-9d3f9ab48763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:38.353733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31ac31-71f6-4c16-b46e-9d3f9ab48763 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:38.354013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31ac31-71f6-4c16-b46e-9d3f9ab48763 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:38.354273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31ac31-71f6-4c16-b46e-9d3f9ab48763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:38.355914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1e31ac31-71f6-4c16-b46e-9d3f9ab48763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:38.450447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31ac31-71f6-4c16-b46e-9d3f9ab48763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:38.452181 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31ac31-71f6-4c16-b46e-9d3f9ab48763 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:38.472025 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 677/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:40.680696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6455f-ca4a-4f72-97bc-78ea0fc7b0bb None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:40.681267 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6455f-ca4a-4f72-97bc-78ea0fc7b0bb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:40.681267 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6455f-ca4a-4f72-97bc-78ea0fc7b0bb None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:40.682960 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 684/1361] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:40.688778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309e1ae-6ccd-4eeb-bd5a-d749180bfb72 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:40.689379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309e1ae-6ccd-4eeb-bd5a-d749180bfb72 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:40.689379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309e1ae-6ccd-4eeb-bd5a-d749180bfb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:40.768343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4309e1ae-6ccd-4eeb-bd5a-d749180bfb72 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:40.769534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4309e1ae-6ccd-4eeb-bd5a-d749180bfb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:40.810693 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:40.877351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 678/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:40.922207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6455f-ca4a-4f72-97bc-78ea0fc7b0bb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:40.923744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f7a6455f-ca4a-4f72-97bc-78ea0fc7b0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:41.007948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:41.130450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6455f-ca4a-4f72-97bc-78ea0fc7b0bb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:41.265697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db960e9-0817-4247-b345-2c3d6ed77eb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:41.266326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db960e9-0817-4247-b345-2c3d6ed77eb4 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:41.266606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db960e9-0817-4247-b345-2c3d6ed77eb4 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:41.266879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db960e9-0817-4247-b345-2c3d6ed77eb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:41.268515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6db960e9-0817-4247-b345-2c3d6ed77eb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:41.292336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:41.363329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db960e9-0817-4247-b345-2c3d6ed77eb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:41.364963 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db960e9-0817-4247-b345-2c3d6ed77eb4 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:41.384318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 685/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:43.686635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601d10c-1966-4a44-9fec-14691dc6ce68 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:43.687495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601d10c-1966-4a44-9fec-14691dc6ce68 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:43.687947 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601d10c-1966-4a44-9fec-14691dc6ce68 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:43.689350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 679/1364] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:37:43.694724 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ea50d-a8af-412f-9b6c-13ba095bfc88 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:43.695169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ea50d-a8af-412f-9b6c-13ba095bfc88 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:43.695423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ea50d-a8af-412f-9b6c-13ba095bfc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:43.777113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b53ea50d-a8af-412f-9b6c-13ba095bfc88 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:43.778643 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b53ea50d-a8af-412f-9b6c-13ba095bfc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:43.886410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:43.892895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 686/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:43.936039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0b5f-52ee-4907-beab-df1b8a487eb0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:43.936331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0b5f-52ee-4907-beab-df1b8a487eb0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:43.936599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0b5f-52ee-4907-beab-df1b8a487eb0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:43.938087 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 680/1366] 10.222.0.39 () {54 vars in 962 bytes} [Tue Jul 26 02:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:43.943320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0ac41-032b-4119-8f52-6a46c96df0d4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:43.943618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0ac41-032b-4119-8f52-6a46c96df0d4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:43.943890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0ac41-032b-4119-8f52-6a46c96df0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:44.024695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9ff0ac41-032b-4119-8f52-6a46c96df0d4 None None] MFA Rules not processed for user `338b2744014940ca96c08d4e9262697b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:44.025949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9ff0ac41-032b-4119-8f52-6a46c96df0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:44.155059 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 687/1367] 10.222.0.39 () {58 vars in 1059 bytes} [Tue Jul 26 02:37:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:44.163074 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d0b5f-52ee-4907-beab-df1b8a487eb0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:44.164627 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-233d0b5f-52ee-4907-beab-df1b8a487eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:44.319407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d0b5f-52ee-4907-beab-df1b8a487eb0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:44.341315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:44.442815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26479b3f-8088-479c-a1a0-af2663ca4a29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:44.443435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26479b3f-8088-479c-a1a0-af2663ca4a29 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:44.443709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26479b3f-8088-479c-a1a0-af2663ca4a29 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:44.443959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26479b3f-8088-479c-a1a0-af2663ca4a29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:44.445617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-26479b3f-8088-479c-a1a0-af2663ca4a29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:44.539412 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26479b3f-8088-479c-a1a0-af2663ca4a29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:44.543326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26479b3f-8088-479c-a1a0-af2663ca4a29 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:44.563289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 681/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:45.549904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59571bc3-cb65-43b9-9fc3-b0923a423141 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:45.550503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59571bc3-cb65-43b9-9fc3-b0923a423141 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:45.550503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59571bc3-cb65-43b9-9fc3-b0923a423141 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:45.552034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 688/1369] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:45.557081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc61fa3-e457-45ea-abda-efd5e72dfa3d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:45.557588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc61fa3-e457-45ea-abda-efd5e72dfa3d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:45.557588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc61fa3-e457-45ea-abda-efd5e72dfa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:45.590378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:45.634767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-adc61fa3-e457-45ea-abda-efd5e72dfa3d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:45.636279 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-adc61fa3-e457-45ea-abda-efd5e72dfa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:45.739856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 682/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:46.093673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b04d2d-d63e-4aae-a3c2-4598c0aaea03 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:46.093673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b04d2d-d63e-4aae-a3c2-4598c0aaea03 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:46.093673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b04d2d-d63e-4aae-a3c2-4598c0aaea03 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:46.093673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 689/1371] 10.222.0.39 () {54 vars in 964 bytes} [Tue Jul 26 02:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:46.099443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b2485-bd70-4b79-9afa-6c6cea2fd0bb None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:46.099443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b2485-bd70-4b79-9afa-6c6cea2fd0bb None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:46.099443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b2485-bd70-4b79-9afa-6c6cea2fd0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:46.187788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2b3b2485-bd70-4b79-9afa-6c6cea2fd0bb None None] MFA Rules not processed for user `ba1305d4e5914f1182dc7436a2d53965`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:46.188905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2b3b2485-bd70-4b79-9afa-6c6cea2fd0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:46.238725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:46.271736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 683/1372] 10.222.0.39 () {58 vars in 1061 bytes} [Tue Jul 26 02:37:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:46.280333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b04d2d-d63e-4aae-a3c2-4598c0aaea03 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:46.282442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-75b04d2d-d63e-4aae-a3c2-4598c0aaea03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:46.341690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:46.406095 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b04d2d-d63e-4aae-a3c2-4598c0aaea03 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:46.485218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292eb8c-14ec-4975-910a-8dbf8fd0ea7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:46.485782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292eb8c-14ec-4975-910a-8dbf8fd0ea7c service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:46.486056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292eb8c-14ec-4975-910a-8dbf8fd0ea7c service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:46.486338 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292eb8c-14ec-4975-910a-8dbf8fd0ea7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:46.488046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9292eb8c-14ec-4975-910a-8dbf8fd0ea7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:46.607022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:46.623591 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292eb8c-14ec-4975-910a-8dbf8fd0ea7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:46.625038 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292eb8c-14ec-4975-910a-8dbf8fd0ea7c service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:46.646447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 690/1373] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:46.670964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e25aa-d70c-4796-857b-2958661c1ae2 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:46.671393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e25aa-d70c-4796-857b-2958661c1ae2 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:46.671635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e25aa-d70c-4796-857b-2958661c1ae2 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:46.673644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 684/1374] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:46.678348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef164bf4-6119-4bb5-a36c-8397b501c7e7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:46.678637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef164bf4-6119-4bb5-a36c-8397b501c7e7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:46.678904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef164bf4-6119-4bb5-a36c-8397b501c7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:46.743317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ef164bf4-6119-4bb5-a36c-8397b501c7e7 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:46.744748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ef164bf4-6119-4bb5-a36c-8397b501c7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:46.849350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 691/1375] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:46.883912 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e25aa-d70c-4796-857b-2958661c1ae2 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:46.885499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e58e25aa-d70c-4796-857b-2958661c1ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:47.058611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e25aa-d70c-4796-857b-2958661c1ae2 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:47.110391 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:47.174072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb69d0ff-f0bb-4d95-9fff-f2b4af08686e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:47.174695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69d0ff-f0bb-4d95-9fff-f2b4af08686e service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:47.174976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69d0ff-f0bb-4d95-9fff-f2b4af08686e service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:47.175244 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb69d0ff-f0bb-4d95-9fff-f2b4af08686e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:47.176868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-eb69d0ff-f0bb-4d95-9fff-f2b4af08686e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:47.271515 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69d0ff-f0bb-4d95-9fff-f2b4af08686e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:47.273138 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb69d0ff-f0bb-4d95-9fff-f2b4af08686e service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:47.293025 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 685/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:49.310734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e553e-9c47-49a7-913a-06bd4d473a99 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:49.311253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e553e-9c47-49a7-913a-06bd4d473a99 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:49.311253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e553e-9c47-49a7-913a-06bd4d473a99 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:49.312567 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 692/1377] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:37:49.317832 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670ae91-b105-4e0f-a766-72947f82938a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:49.318293 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670ae91-b105-4e0f-a766-72947f82938a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:49.318386 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670ae91-b105-4e0f-a766-72947f82938a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:49.386750 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e670ae91-b105-4e0f-a766-72947f82938a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:49.387940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e670ae91-b105-4e0f-a766-72947f82938a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:49.395028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:49.489761 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 686/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:49.537103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e553e-9c47-49a7-913a-06bd4d473a99 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:49.538917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d20e553e-9c47-49a7-913a-06bd4d473a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:49.614788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:49.714776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e553e-9c47-49a7-913a-06bd4d473a99 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:49.828278 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344524a7-2fa0-46ed-ad0a-059ef06ad843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:49.828899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344524a7-2fa0-46ed-ad0a-059ef06ad843 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:49.829174 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344524a7-2fa0-46ed-ad0a-059ef06ad843 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:49.829469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344524a7-2fa0-46ed-ad0a-059ef06ad843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:49.831065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-344524a7-2fa0-46ed-ad0a-059ef06ad843 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:49.850185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:49.927633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344524a7-2fa0-46ed-ad0a-059ef06ad843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:49.929269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344524a7-2fa0-46ed-ad0a-059ef06ad843 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:49.947863 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 693/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:51.978718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0cb0b-b84d-4d3b-972b-54d2e02d65b1 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:51.979331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0cb0b-b84d-4d3b-972b-54d2e02d65b1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:51.979331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0cb0b-b84d-4d3b-972b-54d2e02d65b1 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:51.980598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 687/1380] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:51.986273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c5d6b-85db-4637-bd6b-d448ebb6a5ee None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:51.986749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c5d6b-85db-4637-bd6b-d448ebb6a5ee None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:51.987024 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c5d6b-85db-4637-bd6b-d448ebb6a5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:52.057043 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1f7c5d6b-85db-4637-bd6b-d448ebb6a5ee None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:52.058510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1f7c5d6b-85db-4637-bd6b-d448ebb6a5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:52.166598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:52.178979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 694/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:52.218825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0cb0b-b84d-4d3b-972b-54d2e02d65b1 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:52.220641 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-09d0cb0b-b84d-4d3b-972b-54d2e02d65b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:52.365699 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:52.378266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0cb0b-b84d-4d3b-972b-54d2e02d65b1 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:52.500899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfda3e7-d3d2-4348-bebe-e48e96a82c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:52.501463 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfda3e7-d3d2-4348-bebe-e48e96a82c35 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:52.501741 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfda3e7-d3d2-4348-bebe-e48e96a82c35 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:52.501996 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfda3e7-d3d2-4348-bebe-e48e96a82c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:52.503633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3cfda3e7-d3d2-4348-bebe-e48e96a82c35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:52.597350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfda3e7-d3d2-4348-bebe-e48e96a82c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:52.599044 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfda3e7-d3d2-4348-bebe-e48e96a82c35 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:52.617306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:52.630583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 688/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:54.681058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b852b-65d2-49c3-afd6-844972d2a1a5 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:54.681910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b852b-65d2-49c3-afd6-844972d2a1a5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:54.681910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b852b-65d2-49c3-afd6-844972d2a1a5 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:54.683103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 695/1383] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:54.688779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64132e-e000-4151-aae1-13431f6f1a37 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:54.689364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64132e-e000-4151-aae1-13431f6f1a37 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:54.689572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64132e-e000-4151-aae1-13431f6f1a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:54.763552 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6b64132e-e000-4151-aae1-13431f6f1a37 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:54.764864 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6b64132e-e000-4151-aae1-13431f6f1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:54.867100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 689/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:54.912687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b852b-65d2-49c3-afd6-844972d2a1a5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:54.914373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ce0b852b-65d2-49c3-afd6-844972d2a1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:55.090634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b852b-65d2-49c3-afd6-844972d2a1a5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:55.169272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:55.219626 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72262fe-00ed-44ee-9e82-311fa7ea8f2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:55.220391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72262fe-00ed-44ee-9e82-311fa7ea8f2d service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:55.220721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72262fe-00ed-44ee-9e82-311fa7ea8f2d service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:55.220947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72262fe-00ed-44ee-9e82-311fa7ea8f2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:55.222723 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c72262fe-00ed-44ee-9e82-311fa7ea8f2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:55.322120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72262fe-00ed-44ee-9e82-311fa7ea8f2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:55.323790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72262fe-00ed-44ee-9e82-311fa7ea8f2d service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:55.343583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 696/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:37:57.382078 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09583c28-8adf-4345-a248-b76936f890c0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:57.382654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09583c28-8adf-4345-a248-b76936f890c0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:57.382654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09583c28-8adf-4345-a248-b76936f890c0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:57.384104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 690/1386] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:37:57.389749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a25050-3806-4078-9acd-aba7f9a82585 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:57.390410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a25050-3806-4078-9acd-aba7f9a82585 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:57.390410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a25050-3806-4078-9acd-aba7f9a82585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:57.462864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-56a25050-3806-4078-9acd-aba7f9a82585 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:37:57.464270 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-56a25050-3806-4078-9acd-aba7f9a82585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:57.504479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:57.584761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 697/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:37:57.632580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09583c28-8adf-4345-a248-b76936f890c0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:37:57.635170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-09583c28-8adf-4345-a248-b76936f890c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:57.736459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:57.826618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09583c28-8adf-4345-a248-b76936f890c0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:37:57.955591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6e273-550e-44a9-a136-7225e676eced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:37:57.956253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6e273-550e-44a9-a136-7225e676eced service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:37:57.956530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6e273-550e-44a9-a136-7225e676eced service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:37:57.956798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6e273-550e-44a9-a136-7225e676eced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:37:57.958623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d6d6e273-550e-44a9-a136-7225e676eced service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:37:58.000531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:37:58.062635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6e273-550e-44a9-a136-7225e676eced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:37:58.065267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6e273-550e-44a9-a136-7225e676eced service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:37:58.091650 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 691/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:00.132726 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1787a69-13e1-494d-b6ea-fcf5a0dc544a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:00.133317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1787a69-13e1-494d-b6ea-fcf5a0dc544a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:00.133317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1787a69-13e1-494d-b6ea-fcf5a0dc544a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:00.134680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 698/1389] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:00.140008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b963-f024-4bf8-bcd4-53bbf6351313 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:00.140447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b963-f024-4bf8-bcd4-53bbf6351313 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:00.140641 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b963-f024-4bf8-bcd4-53bbf6351313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:00.209308 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0f58b963-f024-4bf8-bcd4-53bbf6351313 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:00.210547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0f58b963-f024-4bf8-bcd4-53bbf6351313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:00.310604 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 692/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:00.355046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1787a69-13e1-494d-b6ea-fcf5a0dc544a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:00.356703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b1787a69-13e1-494d-b6ea-fcf5a0dc544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:00.511090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1787a69-13e1-494d-b6ea-fcf5a0dc544a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:00.528137 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:00.628779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c6437-d993-4561-81bf-2018d3158407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:00.629811 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c6437-d993-4561-81bf-2018d3158407 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:00.630260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c6437-d993-4561-81bf-2018d3158407 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:00.630677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c6437-d993-4561-81bf-2018d3158407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:00.632458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-709c6437-d993-4561-81bf-2018d3158407 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:00.732617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c6437-d993-4561-81bf-2018d3158407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:00.734290 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c6437-d993-4561-81bf-2018d3158407 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:00.752816 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 699/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:01.580313 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dfe2f-92a5-49a1-813a-904ceb69efa5 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:01.580923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dfe2f-92a5-49a1-813a-904ceb69efa5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:01.580923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dfe2f-92a5-49a1-813a-904ceb69efa5 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:01.582235 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 693/1392] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:01.587681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c171879-5081-4303-919a-3ed6ee6fe998 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:01.588116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c171879-5081-4303-919a-3ed6ee6fe998 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:01.588205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c171879-5081-4303-919a-3ed6ee6fe998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:01.615786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:01.786736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3c171879-5081-4303-919a-3ed6ee6fe998 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:01.788001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3c171879-5081-4303-919a-3ed6ee6fe998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:01.891450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 700/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:01.946668 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c6736-aac3-4ee1-9786-3490d0371db4 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:01.946956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c6736-aac3-4ee1-9786-3490d0371db4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:01.947259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c6736-aac3-4ee1-9786-3490d0371db4 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:01.948603 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 694/1394] 10.222.0.39 () {54 vars in 966 bytes} [Tue Jul 26 02:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:01.953810 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223484d9-0fdb-486f-a7a1-620833f5735b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:01.954101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223484d9-0fdb-486f-a7a1-620833f5735b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:01.954373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223484d9-0fdb-486f-a7a1-620833f5735b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:02.031145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-223484d9-0fdb-486f-a7a1-620833f5735b None None] MFA Rules not processed for user `2402339784b34d98a4670db912617331`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:02.032339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-223484d9-0fdb-486f-a7a1-620833f5735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:02.074518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:02.113254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 701/1395] 10.222.0.39 () {58 vars in 1063 bytes} [Tue Jul 26 02:38:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:02.121142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c6736-aac3-4ee1-9786-3490d0371db4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:02.122719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-874c6736-aac3-4ee1-9786-3490d0371db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:02.137157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:02.228663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c6736-aac3-4ee1-9786-3490d0371db4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:02.301616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50914f-c964-4f34-a399-37befb6d4115 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2402339784b34d98a4670db912617331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:02.302249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50914f-c964-4f34-a399-37befb6d4115 service glance] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:02.302580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50914f-c964-4f34-a399-37befb6d4115 service glance] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:02.302844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50914f-c964-4f34-a399-37befb6d4115 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:02.304449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-df50914f-c964-4f34-a399-37befb6d4115 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:02.374194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:02.417134 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50914f-c964-4f34-a399-37befb6d4115 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:02.418652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50914f-c964-4f34-a399-37befb6d4115 service glance] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:02.438463 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 695/1396] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:02.751478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96937-4183-4da9-b872-82b210bcb72a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:02.752043 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96937-4183-4da9-b872-82b210bcb72a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:02.752238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b96937-4183-4da9-b872-82b210bcb72a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:02.754270 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 702/1397] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:02.759841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58f499-cb60-41f7-a2af-0886c7dcd1cd None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:02.760297 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58f499-cb60-41f7-a2af-0886c7dcd1cd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:02.760467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58f499-cb60-41f7-a2af-0886c7dcd1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:02.847384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0f58f499-cb60-41f7-a2af-0886c7dcd1cd None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:02.848611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0f58f499-cb60-41f7-a2af-0886c7dcd1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:02.949534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 696/1398] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:02.994000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b96937-4183-4da9-b872-82b210bcb72a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:02.995619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-69b96937-4183-4da9-b872-82b210bcb72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:03.158324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b96937-4183-4da9-b872-82b210bcb72a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:03.194957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d51d4-93f2-4b48-aa1e-18fa61cf9354 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:03.195320 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d51d4-93f2-4b48-aa1e-18fa61cf9354 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:03.195662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d51d4-93f2-4b48-aa1e-18fa61cf9354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:03.218559 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:03.224851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:03.263437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-da7d51d4-93f2-4b48-aa1e-18fa61cf9354 None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:03.264652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-da7d51d4-93f2-4b48-aa1e-18fa61cf9354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:03.284477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd42ef93-2ef4-4874-8efd-f89b45815744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:03.285097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42ef93-2ef4-4874-8efd-f89b45815744 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:03.285401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42ef93-2ef4-4874-8efd-f89b45815744 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:03.285760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd42ef93-2ef4-4874-8efd-f89b45815744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:03.287400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bd42ef93-2ef4-4874-8efd-f89b45815744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:03.353409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 697/1399] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:38:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:38:03.379681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42ef93-2ef4-4874-8efd-f89b45815744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:03.381425 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd42ef93-2ef4-4874-8efd-f89b45815744 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:03.400556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b2ca2-a7ed-46bf-8a14-19e47bc385d8 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:03.400754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 703/1400] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:03.400856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b2ca2-a7ed-46bf-8a14-19e47bc385d8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:03.401109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b2ca2-a7ed-46bf-8a14-19e47bc385d8 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:03.402496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 698/1401] 10.222.0.39 () {54 vars in 943 bytes} [Tue Jul 26 02:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:38:03.408786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e36a8-812d-47ed-9f92-53742ce38784 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:03.409018 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e36a8-812d-47ed-9f92-53742ce38784 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:03.409387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e36a8-812d-47ed-9f92-53742ce38784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:03.478102 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:03.494607 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-795e36a8-812d-47ed-9f92-53742ce38784 None None] MFA Rules not processed for user `f2365526802146088fcaa4afc2e03a35`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:03.495932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-795e36a8-812d-47ed-9f92-53742ce38784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:03.620301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 704/1402] 10.222.0.39 () {58 vars in 1040 bytes} [Tue Jul 26 02:38:03 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:03.630630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b2ca2-a7ed-46bf-8a14-19e47bc385d8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:03.632172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d13b2ca2-a7ed-46bf-8a14-19e47bc385d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:03.744258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:03.774340 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b2ca2-a7ed-46bf-8a14-19e47bc385d8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:03.891882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a821f-0785-47fd-af1d-5809b1c443ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:03.892511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a821f-0785-47fd-af1d-5809b1c443ef service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:03.892815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a821f-0785-47fd-af1d-5809b1c443ef service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:03.893042 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a821f-0785-47fd-af1d-5809b1c443ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:03.894804 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-be4a821f-0785-47fd-af1d-5809b1c443ef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:03.978960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a821f-0785-47fd-af1d-5809b1c443ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:03.980562 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a821f-0785-47fd-af1d-5809b1c443ef service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:03.988716 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 699/1403] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:38:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:38:05.449928 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c910de-4ca6-4cd2-b7ec-76d57345cb5a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:05.450489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c910de-4ca6-4cd2-b7ec-76d57345cb5a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:05.450489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c910de-4ca6-4cd2-b7ec-76d57345cb5a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:05.451841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 705/1404] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:05.457015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121603cd-ce61-4e5d-973c-91981cf61632 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:05.457468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121603cd-ce61-4e5d-973c-91981cf61632 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:05.457658 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121603cd-ce61-4e5d-973c-91981cf61632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:05.473515 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:05.536634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-121603cd-ce61-4e5d-973c-91981cf61632 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:05.536634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-121603cd-ce61-4e5d-973c-91981cf61632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:05.642707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 700/1405] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:05.687516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c910de-4ca6-4cd2-b7ec-76d57345cb5a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:05.689054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f7c910de-4ca6-4cd2-b7ec-76d57345cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:05.815806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:05.866930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c910de-4ca6-4cd2-b7ec-76d57345cb5a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:05.998630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b818cb-c300-412b-a4eb-7b651d8b5055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:05.999262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b818cb-c300-412b-a4eb-7b651d8b5055 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:05.999705 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b818cb-c300-412b-a4eb-7b651d8b5055 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:05.999979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b818cb-c300-412b-a4eb-7b651d8b5055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:06.001674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-65b818cb-c300-412b-a4eb-7b651d8b5055 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:06.080052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:06.100894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b818cb-c300-412b-a4eb-7b651d8b5055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:06.102544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b818cb-c300-412b-a4eb-7b651d8b5055 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:06.123428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 706/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:08.148661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57e3d8-d176-4f50-b681-5199a3da7482 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:08.149343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57e3d8-d176-4f50-b681-5199a3da7482 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:08.149343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57e3d8-d176-4f50-b681-5199a3da7482 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:08.153452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 701/1407] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:38:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:08.155743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3daaf-7a4b-43ae-a6eb-dc6ee1812894 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:08.156163 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3daaf-7a4b-43ae-a6eb-dc6ee1812894 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:08.156293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3daaf-7a4b-43ae-a6eb-dc6ee1812894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:08.240430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5ec3daaf-7a4b-43ae-a6eb-dc6ee1812894 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:08.241722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5ec3daaf-7a4b-43ae-a6eb-dc6ee1812894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:08.347785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 707/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:08.392299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57e3d8-d176-4f50-b681-5199a3da7482 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:08.393878 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3f57e3d8-d176-4f50-b681-5199a3da7482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:08.492526 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:08.556954 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57e3d8-d176-4f50-b681-5199a3da7482 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:08.680324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292422c8-370f-44aa-8e7c-21b207e2f5aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:08.681418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292422c8-370f-44aa-8e7c-21b207e2f5aa service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:08.681706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292422c8-370f-44aa-8e7c-21b207e2f5aa service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:08.681977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292422c8-370f-44aa-8e7c-21b207e2f5aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:08.683651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-292422c8-370f-44aa-8e7c-21b207e2f5aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:08.745113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:08.783716 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292422c8-370f-44aa-8e7c-21b207e2f5aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:08.785624 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292422c8-370f-44aa-8e7c-21b207e2f5aa service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:08.805451 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 702/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:18.345954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=78 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:18.803114 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=22 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:25.745839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b7075-83d6-4601-a28b-c28fb411598d None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:25.746412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b7075-83d6-4601-a28b-c28fb411598d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:25.746412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b7075-83d6-4601-a28b-c28fb411598d None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:25.748447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 708/1410] 10.222.0.39 () {54 vars in 918 bytes} [Tue Jul 26 02:38:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:25.755869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914de6-f7cc-483b-9756-356d5a101d13 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:25.756358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914de6-f7cc-483b-9756-356d5a101d13 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:25.756459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914de6-f7cc-483b-9756-356d5a101d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:25.837158 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-50914de6-f7cc-483b-9756-356d5a101d13 None None] MFA Rules not processed for user `629b38364f6a414aa14123c0749ba164`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:25.838428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-50914de6-f7cc-483b-9756-356d5a101d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:25.966323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 703/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Jul 26 02:38:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:25.985348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadac212-9941-468c-9489-4e0f5354339c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:25.985755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadac212-9941-468c-9489-4e0f5354339c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:25.986105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadac212-9941-468c-9489-4e0f5354339c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:25.988052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 709/1412] 10.222.0.39 () {54 vars in 918 bytes} [Tue Jul 26 02:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:25.994410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513752c-de19-43ec-a9d6-f46f02efe765 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:25.994694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513752c-de19-43ec-a9d6-f46f02efe765 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:25.994967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513752c-de19-43ec-a9d6-f46f02efe765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:26.069906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:26.073118 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a513752c-de19-43ec-a9d6-f46f02efe765 None None] MFA Rules not processed for user `338b2744014940ca96c08d4e9262697b`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:26.075168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a513752c-de19-43ec-a9d6-f46f02efe765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:26.192907 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 704/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Jul 26 02:38:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:28.643305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe91b0-497a-41d9-be93-d684190f942e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:28.643792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe91b0-497a-41d9-be93-d684190f942e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:28.643792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe91b0-497a-41d9-be93-d684190f942e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:28.645234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:28.650822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b721a4-5d46-4bde-930c-75a0fe6b94f6 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:28.651286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b721a4-5d46-4bde-930c-75a0fe6b94f6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:28.651396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b721a4-5d46-4bde-930c-75a0fe6b94f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:28.717607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-58b721a4-5d46-4bde-930c-75a0fe6b94f6 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:28.718806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-58b721a4-5d46-4bde-930c-75a0fe6b94f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:28.784340 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:28.830093 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:38:28.875132 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe91b0-497a-41d9-be93-d684190f942e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:28.876697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-acfe91b0-497a-41d9-be93-d684190f942e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:29.039375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe91b0-497a-41d9-be93-d684190f942e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:29.115429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:29.159500 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98fe69-e34d-44db-a303-a13b2feefe24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:29.160399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98fe69-e34d-44db-a303-a13b2feefe24 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:29.160678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98fe69-e34d-44db-a303-a13b2feefe24 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:29.160946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98fe69-e34d-44db-a303-a13b2feefe24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:29.162606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6d98fe69-e34d-44db-a303-a13b2feefe24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:29.253843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98fe69-e34d-44db-a303-a13b2feefe24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:29.255442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98fe69-e34d-44db-a303-a13b2feefe24 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:29.276020 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 711/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:30.166203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165246a-49cc-4040-b78d-f0c7cc93fd6e None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:30.166836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165246a-49cc-4040-b78d-f0c7cc93fd6e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:30.166836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165246a-49cc-4040-b78d-f0c7cc93fd6e None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:30.168828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 02:38:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:30.177007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05249b7-0c55-4dbe-9153-bb91803a7978 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:30.177481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05249b7-0c55-4dbe-9153-bb91803a7978 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:30.177587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05249b7-0c55-4dbe-9153-bb91803a7978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:30.263522 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d05249b7-0c55-4dbe-9153-bb91803a7978 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:30.264721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d05249b7-0c55-4dbe-9153-bb91803a7978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:30.291900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:30.366719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 02:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:30.523001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165246a-49cc-4040-b78d-f0c7cc93fd6e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:30.524638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a165246a-49cc-4040-b78d-f0c7cc93fd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:30.680872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165246a-49cc-4040-b78d-f0c7cc93fd6e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:30.721770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:30.802230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160ec47-8de6-45db-a44c-86da042bee4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:30.802776 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160ec47-8de6-45db-a44c-86da042bee4c service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:30.803057 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160ec47-8de6-45db-a44c-86da042bee4c service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:30.803324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160ec47-8de6-45db-a44c-86da042bee4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:30.804963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0160ec47-8de6-45db-a44c-86da042bee4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:30.908207 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160ec47-8de6-45db-a44c-86da042bee4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:30.909867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160ec47-8de6-45db-a44c-86da042bee4c service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:30.929238 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 707/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:31.828415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39dc93-6a24-4f9d-b82b-bafbe6e6ac31 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:31.829235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39dc93-6a24-4f9d-b82b-bafbe6e6ac31 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:31.829235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39dc93-6a24-4f9d-b82b-bafbe6e6ac31 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:31.831514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 02:38:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:31.838716 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529ef1a-447a-49a3-8c85-04a9f9e22a4f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:31.839128 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529ef1a-447a-49a3-8c85-04a9f9e22a4f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:31.839248 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529ef1a-447a-49a3-8c85-04a9f9e22a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:31.897481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:31.923491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2529ef1a-447a-49a3-8c85-04a9f9e22a4f None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:31.924717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2529ef1a-447a-49a3-8c85-04a9f9e22a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:32.030633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 02:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:32.193786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39dc93-6a24-4f9d-b82b-bafbe6e6ac31 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:32.195236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9d39dc93-6a24-4f9d-b82b-bafbe6e6ac31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:32.360149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39dc93-6a24-4f9d-b82b-bafbe6e6ac31 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:32.373317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:32.478583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3c324-1779-4761-b8e6-81093c0b67a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:32.479113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3c324-1779-4761-b8e6-81093c0b67a2 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:32.479390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3c324-1779-4761-b8e6-81093c0b67a2 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:32.479663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3c324-1779-4761-b8e6-81093c0b67a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:32.481275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-05c3c324-1779-4761-b8e6-81093c0b67a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:32.578313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3c324-1779-4761-b8e6-81093c0b67a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:32.579905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3c324-1779-4761-b8e6-81093c0b67a2 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:32.599469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 714/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:33.475233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fda23-b307-4d47-b5f0-daa62e231e3e None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:33.475818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fda23-b307-4d47-b5f0-daa62e231e3e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:33.475818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fda23-b307-4d47-b5f0-daa62e231e3e None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:33.477182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 02:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:33.483349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27ae0c-9e12-4cac-b5d2-02be7fcfba24 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:33.484131 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27ae0c-9e12-4cac-b5d2-02be7fcfba24 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:33.484231 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27ae0c-9e12-4cac-b5d2-02be7fcfba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:33.508177 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:33.570604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-aa27ae0c-9e12-4cac-b5d2-02be7fcfba24 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:33.572461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aa27ae0c-9e12-4cac-b5d2-02be7fcfba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:33.682580 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 02:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:33.832638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fda23-b307-4d47-b5f0-daa62e231e3e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:33.834250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0b7fda23-b307-4d47-b5f0-daa62e231e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:33.948755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:33.989894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fda23-b307-4d47-b5f0-daa62e231e3e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:34.116060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4f2fe-4c89-4f6c-886c-a19a204dc35c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:34.116679 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4f2fe-4c89-4f6c-886c-a19a204dc35c service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:34.116957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4f2fe-4c89-4f6c-886c-a19a204dc35c service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:34.117227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4f2fe-4c89-4f6c-886c-a19a204dc35c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:34.118911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b6c4f2fe-4c89-4f6c-886c-a19a204dc35c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:34.197059 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:34.216554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4f2fe-4c89-4f6c-886c-a19a204dc35c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:34.218583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c4f2fe-4c89-4f6c-886c-a19a204dc35c service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:34.237632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 710/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:35.102353 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462bd0-c411-4026-a70e-29157b741dd8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:35.102922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462bd0-c411-4026-a70e-29157b741dd8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:35.102922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45462bd0-c411-4026-a70e-29157b741dd8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:35.104186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 02:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:35.110383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74ba79-5142-4a94-add3-bf74431a1040 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:35.111139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74ba79-5142-4a94-add3-bf74431a1040 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:35.111306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74ba79-5142-4a94-add3-bf74431a1040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:35.193528 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2d74ba79-5142-4a94-add3-bf74431a1040 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:35.194739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2d74ba79-5142-4a94-add3-bf74431a1040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:35.293050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 02:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:35.444809 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45462bd0-c411-4026-a70e-29157b741dd8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:35.446423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-45462bd0-c411-4026-a70e-29157b741dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:35.536120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:35.601697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45462bd0-c411-4026-a70e-29157b741dd8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:35.722741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661cbb3d-387c-42d4-9ad1-4fd5f92fcd4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:35.723278 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cbb3d-387c-42d4-9ad1-4fd5f92fcd4f service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:35.723559 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cbb3d-387c-42d4-9ad1-4fd5f92fcd4f service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:35.723834 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cbb3d-387c-42d4-9ad1-4fd5f92fcd4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:35.725494 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-661cbb3d-387c-42d4-9ad1-4fd5f92fcd4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:35.777749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:35.833770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cbb3d-387c-42d4-9ad1-4fd5f92fcd4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:35.835384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661cbb3d-387c-42d4-9ad1-4fd5f92fcd4f service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:35.855111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 717/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:36.661544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba611cce-df95-4ec3-8bfc-4f00921f4afe None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:36.662037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba611cce-df95-4ec3-8bfc-4f00921f4afe None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:36.662037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba611cce-df95-4ec3-8bfc-4f00921f4afe None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:36.663430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 02:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:36.668718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4440a6-9b12-4ec2-9f38-07d52b24a160 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:36.669145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4440a6-9b12-4ec2-9f38-07d52b24a160 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:36.669239 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4440a6-9b12-4ec2-9f38-07d52b24a160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:36.758732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ee4440a6-9b12-4ec2-9f38-07d52b24a160 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:36.759941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ee4440a6-9b12-4ec2-9f38-07d52b24a160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:36.859762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 02:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:37.012958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba611cce-df95-4ec3-8bfc-4f00921f4afe None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:37.014421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ba611cce-df95-4ec3-8bfc-4f00921f4afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:37.072884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:37.172944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba611cce-df95-4ec3-8bfc-4f00921f4afe None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:37.293946 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb52752-e26d-43cb-8f68-63edd5bf5227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:37.294478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb52752-e26d-43cb-8f68-63edd5bf5227 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:37.294756 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb52752-e26d-43cb-8f68-63edd5bf5227 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:37.295025 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb52752-e26d-43cb-8f68-63edd5bf5227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:37.296691 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0bb52752-e26d-43cb-8f68-63edd5bf5227 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:37.303805 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:37.391776 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb52752-e26d-43cb-8f68-63edd5bf5227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:37.393417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb52752-e26d-43cb-8f68-63edd5bf5227 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:37.412388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 713/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:38.220654 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b32de3-4614-423d-be3f-b8551ad114f8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:38.221670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b32de3-4614-423d-be3f-b8551ad114f8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:38.221670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b32de3-4614-423d-be3f-b8551ad114f8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:38.223844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 02:38:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:38.230505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08fa60-87c5-45ec-945b-0679351a5c87 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:38.230945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08fa60-87c5-45ec-945b-0679351a5c87 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:38.231117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08fa60-87c5-45ec-945b-0679351a5c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:38.316816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1f08fa60-87c5-45ec-945b-0679351a5c87 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:38.318657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1f08fa60-87c5-45ec-945b-0679351a5c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:38.392985 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:38.424727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 02:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:38.582553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b32de3-4614-423d-be3f-b8551ad114f8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:38.584833 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a2b32de3-4614-423d-be3f-b8551ad114f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:38.604647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:38.742484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b32de3-4614-423d-be3f-b8551ad114f8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:38.836956 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:38.865932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6adf54-82f7-462b-b974-f58cb825700f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:38.866581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6adf54-82f7-462b-b974-f58cb825700f service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:38.866858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6adf54-82f7-462b-b974-f58cb825700f service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:38.867129 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6adf54-82f7-462b-b974-f58cb825700f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:38.868886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7f6adf54-82f7-462b-b974-f58cb825700f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:38.968040 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6adf54-82f7-462b-b974-f58cb825700f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:38.969747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6adf54-82f7-462b-b974-f58cb825700f service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:38.988925 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 720/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:39.787740 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829624c0-2621-42fb-b32e-04856ac1bff9 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:39.788467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829624c0-2621-42fb-b32e-04856ac1bff9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:39.788625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829624c0-2621-42fb-b32e-04856ac1bff9 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:39.790583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 02:38:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:39.795803 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16f90b-d9e4-4a81-bfa9-45c1eac18b5e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:39.796276 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16f90b-d9e4-4a81-bfa9-45c1eac18b5e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:39.796387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16f90b-d9e4-4a81-bfa9-45c1eac18b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:39.884665 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-db16f90b-d9e4-4a81-bfa9-45c1eac18b5e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:39.885945 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-db16f90b-d9e4-4a81-bfa9-45c1eac18b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:39.930239 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:39.986404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 02:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:40.148077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829624c0-2621-42fb-b32e-04856ac1bff9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:40.150130 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-829624c0-2621-42fb-b32e-04856ac1bff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:40.301321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829624c0-2621-42fb-b32e-04856ac1bff9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:40.355988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:40.420767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1c20a-9f74-470c-9155-81484e81bcaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:40.421318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1c20a-9f74-470c-9155-81484e81bcaa service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:40.421605 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1c20a-9f74-470c-9155-81484e81bcaa service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:40.421867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1c20a-9f74-470c-9155-81484e81bcaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:40.423485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1ea1c20a-9f74-470c-9155-81484e81bcaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:40.518592 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1c20a-9f74-470c-9155-81484e81bcaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:40.520216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1c20a-9f74-470c-9155-81484e81bcaa service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:40.538723 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 716/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:41.330710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b7384-76db-4234-ac98-6b0119ff8907 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:41.331466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b7384-76db-4234-ac98-6b0119ff8907 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:41.331466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b7384-76db-4234-ac98-6b0119ff8907 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:41.333310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 02:38:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:41.340998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0c5b0-98f7-41ad-ba6c-99fd96dd4eb0 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:41.341687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0c5b0-98f7-41ad-ba6c-99fd96dd4eb0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:41.341854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0c5b0-98f7-41ad-ba6c-99fd96dd4eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:41.429375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-47a0c5b0-98f7-41ad-ba6c-99fd96dd4eb0 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:41.430577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-47a0c5b0-98f7-41ad-ba6c-99fd96dd4eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:41.432567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:41.536436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 02:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:41.688183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b7384-76db-4234-ac98-6b0119ff8907 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:41.690531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-955b7384-76db-4234-ac98-6b0119ff8907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:41.848388 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b7384-76db-4234-ac98-6b0119ff8907 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:41.878103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:41.970691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37307b-8df7-4cec-a872-3a5529c389ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:41.971214 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37307b-8df7-4cec-a872-3a5529c389ab service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:41.971485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37307b-8df7-4cec-a872-3a5529c389ab service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:41.971745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37307b-8df7-4cec-a872-3a5529c389ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:41.973366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fa37307b-8df7-4cec-a872-3a5529c389ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:42.073043 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37307b-8df7-4cec-a872-3a5529c389ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:42.074727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37307b-8df7-4cec-a872-3a5529c389ab service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:42.094147 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 723/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:43.986428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fde09-14ff-466a-adfa-2f35e9a261df None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:43.987306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fde09-14ff-466a-adfa-2f35e9a261df None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:43.987306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fde09-14ff-466a-adfa-2f35e9a261df None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:43.989503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:38:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:43.997490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c64615-9f94-45e9-9bb9-dc7b41ed47b4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:43.997935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c64615-9f94-45e9-9bb9-dc7b41ed47b4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:43.998032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c64615-9f94-45e9-9bb9-dc7b41ed47b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:44.044619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:44.072589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-07c64615-9f94-45e9-9bb9-dc7b41ed47b4 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:44.073847 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-07c64615-9f94-45e9-9bb9-dc7b41ed47b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:44.176834 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:44.218431 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fde09-14ff-466a-adfa-2f35e9a261df None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:44.220039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b76fde09-14ff-466a-adfa-2f35e9a261df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:44.331601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fde09-14ff-466a-adfa-2f35e9a261df None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:44.363290 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:44.405041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0cc0b-7178-43e1-9056-cbf2e5381a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:44.405688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0cc0b-7178-43e1-9056-cbf2e5381a87 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:44.405963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0cc0b-7178-43e1-9056-cbf2e5381a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:44.406204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0cc0b-7178-43e1-9056-cbf2e5381a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:44.407799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-dae0cc0b-7178-43e1-9056-cbf2e5381a87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:44.521717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0cc0b-7178-43e1-9056-cbf2e5381a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:44.523235 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0cc0b-7178-43e1-9056-cbf2e5381a87 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:44.548638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 719/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:46.690567 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b31759-1ef6-4135-820e-a6122d31bcb9 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:46.691120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b31759-1ef6-4135-820e-a6122d31bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:46.691120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b31759-1ef6-4135-820e-a6122d31bcb9 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:46.692506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:46.698915 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dd163-49bd-4b8d-9e14-93757a6d703c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:46.699392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dd163-49bd-4b8d-9e14-93757a6d703c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:46.699490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899dd163-49bd-4b8d-9e14-93757a6d703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:46.773984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-899dd163-49bd-4b8d-9e14-93757a6d703c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:46.775180 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-899dd163-49bd-4b8d-9e14-93757a6d703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:46.788382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:46.874883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:46.915853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b31759-1ef6-4135-820e-a6122d31bcb9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:46.918348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e5b31759-1ef6-4135-820e-a6122d31bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:47.029404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b31759-1ef6-4135-820e-a6122d31bcb9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:47.042150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:47.105422 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dac26b-a76e-480c-ae01-9b40d477045b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:47.106055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dac26b-a76e-480c-ae01-9b40d477045b service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:47.106336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dac26b-a76e-480c-ae01-9b40d477045b service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:47.106608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dac26b-a76e-480c-ae01-9b40d477045b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:47.108242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-64dac26b-a76e-480c-ae01-9b40d477045b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:47.230153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dac26b-a76e-480c-ae01-9b40d477045b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:47.231509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dac26b-a76e-480c-ae01-9b40d477045b service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:47.249934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 726/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:49.566472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63549bf-550a-4ba6-973b-b130d6cb6989 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:49.567069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63549bf-550a-4ba6-973b-b130d6cb6989 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:49.567069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63549bf-550a-4ba6-973b-b130d6cb6989 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:49.568779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:49.574879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1d36d-7716-4fcf-a34f-e6146b4f97fd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:49.575388 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1d36d-7716-4fcf-a34f-e6146b4f97fd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:49.575388 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1d36d-7716-4fcf-a34f-e6146b4f97fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:49.626119 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:49.646318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c9e1d36d-7716-4fcf-a34f-e6146b4f97fd None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:49.647549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c9e1d36d-7716-4fcf-a34f-e6146b4f97fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:49.744351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:49.793148 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63549bf-550a-4ba6-973b-b130d6cb6989 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:49.795630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a63549bf-550a-4ba6-973b-b130d6cb6989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:49.919797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63549bf-550a-4ba6-973b-b130d6cb6989 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:49.963065 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:49.999312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c357b7-8994-446c-8026-a596b7e6760f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:49.999938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c357b7-8994-446c-8026-a596b7e6760f service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:50.000217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c357b7-8994-446c-8026-a596b7e6760f service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:50.000491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c357b7-8994-446c-8026-a596b7e6760f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:50.002177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-89c357b7-8994-446c-8026-a596b7e6760f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:50.114499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c357b7-8994-446c-8026-a596b7e6760f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:50.115955 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c357b7-8994-446c-8026-a596b7e6760f service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:50.134423 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 722/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:52.244557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e3666-5b14-45c9-a0ed-15878c0cf369 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:52.245174 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e3666-5b14-45c9-a0ed-15878c0cf369 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:52.245174 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e3666-5b14-45c9-a0ed-15878c0cf369 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:52.246724 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:52.252516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9801f62-09f7-4241-b267-b3790eb0c9da None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:52.252965 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9801f62-09f7-4241-b267-b3790eb0c9da None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:52.253096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9801f62-09f7-4241-b267-b3790eb0c9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:52.320971 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c9801f62-09f7-4241-b267-b3790eb0c9da None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:52.322196 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c9801f62-09f7-4241-b267-b3790eb0c9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:52.348060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:52.427654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:38:52.469433 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e3666-5b14-45c9-a0ed-15878c0cf369 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:52.470984 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-767e3666-5b14-45c9-a0ed-15878c0cf369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:52.581931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e3666-5b14-45c9-a0ed-15878c0cf369 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:52.602764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:52.659844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15364729-1302-4890-a46c-da19801330fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:52.660477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364729-1302-4890-a46c-da19801330fa service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:52.660758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364729-1302-4890-a46c-da19801330fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:52.661033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15364729-1302-4890-a46c-da19801330fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:52.662700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-15364729-1302-4890-a46c-da19801330fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:52.778997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364729-1302-4890-a46c-da19801330fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:52.780447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15364729-1302-4890-a46c-da19801330fa service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:52.799280 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 729/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:54.822876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a4522-481d-4d65-b1fd-07289b9a8f20 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:54.823547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a4522-481d-4d65-b1fd-07289b9a8f20 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:54.823547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a4522-481d-4d65-b1fd-07289b9a8f20 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:54.824840 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:54.831363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144794d-7686-4b1d-810a-e311fe5f0eed None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:54.832052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144794d-7686-4b1d-810a-e311fe5f0eed None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:54.832213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144794d-7686-4b1d-810a-e311fe5f0eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:54.907661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:54.912562 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7144794d-7686-4b1d-810a-e311fe5f0eed None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:54.914504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7144794d-7686-4b1d-810a-e311fe5f0eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:55.029614 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:38:55.070221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a4522-481d-4d65-b1fd-07289b9a8f20 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:55.072618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-473a4522-481d-4d65-b1fd-07289b9a8f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:55.201161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a4522-481d-4d65-b1fd-07289b9a8f20 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:55.262203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:55.287555 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72613b-fb6c-48e2-8a7d-7b52a4a2ac8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:55.288203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72613b-fb6c-48e2-8a7d-7b52a4a2ac8a service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:55.288571 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72613b-fb6c-48e2-8a7d-7b52a4a2ac8a service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:55.288913 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72613b-fb6c-48e2-8a7d-7b52a4a2ac8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:55.290754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0b72613b-fb6c-48e2-8a7d-7b52a4a2ac8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:55.406336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72613b-fb6c-48e2-8a7d-7b52a4a2ac8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:55.407788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72613b-fb6c-48e2-8a7d-7b52a4a2ac8a service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:55.426855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 725/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:38:57.477940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543589cb-9630-442a-9f95-63a03ebed909 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:57.478534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543589cb-9630-442a-9f95-63a03ebed909 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:57.478534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543589cb-9630-442a-9f95-63a03ebed909 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:57.480667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:38:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:38:57.488829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f2dde-675f-4051-93c6-aca0a13935c3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:57.489331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f2dde-675f-4051-93c6-aca0a13935c3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:57.489444 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f2dde-675f-4051-93c6-aca0a13935c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:57.557306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-8e7f2dde-675f-4051-93c6-aca0a13935c3 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:38:57.558898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8e7f2dde-675f-4051-93c6-aca0a13935c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:57.589166 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:57.664660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:38:57.706426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543589cb-9630-442a-9f95-63a03ebed909 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:38:57.707965 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-543589cb-9630-442a-9f95-63a03ebed909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:57.820882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543589cb-9630-442a-9f95-63a03ebed909 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:38:57.856340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:38:57.903862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fa0d2-ea2d-4c34-a580-ee942a485c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:38:57.904577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fa0d2-ea2d-4c34-a580-ee942a485c9a service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:38:57.904827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fa0d2-ea2d-4c34-a580-ee942a485c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:38:57.905096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fa0d2-ea2d-4c34-a580-ee942a485c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:38:57.906762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9f2fa0d2-ea2d-4c34-a580-ee942a485c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:38:58.029527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fa0d2-ea2d-4c34-a580-ee942a485c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:38:58.030979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fa0d2-ea2d-4c34-a580-ee942a485c9a service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:38:58.049478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 732/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:39:00.089371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49710b3e-b219-4afa-8fa1-a8f1b0bf16a5 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:00.089931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49710b3e-b219-4afa-8fa1-a8f1b0bf16a5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:00.089931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49710b3e-b219-4afa-8fa1-a8f1b0bf16a5 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:00.091234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:39:00.098183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff7992-a83f-40bb-88e4-c4647a63800b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:00.098956 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff7992-a83f-40bb-88e4-c4647a63800b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:00.099075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff7992-a83f-40bb-88e4-c4647a63800b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:00.168258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-dbff7992-a83f-40bb-88e4-c4647a63800b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:39:00.169533 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dbff7992-a83f-40bb-88e4-c4647a63800b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:00.177989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:00.270717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:39:00.310766 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49710b3e-b219-4afa-8fa1-a8f1b0bf16a5 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:39:00.313207 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-49710b3e-b219-4afa-8fa1-a8f1b0bf16a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:00.439375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49710b3e-b219-4afa-8fa1-a8f1b0bf16a5 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:39:00.496532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:00.526124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458b25c-6594-4945-8af7-443ecc3d6481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:39:00.527076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458b25c-6594-4945-8af7-443ecc3d6481 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:00.527366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458b25c-6594-4945-8af7-443ecc3d6481 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:00.527666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458b25c-6594-4945-8af7-443ecc3d6481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:00.529320 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c458b25c-6594-4945-8af7-443ecc3d6481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:00.646895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458b25c-6594-4945-8af7-443ecc3d6481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:39:00.648359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458b25c-6594-4945-8af7-443ecc3d6481 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:39:00.667139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 728/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:39:02.702974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8ed35-0520-4475-8961-276c3ef41494 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:02.703553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8ed35-0520-4475-8961-276c3ef41494 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:02.703553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8ed35-0520-4475-8961-276c3ef41494 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:02.704928 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:39:02.710382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605f3f-b240-478c-8ffc-f2af96af59a1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:02.710830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605f3f-b240-478c-8ffc-f2af96af59a1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:02.710941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605f3f-b240-478c-8ffc-f2af96af59a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:02.906001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-90605f3f-b240-478c-8ffc-f2af96af59a1 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:39:02.907251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-90605f3f-b240-478c-8ffc-f2af96af59a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:02.944425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:03.006061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:39:03.045956 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8ed35-0520-4475-8961-276c3ef41494 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:39:03.048310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-72e8ed35-0520-4475-8961-276c3ef41494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:03.164677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e8ed35-0520-4475-8961-276c3ef41494 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:39:03.204221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:03.241176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e39f5d-7bb8-49e9-a979-64f49d29161e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:39:03.241836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e39f5d-7bb8-49e9-a979-64f49d29161e service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:03.242118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e39f5d-7bb8-49e9-a979-64f49d29161e service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:03.242391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e39f5d-7bb8-49e9-a979-64f49d29161e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:03.244030 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-36e39f5d-7bb8-49e9-a979-64f49d29161e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:03.368729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e39f5d-7bb8-49e9-a979-64f49d29161e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:39:03.370233 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e39f5d-7bb8-49e9-a979-64f49d29161e service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:39:03.388797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 735/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:39:05.426209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6019c4-2ed7-41a5-a737-d3590e676c85 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:05.426785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6019c4-2ed7-41a5-a737-d3590e676c85 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:05.426785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6019c4-2ed7-41a5-a737-d3590e676c85 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:05.428093 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:39:05.434657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a41b7-8afc-4645-9ecc-c5731fd91b24 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:05.435409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a41b7-8afc-4645-9ecc-c5731fd91b24 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:05.435602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a41b7-8afc-4645-9ecc-c5731fd91b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:05.511141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-653a41b7-8afc-4645-9ecc-c5731fd91b24 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:39:05.512393 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-653a41b7-8afc-4645-9ecc-c5731fd91b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:05.530640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:05.619921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:39:05.656723 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6019c4-2ed7-41a5-a737-d3590e676c85 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:39:05.658433 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2e6019c4-2ed7-41a5-a737-d3590e676c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:05.772735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6019c4-2ed7-41a5-a737-d3590e676c85 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:39:05.846809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:05.857568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86cbcd-0bf8-4a24-80d1-37cc7ba43114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:39:05.858530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86cbcd-0bf8-4a24-80d1-37cc7ba43114 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:05.858950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86cbcd-0bf8-4a24-80d1-37cc7ba43114 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:05.859368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86cbcd-0bf8-4a24-80d1-37cc7ba43114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:05.862105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4e86cbcd-0bf8-4a24-80d1-37cc7ba43114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:05.993418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86cbcd-0bf8-4a24-80d1-37cc7ba43114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:39:05.994868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86cbcd-0bf8-4a24-80d1-37cc7ba43114 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:39:06.013185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 731/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:39:08.016573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb10e2b-7552-424e-ad35-d6a568a00a79 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:08.017246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb10e2b-7552-424e-ad35-d6a568a00a79 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:08.017246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb10e2b-7552-424e-ad35-d6a568a00a79 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:08.018465 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:39:08.024783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa324250-f069-4fa0-ae11-ea75cab69681 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:08.025558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa324250-f069-4fa0-ae11-ea75cab69681 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:08.025728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa324250-f069-4fa0-ae11-ea75cab69681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:08.099725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-fa324250-f069-4fa0-ae11-ea75cab69681 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:39:08.100949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fa324250-f069-4fa0-ae11-ea75cab69681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:08.152268 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:08.201777 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:39:08.249244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb10e2b-7552-424e-ad35-d6a568a00a79 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:39:08.250807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cdb10e2b-7552-424e-ad35-d6a568a00a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:08.369026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb10e2b-7552-424e-ad35-d6a568a00a79 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:39:08.420269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:08.447639 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b9b7c-b508-41ac-80de-9303d30237bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:39:08.448258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b9b7c-b508-41ac-80de-9303d30237bf service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:08.448532 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b9b7c-b508-41ac-80de-9303d30237bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:08.448921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b9b7c-b508-41ac-80de-9303d30237bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:08.450572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5c3b9b7c-b508-41ac-80de-9303d30237bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:08.574058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b9b7c-b508-41ac-80de-9303d30237bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:39:08.575497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b9b7c-b508-41ac-80de-9303d30237bf service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:39:08.595181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 738/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:39:18.199755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=22 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:18.592180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=66 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:27.876657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7157614-7bfa-4085-b266-533d6b86c5d9 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:27.877444 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7157614-7bfa-4085-b266-533d6b86c5d9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:27.877444 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7157614-7bfa-4085-b266-533d6b86c5d9 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:27.879726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 733/1471] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:39:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:39:27.885356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d20650-4685-4e46-9201-a4c94a466960 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:27.885788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d20650-4685-4e46-9201-a4c94a466960 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:27.885903 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d20650-4685-4e46-9201-a4c94a466960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:27.963648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-50d20650-4685-4e46-9201-a4c94a466960 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:39:27.964873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-50d20650-4685-4e46-9201-a4c94a466960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:28.081226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 739/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:39:28.168081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc5480-8626-461d-95ec-e584d3741727 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:28.168366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc5480-8626-461d-95ec-e584d3741727 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:28.168635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc5480-8626-461d-95ec-e584d3741727 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:28.170013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 734/1473] 10.222.0.39 () {54 vars in 966 bytes} [Tue Jul 26 02:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:39:28.175164 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569f2a-d5b3-436b-affa-162036fe8406 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:28.175454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569f2a-d5b3-436b-affa-162036fe8406 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:28.175731 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65569f2a-d5b3-436b-affa-162036fe8406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:28.255248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-65569f2a-d5b3-436b-affa-162036fe8406 None None] MFA Rules not processed for user `2402339784b34d98a4670db912617331`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:39:28.256451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-65569f2a-d5b3-436b-affa-162036fe8406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:28.277568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:28.346549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 740/1474] 10.222.0.39 () {58 vars in 1063 bytes} [Tue Jul 26 02:39:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:39:28.358276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc5480-8626-461d-95ec-e584d3741727 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:39:28.360583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d7cc5480-8626-461d-95ec-e584d3741727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:28.470895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc5480-8626-461d-95ec-e584d3741727 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:39:28.547704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b0c8e-6033-4685-805e-8b10febd42b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2402339784b34d98a4670db912617331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:39:28.548330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b0c8e-6033-4685-805e-8b10febd42b8 service glance] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:28.548607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b0c8e-6033-4685-805e-8b10febd42b8 service glance] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:28.548875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b0c8e-6033-4685-805e-8b10febd42b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:28.550536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e73b0c8e-6033-4685-805e-8b10febd42b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:28.605889 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:28.668609 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b0c8e-6033-4685-805e-8b10febd42b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:39:28.670105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73b0c8e-6033-4685-805e-8b10febd42b8 service glance] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:39:28.689748 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 735/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:39:30.761320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713c019-2069-4088-8e68-68b764448843 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:30.762023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713c019-2069-4088-8e68-68b764448843 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:30.762023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713c019-2069-4088-8e68-68b764448843 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:30.763358 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 741/1476] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:39:30.769553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1198ef-7947-4320-b9ff-060af0854486 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:30.769985 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1198ef-7947-4320-b9ff-060af0854486 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:30.770108 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1198ef-7947-4320-b9ff-060af0854486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:30.850188 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6d1198ef-7947-4320-b9ff-060af0854486 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:39:30.851397 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6d1198ef-7947-4320-b9ff-060af0854486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:30.958142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 736/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:39:30.981847 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713c019-2069-4088-8e68-68b764448843 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:39:30.983376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8713c019-2069-4088-8e68-68b764448843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:31.115292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713c019-2069-4088-8e68-68b764448843 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:39:31.168284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:31.215256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4607d-f808-4fd4-ab9e-a228baf5fa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:39:31.215812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4607d-f808-4fd4-ab9e-a228baf5fa48 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:31.216089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4607d-f808-4fd4-ab9e-a228baf5fa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:31.216359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4607d-f808-4fd4-ab9e-a228baf5fa48 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:31.217056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4607d-f808-4fd4-ab9e-a228baf5fa48 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:39:31.219166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: WARNING py.warnings [None req-36a4607d-f808-4fd4-ab9e-a228baf5fa48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:39:31.219166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: warnings.warn(msg) Jul 26 02:39:31.219166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: Jul 26 02:39:31.220343 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4607d-f808-4fd4-ab9e-a228baf5fa48 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:39:31.239681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 742/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 02:39:30 2022] GET /identity/v3/projects => generated 2553 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:39:33.274656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969aefe-5132-4eae-ad36-6d8939a9ba65 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:33.275304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969aefe-5132-4eae-ad36-6d8939a9ba65 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:33.275304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969aefe-5132-4eae-ad36-6d8939a9ba65 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:33.276574 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 737/1479] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:39:33.282970 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b35505-1193-48c0-9e49-5c4bb8ff728b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:33.283732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b35505-1193-48c0-9e49-5c4bb8ff728b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:33.283839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b35505-1193-48c0-9e49-5c4bb8ff728b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:33.370035 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-50b35505-1193-48c0-9e49-5c4bb8ff728b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:39:33.371671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-50b35505-1193-48c0-9e49-5c4bb8ff728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:33.491625 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 743/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:39:33.538553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969aefe-5132-4eae-ad36-6d8939a9ba65 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:39:33.541033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8969aefe-5132-4eae-ad36-6d8939a9ba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:33.556555 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:33.708469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969aefe-5132-4eae-ad36-6d8939a9ba65 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:39:33.794967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:33.829438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16ef86-8c1f-4ef6-be68-9d0d9c8249c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:39:33.830166 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16ef86-8c1f-4ef6-be68-9d0d9c8249c3 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:33.830450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16ef86-8c1f-4ef6-be68-9d0d9c8249c3 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:33.830717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16ef86-8c1f-4ef6-be68-9d0d9c8249c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:33.832357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7a16ef86-8c1f-4ef6-be68-9d0d9c8249c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:33.925255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16ef86-8c1f-4ef6-be68-9d0d9c8249c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:39:33.926882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16ef86-8c1f-4ef6-be68-9d0d9c8249c3 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:39:33.945006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 738/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:39:36.136856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4f766-34f7-4457-87a4-2e39dedfe51a None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:36.137751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4f766-34f7-4457-87a4-2e39dedfe51a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:36.137751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4f766-34f7-4457-87a4-2e39dedfe51a None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:36.139689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 744/1482] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:39:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:39:36.146144 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5e54-758e-4f0a-b3f7-9f4fa64516e5 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:36.146593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5e54-758e-4f0a-b3f7-9f4fa64516e5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:36.146732 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb5e54-758e-4f0a-b3f7-9f4fa64516e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:36.226887 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-64eb5e54-758e-4f0a-b3f7-9f4fa64516e5 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:39:36.228741 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-64eb5e54-758e-4f0a-b3f7-9f4fa64516e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:36.277104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:36.328866 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 739/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:39:36.365119 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4f766-34f7-4457-87a4-2e39dedfe51a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:39:36.366683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-18f4f766-34f7-4457-87a4-2e39dedfe51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:36.392383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:36.484091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4f766-34f7-4457-87a4-2e39dedfe51a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:39:36.560176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f1202-8dc4-4199-9716-e097123a5174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:39:36.560800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1202-8dc4-4199-9716-e097123a5174 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:36.561088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1202-8dc4-4199-9716-e097123a5174 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:36.561397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1202-8dc4-4199-9716-e097123a5174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:36.563039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bc1f1202-8dc4-4199-9716-e097123a5174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:36.639024 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:36.680606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f1202-8dc4-4199-9716-e097123a5174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:39:36.682226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f1202-8dc4-4199-9716-e097123a5174 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:39:36.702467 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 745/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:39:38.739376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4152170-2601-451c-8a1c-8c6951060941 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:38.739914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4152170-2601-451c-8a1c-8c6951060941 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:38.740028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4152170-2601-451c-8a1c-8c6951060941 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:38.742211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 740/1485] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:39:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:39:38.749411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae008d02-4f8c-4fed-b98d-3ba192e97430 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:38.749918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae008d02-4f8c-4fed-b98d-3ba192e97430 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:38.749918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae008d02-4f8c-4fed-b98d-3ba192e97430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:38.815606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ae008d02-4f8c-4fed-b98d-3ba192e97430 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:39:38.816793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ae008d02-4f8c-4fed-b98d-3ba192e97430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:38.917323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 746/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:39:38.969417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4152170-2601-451c-8a1c-8c6951060941 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:39:38.971717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f4152170-2601-451c-8a1c-8c6951060941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:39.087445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4152170-2601-451c-8a1c-8c6951060941 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:39:39.163878 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:39.166203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147f2d8-b03e-4074-824c-113c3c345b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:39:39.167302 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147f2d8-b03e-4074-824c-113c3c345b30 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:39.167824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147f2d8-b03e-4074-824c-113c3c345b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:39.168152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147f2d8-b03e-4074-824c-113c3c345b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:39.170654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4147f2d8-b03e-4074-824c-113c3c345b30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:39.284626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147f2d8-b03e-4074-824c-113c3c345b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:39:39.286108 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147f2d8-b03e-4074-824c-113c3c345b30 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:39:39.304439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 741/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:39:41.408373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892e152-3694-4fd6-9a02-8467b4a2bba8 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:41.408967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892e152-3694-4fd6-9a02-8467b4a2bba8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:41.408967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892e152-3694-4fd6-9a02-8467b4a2bba8 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:41.410336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 747/1488] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:39:41.416350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b564ea5-22d7-43b1-8ced-7ff21900ce4d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:41.416897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b564ea5-22d7-43b1-8ced-7ff21900ce4d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:41.417059 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b564ea5-22d7-43b1-8ced-7ff21900ce4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:41.496798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3b564ea5-22d7-43b1-8ced-7ff21900ce4d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:39:41.498094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3b564ea5-22d7-43b1-8ced-7ff21900ce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:41.552025 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:41.599671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 742/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:39:41.645846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892e152-3694-4fd6-9a02-8467b4a2bba8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:39:41.647392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1892e152-3694-4fd6-9a02-8467b4a2bba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:41.685220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:41.756549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892e152-3694-4fd6-9a02-8467b4a2bba8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:39:41.835175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d6655-0485-4505-8f53-a54b74a3721f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:39:41.835801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d6655-0485-4505-8f53-a54b74a3721f service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:41.836077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d6655-0485-4505-8f53-a54b74a3721f service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:41.836343 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d6655-0485-4505-8f53-a54b74a3721f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:41.838005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a05d6655-0485-4505-8f53-a54b74a3721f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:41.922858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:41.952769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d6655-0485-4505-8f53-a54b74a3721f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:39:41.954180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d6655-0485-4505-8f53-a54b74a3721f service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:39:41.973436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 748/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:39:44.186070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b5f7c-b76f-4484-822c-aa7af3cf2c08 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:44.187046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b5f7c-b76f-4484-822c-aa7af3cf2c08 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:44.187046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b5f7c-b76f-4484-822c-aa7af3cf2c08 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:44.189265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 743/1491] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 02:39:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:39:44.195636 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0df155-3288-4b1e-ad9f-c1832d77c15c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:44.196402 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0df155-3288-4b1e-ad9f-c1832d77c15c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:44.196596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0df155-3288-4b1e-ad9f-c1832d77c15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:44.273100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-cd0df155-3288-4b1e-ad9f-c1832d77c15c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:39:44.274698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cd0df155-3288-4b1e-ad9f-c1832d77c15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:44.372843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 749/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 02:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:39:44.413569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b5f7c-b76f-4484-822c-aa7af3cf2c08 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:39:44.415110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c35b5f7c-b76f-4484-822c-aa7af3cf2c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:44.532436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b5f7c-b76f-4484-822c-aa7af3cf2c08 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:39:44.617060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e381e-3544-41df-96c3-d7b1de064bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:39:44.617722 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e381e-3544-41df-96c3-d7b1de064bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:39:44.617997 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e381e-3544-41df-96c3-d7b1de064bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:39:44.618266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e381e-3544-41df-96c3-d7b1de064bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:39:44.619898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-081e381e-3544-41df-96c3-d7b1de064bc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:39:44.629547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:44.741610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e381e-3544-41df-96c3-d7b1de064bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:39:44.743063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e381e-3544-41df-96c3-d7b1de064bc7 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:39:44.761635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 744/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:39:54.371001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=82 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:39:54.758982 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=50 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:41:18.283416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6103d-9115-4984-be83-0bd00d5e4ecb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:18.284357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6103d-9115-4984-be83-0bd00d5e4ecb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:18.284357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6103d-9115-4984-be83-0bd00d5e4ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:18.374202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fde6103d-9115-4984-be83-0bd00d5e4ecb None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:41:18.375421 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fde6103d-9115-4984-be83-0bd00d5e4ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:18.474269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 750/1494] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:41:18.482943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3542-d8bd-4392-9134-f21a21c7772f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:18.483457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3542-d8bd-4392-9134-f21a21c7772f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:18.483457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3542-d8bd-4392-9134-f21a21c7772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:18.565608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-300c3542-d8bd-4392-9134-f21a21c7772f None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:41:18.566742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-300c3542-d8bd-4392-9134-f21a21c7772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:18.674369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 745/1495] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:41:18.679610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6103d-9115-4984-be83-0bd00d5e4ecb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:41:18.680833 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fde6103d-9115-4984-be83-0bd00d5e4ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:18.693126 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6103d-9115-4984-be83-0bd00d5e4ecb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:41:18.758546 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:41:18.802218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e6005-b817-45b3-af95-852b044b91e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:41:18.802843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e6005-b817-45b3-af95-852b044b91e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:18.803124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e6005-b817-45b3-af95-852b044b91e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:18.803394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e6005-b817-45b3-af95-852b044b91e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:18.804094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e6005-b817-45b3-af95-852b044b91e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:41:18.804396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e6005-b817-45b3-af95-852b044b91e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:41:18.805458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: WARNING py.warnings [None req-e00e6005-b817-45b3-af95-852b044b91e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:41:18.805458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: warnings.warn(msg) Jul 26 02:41:18.805458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: Jul 26 02:41:18.806350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e6005-b817-45b3-af95-852b044b91e7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:41:18.818422 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 751/1496] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:41:18.827110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c3542-d8bd-4392-9134-f21a21c7772f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:41:18.836697 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c3542-d8bd-4392-9134-f21a21c7772f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:41:18.901318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:41:18.938379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65232e1a-c0e8-4706-b7d6-7ab6c39e8fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:41:18.939004 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65232e1a-c0e8-4706-b7d6-7ab6c39e8fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:18.939282 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65232e1a-c0e8-4706-b7d6-7ab6c39e8fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:18.939638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65232e1a-c0e8-4706-b7d6-7ab6c39e8fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:18.940329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65232e1a-c0e8-4706-b7d6-7ab6c39e8fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:41:18.942141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: WARNING py.warnings [None req-65232e1a-c0e8-4706-b7d6-7ab6c39e8fa8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:41:18.942141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: warnings.warn(msg) Jul 26 02:41:18.942141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: Jul 26 02:41:18.943351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65232e1a-c0e8-4706-b7d6-7ab6c39e8fa8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:41:19.010427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 746/1497] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:41:18 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:41:19.014812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e6005-b817-45b3-af95-852b044b91e7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:41:19.016329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e00e6005-b817-45b3-af95-852b044b91e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:19.051613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e6005-b817-45b3-af95-852b044b91e7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:41:19.156833 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e249d3-aad3-4c6a-83c0-b3096fc3ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:41:19.157490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e249d3-aad3-4c6a-83c0-b3096fc3ad27 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:19.157766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e249d3-aad3-4c6a-83c0-b3096fc3ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:19.158056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e249d3-aad3-4c6a-83c0-b3096fc3ad27 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:19.158735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e249d3-aad3-4c6a-83c0-b3096fc3ad27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:41:19.159734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: WARNING py.warnings [None req-03e249d3-aad3-4c6a-83c0-b3096fc3ad27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:41:19.159734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: warnings.warn(msg) Jul 26 02:41:19.159734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: Jul 26 02:41:19.160933 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e249d3-aad3-4c6a-83c0-b3096fc3ad27 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:41:19.205043 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 752/1498] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:41:19 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:41:19.209575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65232e1a-c0e8-4706-b7d6-7ab6c39e8fa8 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:41:19.211141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-65232e1a-c0e8-4706-b7d6-7ab6c39e8fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:19.272358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65232e1a-c0e8-4706-b7d6-7ab6c39e8fa8 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:41:19.362849 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:41:19.374955 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeeb834-7172-43de-a955-672bddfa8b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:41:19.375576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeb834-7172-43de-a955-672bddfa8b4e admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:19.375852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeb834-7172-43de-a955-672bddfa8b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:19.376125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeb834-7172-43de-a955-672bddfa8b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:19.376828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeeb834-7172-43de-a955-672bddfa8b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:41:19.377884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: WARNING py.warnings [None req-3aeeb834-7172-43de-a955-672bddfa8b4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:41:19.377884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: warnings.warn(msg) Jul 26 02:41:19.377884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: Jul 26 02:41:19.378766 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeeb834-7172-43de-a955-672bddfa8b4e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:41:19.391381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 747/1499] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:41:19.395760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e249d3-aad3-4c6a-83c0-b3096fc3ad27 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:41:19.397305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-03e249d3-aad3-4c6a-83c0-b3096fc3ad27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:19.409032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e249d3-aad3-4c6a-83c0-b3096fc3ad27 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:41:19.435375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:41:19.517188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de07b6-59ba-43cc-8b90-ff7ee3c85fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:41:19.517957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de07b6-59ba-43cc-8b90-ff7ee3c85fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:19.518237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de07b6-59ba-43cc-8b90-ff7ee3c85fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:19.518510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de07b6-59ba-43cc-8b90-ff7ee3c85fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:19.519214 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de07b6-59ba-43cc-8b90-ff7ee3c85fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:41:19.520236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: WARNING py.warnings [None req-04de07b6-59ba-43cc-8b90-ff7ee3c85fa5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:41:19.520236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: warnings.warn(msg) Jul 26 02:41:19.520236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: Jul 26 02:41:19.521131 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de07b6-59ba-43cc-8b90-ff7ee3c85fa5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:41:19.533489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 753/1500] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:41:19.538560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeeb834-7172-43de-a955-672bddfa8b4e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:41:19.540725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3aeeb834-7172-43de-a955-672bddfa8b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:19.578363 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeeb834-7172-43de-a955-672bddfa8b4e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:41:19.679750 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef728ca4-a119-4945-8afb-da68b3b6122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:41:19.680361 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef728ca4-a119-4945-8afb-da68b3b6122e admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:19.680640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef728ca4-a119-4945-8afb-da68b3b6122e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:19.680912 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef728ca4-a119-4945-8afb-da68b3b6122e admin admin] PATH_INFO: `/v3/projects/f2885920115a4315b9ecd6d418905e5e/users/b20375099c4a414baa66bf85e24f7ed2/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:19.706334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef728ca4-a119-4945-8afb-da68b3b6122e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2885920115a4315b9ecd6d418905e5e, user_id=b20375099c4a414baa66bf85e24f7ed2, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:41:19.707949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: WARNING py.warnings [None req-ef728ca4-a119-4945-8afb-da68b3b6122e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:41:19.707949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: warnings.warn(msg) Jul 26 02:41:19.707949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: Jul 26 02:41:19.711021 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef728ca4-a119-4945-8afb-da68b3b6122e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:41:19.751378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 748/1501] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:41:19 2022] PUT /identity/v3/projects/f2885920115a4315b9ecd6d418905e5e/users/b20375099c4a414baa66bf85e24f7ed2/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:41:19.765170 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1689cc6-404c-4d33-aedd-06fa324155b8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:19.765541 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1689cc6-404c-4d33-aedd-06fa324155b8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:19.765940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1689cc6-404c-4d33-aedd-06fa324155b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:19.829959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d1689cc6-404c-4d33-aedd-06fa324155b8 None None] MFA Rules not processed for user `b20375099c4a414baa66bf85e24f7ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:41:19.831188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d1689cc6-404c-4d33-aedd-06fa324155b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:19.912827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 754/1502] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:41:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:41:19.928079 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e933f3-1007-40cf-9be0-4a9ac51e36a2 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:19.928507 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e933f3-1007-40cf-9be0-4a9ac51e36a2 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:19.928953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e933f3-1007-40cf-9be0-4a9ac51e36a2 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:19.931127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 749/1503] 10.222.0.39 () {54 vars in 964 bytes} [Tue Jul 26 02:41:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:41:19.937962 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6b33-868b-4874-bc1a-ea90afd84576 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:19.938270 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6b33-868b-4874-bc1a-ea90afd84576 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:19.938523 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa6b33-868b-4874-bc1a-ea90afd84576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:19.973300 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:41:20.027832 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-30fa6b33-868b-4874-bc1a-ea90afd84576 None None] MFA Rules not processed for user `ba1305d4e5914f1182dc7436a2d53965`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:41:20.029056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-30fa6b33-868b-4874-bc1a-ea90afd84576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:20.107606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 755/1504] 10.222.0.39 () {58 vars in 1061 bytes} [Tue Jul 26 02:41:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:41:20.115817 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e933f3-1007-40cf-9be0-4a9ac51e36a2 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:41:20.117351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e9e933f3-1007-40cf-9be0-4a9ac51e36a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:20.176976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:41:20.234919 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e933f3-1007-40cf-9be0-4a9ac51e36a2 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:41:20.338570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b69383-cea1-4e7d-9816-bf319ad96006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:41:20.339206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b69383-cea1-4e7d-9816-bf319ad96006 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:20.339482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b69383-cea1-4e7d-9816-bf319ad96006 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:20.339753 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b69383-cea1-4e7d-9816-bf319ad96006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:20.341462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b7b69383-cea1-4e7d-9816-bf319ad96006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:20.448598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b69383-cea1-4e7d-9816-bf319ad96006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:41:20.450085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b69383-cea1-4e7d-9816-bf319ad96006 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:41:20.453630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:41:20.470547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 750/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:41:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:41:20.515427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42072314-890e-4af5-aa10-de5214e83319 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:20.515897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42072314-890e-4af5-aa10-de5214e83319 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:20.516000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42072314-890e-4af5-aa10-de5214e83319 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:20.517260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 756/1506] 10.222.0.39 () {52 vars in 830 bytes} [Tue Jul 26 02:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:41:20.521051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b69383-cea1-4e7d-9816-bf319ad96006 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:41:20.522383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b7b69383-cea1-4e7d-9816-bf319ad96006 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:20.632147 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b69383-cea1-4e7d-9816-bf319ad96006 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:41:20.735116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:41:20.735764 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:20.736049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:20.736318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] PATH_INFO: `/v3/users/b20375099c4a414baa66bf85e24f7ed2` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:20.751377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20375099c4a414baa66bf85e24f7ed2)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:41:20.752465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: WARNING py.warnings [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:41:20.752465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: warnings.warn(msg) Jul 26 02:41:20.752465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: Jul 26 02:41:20.753726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:41:20.767213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:41:20.823899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20375099c4a414baa66bf85e24f7ed2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:41:20.836194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20375099c4a414baa66bf85e24f7ed2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:41:20.836736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20375099c4a414baa66bf85e24f7ed2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:41:20.856848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20375099c4a414baa66bf85e24f7ed2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:41:20.857302 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20375099c4a414baa66bf85e24f7ed2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:41:20.879660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 751/1507] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:41:20 2022] DELETE /identity/v3/users/b20375099c4a414baa66bf85e24f7ed2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:41:20.884429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a7ec5-5ce7-4589-b439-e99fe1f9e065 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:20.884710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a7ec5-5ce7-4589-b439-e99fe1f9e065 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:20.884980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a7ec5-5ce7-4589-b439-e99fe1f9e065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:20.940989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-aa3a7ec5-5ce7-4589-b439-e99fe1f9e065 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:41:20.942247 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aa3a7ec5-5ce7-4589-b439-e99fe1f9e065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:21.020223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:41:21.037998 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 757/1508] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:41:21.048744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:41:21.050083 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:21.153083 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d61e9-621e-45f8-9e9b-8400edbb32e3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:41:21.209358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:41:21.230659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1192346-5d7e-44e4-a37d-f1a2d8f0ce4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:41:21.231286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1192346-5d7e-44e4-a37d-f1a2d8f0ce4f service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:21.231561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1192346-5d7e-44e4-a37d-f1a2d8f0ce4f service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:21.231831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1192346-5d7e-44e4-a37d-f1a2d8f0ce4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:21.233493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e1192346-5d7e-44e4-a37d-f1a2d8f0ce4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:21.349649 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1192346-5d7e-44e4-a37d-f1a2d8f0ce4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:41:21.351025 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1192346-5d7e-44e4-a37d-f1a2d8f0ce4f service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:41:21.370818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 752/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:41:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:41:21.704995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a7ec5-5ce7-4589-b439-e99fe1f9e065 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:41:21.706538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aa3a7ec5-5ce7-4589-b439-e99fe1f9e065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:41:21.719101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a7ec5-5ce7-4589-b439-e99fe1f9e065 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:41:21.824657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414cb5b-53ee-406f-bcac-10ce90191fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:41:21.825314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414cb5b-53ee-406f-bcac-10ce90191fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:41:21.825612 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414cb5b-53ee-406f-bcac-10ce90191fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:41:21.825875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414cb5b-53ee-406f-bcac-10ce90191fb1 admin admin] PATH_INFO: `/v3/projects/f2885920115a4315b9ecd6d418905e5e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:41:21.836014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414cb5b-53ee-406f-bcac-10ce90191fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2885920115a4315b9ecd6d418905e5e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:41:21.837047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: WARNING py.warnings [None req-6414cb5b-53ee-406f-bcac-10ce90191fb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:41:21.837047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: warnings.warn(msg) Jul 26 02:41:21.837047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: Jul 26 02:41:21.838266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414cb5b-53ee-406f-bcac-10ce90191fb1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:41:21.913053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6414cb5b-53ee-406f-bcac-10ce90191fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2885920115a4315b9ecd6d418905e5e', 'request_id': 'req-6414cb5b-53ee-406f-bcac-10ce90191fb1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:41:21.922614 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6414cb5b-53ee-406f-bcac-10ce90191fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2885920115a4315b9ecd6d418905e5e', 'request_id': 'req-6414cb5b-53ee-406f-bcac-10ce90191fb1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:41:21.929009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6414cb5b-53ee-406f-bcac-10ce90191fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2885920115a4315b9ecd6d418905e5e', 'request_id': 'req-6414cb5b-53ee-406f-bcac-10ce90191fb1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:41:21.960918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6414cb5b-53ee-406f-bcac-10ce90191fb1 admin admin] The token cache is being invalidate because project f2885920115a4315b9ecd6d418905e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:41:21.961201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6414cb5b-53ee-406f-bcac-10ce90191fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:41:21.961757 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6414cb5b-53ee-406f-bcac-10ce90191fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:41:21.963105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 758/1510] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:41:21 2022] DELETE /identity/v3/projects/f2885920115a4315b9ecd6d418905e5e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:41:31.368074 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=62 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:41:31.958615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:43:09.745654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f8bb7-a9ea-46fb-b379-06cf29776f10 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:09.747427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f8bb7-a9ea-46fb-b379-06cf29776f10 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:09.747427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f8bb7-a9ea-46fb-b379-06cf29776f10 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:09.747628 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 02:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:43:09.753742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4a19-3d0f-41bc-814f-20ca96b79837 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:09.753742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4a19-3d0f-41bc-814f-20ca96b79837 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:09.754306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4a19-3d0f-41bc-814f-20ca96b79837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:09.837997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ca0a4a19-3d0f-41bc-814f-20ca96b79837 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:43:09.839221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ca0a4a19-3d0f-41bc-814f-20ca96b79837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:09.963015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 02:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:43:10.117881 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f8bb7-a9ea-46fb-b379-06cf29776f10 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:43:10.120227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fa2f8bb7-a9ea-46fb-b379-06cf29776f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:10.254491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f8bb7-a9ea-46fb-b379-06cf29776f10 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:43:10.260939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70646c4b-b6d1-4131-b56a-a574511d9bec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:43:10.261601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70646c4b-b6d1-4131-b56a-a574511d9bec service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:10.261862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70646c4b-b6d1-4131-b56a-a574511d9bec service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:10.262139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70646c4b-b6d1-4131-b56a-a574511d9bec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:10.271409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70646c4b-b6d1-4131-b56a-a574511d9bec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:43:10.273015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70646c4b-b6d1-4131-b56a-a574511d9bec service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:43:10.283358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 754/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:43:11.116861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bd72c-c10b-41f8-a448-61da7e9f1fd5 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:11.117640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bd72c-c10b-41f8-a448-61da7e9f1fd5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:11.117640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bd72c-c10b-41f8-a448-61da7e9f1fd5 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:11.119028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 02:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:43:11.124228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0186bc9-3696-4365-8351-5f584aa0f5e8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:11.124746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0186bc9-3696-4365-8351-5f584aa0f5e8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:11.124746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0186bc9-3696-4365-8351-5f584aa0f5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:11.146737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a0186bc9-3696-4365-8351-5f584aa0f5e8 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:43:11.147956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a0186bc9-3696-4365-8351-5f584aa0f5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:11.156611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 02:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:43:11.321679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bd72c-c10b-41f8-a448-61da7e9f1fd5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:43:11.337693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bd72c-c10b-41f8-a448-61da7e9f1fd5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:43:11.345105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dc2b3-9bc2-4b54-8b30-9382174d1df3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:43:11.345791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dc2b3-9bc2-4b54-8b30-9382174d1df3 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:11.346066 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dc2b3-9bc2-4b54-8b30-9382174d1df3 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:11.346334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dc2b3-9bc2-4b54-8b30-9382174d1df3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:11.356037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dc2b3-9bc2-4b54-8b30-9382174d1df3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:43:11.357741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dc2b3-9bc2-4b54-8b30-9382174d1df3 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:43:11.367972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 761/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:43:11.789392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f521f-b670-49d3-a4c8-1ceec0568e0f None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:11.789662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f521f-b670-49d3-a4c8-1ceec0568e0f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:11.789939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f521f-b670-49d3-a4c8-1ceec0568e0f None None] PATH_INFO: `/v3` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:11.791597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 756/1517] 10.222.0.18 () {54 vars in 925 bytes} [Tue Jul 26 02:43:11 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:43:11.799093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc2dba-fd23-4948-b532-c870fd6af5f8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:11.799457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc2dba-fd23-4948-b532-c870fd6af5f8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:11.799739 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc2dba-fd23-4948-b532-c870fd6af5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:11.865590 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-38bc2dba-fd23-4948-b532-c870fd6af5f8 None None] MFA Rules not processed for user `629b38364f6a414aa14123c0749ba164`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:43:11.866794 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-38bc2dba-fd23-4948-b532-c870fd6af5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:11.885804 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:43:11.951428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 762/1518] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Jul 26 02:43:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:43:15.767027 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfcd9a-616f-49bb-a4e0-28b3997953f1 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:15.767601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfcd9a-616f-49bb-a4e0-28b3997953f1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:15.767601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfcd9a-616f-49bb-a4e0-28b3997953f1 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:15.769479 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 757/1519] 10.222.0.39 () {54 vars in 961 bytes} [Tue Jul 26 02:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:43:15.778068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340f5d5-f6b5-4e95-831e-2533eb619230 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:15.778496 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340f5d5-f6b5-4e95-831e-2533eb619230 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:15.778762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340f5d5-f6b5-4e95-831e-2533eb619230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:15.803181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f340f5d5-f6b5-4e95-831e-2533eb619230 None None] MFA Rules not processed for user `629b38364f6a414aa14123c0749ba164`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:43:15.804445 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f340f5d5-f6b5-4e95-831e-2533eb619230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:15.813687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 763/1520] 10.222.0.39 () {58 vars in 1058 bytes} [Tue Jul 26 02:43:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:43:15.821481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfcd9a-616f-49bb-a4e0-28b3997953f1 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:43:15.836672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfcd9a-616f-49bb-a4e0-28b3997953f1 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:43:15.842244 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283a0d2-246e-4bf3-97c2-0662bf1d5454 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629b38364f6a414aa14123c0749ba164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:43:15.843175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283a0d2-246e-4bf3-97c2-0662bf1d5454 service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:15.843455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283a0d2-246e-4bf3-97c2-0662bf1d5454 service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:15.843728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283a0d2-246e-4bf3-97c2-0662bf1d5454 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:15.852495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283a0d2-246e-4bf3-97c2-0662bf1d5454 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:43:15.854046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283a0d2-246e-4bf3-97c2-0662bf1d5454 service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:43:15.863845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 758/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:43:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:43:22.644721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e35204-9ea7-45a6-b226-2e2e8c64a929 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:22.645201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e35204-9ea7-45a6-b226-2e2e8c64a929 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:22.645318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e35204-9ea7-45a6-b226-2e2e8c64a929 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:22.647365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 02:43:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:43:22.652155 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab013534-a592-408a-8b0d-f36fa9cc7dc8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:22.652561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab013534-a592-408a-8b0d-f36fa9cc7dc8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:22.652710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab013534-a592-408a-8b0d-f36fa9cc7dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:22.673334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ab013534-a592-408a-8b0d-f36fa9cc7dc8 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:43:22.674572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ab013534-a592-408a-8b0d-f36fa9cc7dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:22.683062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 02:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:43:22.838119 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e35204-9ea7-45a6-b226-2e2e8c64a929 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:43:22.860150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e35204-9ea7-45a6-b226-2e2e8c64a929 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:43:22.866166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a2f0b-4539-48da-b982-11839454c52e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:43:22.866808 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a2f0b-4539-48da-b982-11839454c52e service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:22.867088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a2f0b-4539-48da-b982-11839454c52e service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:22.867352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a2f0b-4539-48da-b982-11839454c52e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:22.876425 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a2f0b-4539-48da-b982-11839454c52e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:43:22.878050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a2f0b-4539-48da-b982-11839454c52e service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:43:22.888332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 765/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:43:23.713080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd74d7-8466-4e67-a207-4041c79c1c50 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:23.713973 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd74d7-8466-4e67-a207-4041c79c1c50 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:23.714141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd74d7-8466-4e67-a207-4041c79c1c50 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:23.716752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 02:43:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:43:23.722213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cadeeb-dc81-43ed-8f11-1b2a2ff2dabd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:23.722681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cadeeb-dc81-43ed-8f11-1b2a2ff2dabd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:23.722778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cadeeb-dc81-43ed-8f11-1b2a2ff2dabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:23.743754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c7cadeeb-dc81-43ed-8f11-1b2a2ff2dabd None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:43:23.744941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c7cadeeb-dc81-43ed-8f11-1b2a2ff2dabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:23.753364 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 02:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:43:23.904382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd74d7-8466-4e67-a207-4041c79c1c50 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:43:23.920978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd74d7-8466-4e67-a207-4041c79c1c50 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:43:23.927123 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2912115-6d93-4d8e-a680-1ad3dc63c1cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:43:23.927730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2912115-6d93-4d8e-a680-1ad3dc63c1cb service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:23.928012 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2912115-6d93-4d8e-a680-1ad3dc63c1cb service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:23.928289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2912115-6d93-4d8e-a680-1ad3dc63c1cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:23.937054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2912115-6d93-4d8e-a680-1ad3dc63c1cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:43:23.938733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2912115-6d93-4d8e-a680-1ad3dc63c1cb service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:43:23.948679 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 761/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:43:27.932944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c029db3-5acd-49e0-ad6b-0cf2c0ce1ef2 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:27.933533 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c029db3-5acd-49e0-ad6b-0cf2c0ce1ef2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:27.933533 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c029db3-5acd-49e0-ad6b-0cf2c0ce1ef2 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:27.934849 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:43:27.940530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b486f-aafb-414d-bfd7-26655c1d99e5 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:27.940985 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b486f-aafb-414d-bfd7-26655c1d99e5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:27.941080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b486f-aafb-414d-bfd7-26655c1d99e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:27.968412 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-378b486f-aafb-414d-bfd7-26655c1d99e5 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:43:27.970494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-378b486f-aafb-414d-bfd7-26655c1d99e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:27.984621 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:43:28.059075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c029db3-5acd-49e0-ad6b-0cf2c0ce1ef2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:43:28.061072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9c029db3-5acd-49e0-ad6b-0cf2c0ce1ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:28.152726 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c029db3-5acd-49e0-ad6b-0cf2c0ce1ef2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:43:28.156432 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284fa2f-ebb6-4687-b461-7b7ecdde8a23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:43:28.157054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284fa2f-ebb6-4687-b461-7b7ecdde8a23 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:28.157368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284fa2f-ebb6-4687-b461-7b7ecdde8a23 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:28.157642 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284fa2f-ebb6-4687-b461-7b7ecdde8a23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:28.166659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284fa2f-ebb6-4687-b461-7b7ecdde8a23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:43:28.168090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284fa2f-ebb6-4687-b461-7b7ecdde8a23 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:43:28.177683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 768/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:43:30.181259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b87cc6-f861-4b20-b5e1-7fe30e4083b0 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:30.182225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b87cc6-f861-4b20-b5e1-7fe30e4083b0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:30.182400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b87cc6-f861-4b20-b5e1-7fe30e4083b0 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:30.184827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:43:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:43:30.192650 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0705d-f28c-4d51-b870-df9e982bb0ac None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:30.193094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0705d-f28c-4d51-b870-df9e982bb0ac None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:30.193197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0705d-f28c-4d51-b870-df9e982bb0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:30.214077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5ad0705d-f28c-4d51-b870-df9e982bb0ac None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:43:30.215263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5ad0705d-f28c-4d51-b870-df9e982bb0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:30.224122 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:43:30.264534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b87cc6-f861-4b20-b5e1-7fe30e4083b0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:43:30.267376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f8b87cc6-f861-4b20-b5e1-7fe30e4083b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:30.285813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b87cc6-f861-4b20-b5e1-7fe30e4083b0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:43:30.290370 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189bf17-45aa-4439-8cc9-017634df3bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:43:30.291045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189bf17-45aa-4439-8cc9-017634df3bcc service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:30.291331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189bf17-45aa-4439-8cc9-017634df3bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:30.291589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189bf17-45aa-4439-8cc9-017634df3bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:30.301724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189bf17-45aa-4439-8cc9-017634df3bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:43:30.303172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189bf17-45aa-4439-8cc9-017634df3bcc service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:43:30.313596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 764/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:43:33.857312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3182675-f041-4d5a-9e07-2057e50ee911 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:33.857871 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3182675-f041-4d5a-9e07-2057e50ee911 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:33.857871 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3182675-f041-4d5a-9e07-2057e50ee911 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:33.859321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:43:33.865565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c59d0-921d-439d-b60b-667120ab6830 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:33.866147 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c59d0-921d-439d-b60b-667120ab6830 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:33.866147 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c59d0-921d-439d-b60b-667120ab6830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:33.876692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=81 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:43:33.895023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-290c59d0-921d-439d-b60b-667120ab6830 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:43:33.896185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-290c59d0-921d-439d-b60b-667120ab6830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:33.904509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:43:34.223540 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3182675-f041-4d5a-9e07-2057e50ee911 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:43:34.225543 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b3182675-f041-4d5a-9e07-2057e50ee911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:34.296752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:43:34.311949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3182675-f041-4d5a-9e07-2057e50ee911 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:43:34.317737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e09ee0-a3be-4bd2-aaf7-28b3379fbe69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:43:34.318536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e09ee0-a3be-4bd2-aaf7-28b3379fbe69 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:34.318902 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e09ee0-a3be-4bd2-aaf7-28b3379fbe69 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:34.319251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e09ee0-a3be-4bd2-aaf7-28b3379fbe69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:34.331718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e09ee0-a3be-4bd2-aaf7-28b3379fbe69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:43:34.333157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e09ee0-a3be-4bd2-aaf7-28b3379fbe69 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:43:34.343312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 771/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:43:36.338058 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aa41c-f7cc-4b53-af28-39c4d4919e89 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:36.338909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aa41c-f7cc-4b53-af28-39c4d4919e89 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:36.338909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663aa41c-f7cc-4b53-af28-39c4d4919e89 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:36.340964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 02:43:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:43:36.346670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37b598-f526-44de-9cfa-c781a52f4e6e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:36.347153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37b598-f526-44de-9cfa-c781a52f4e6e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:36.347249 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37b598-f526-44de-9cfa-c781a52f4e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:36.368825 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3a37b598-f526-44de-9cfa-c781a52f4e6e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:43:36.370656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3a37b598-f526-44de-9cfa-c781a52f4e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:36.382261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 02:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:43:36.685557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aa41c-f7cc-4b53-af28-39c4d4919e89 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:43:36.688276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-663aa41c-f7cc-4b53-af28-39c4d4919e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:43:36.706610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663aa41c-f7cc-4b53-af28-39c4d4919e89 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:43:36.710395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f7920-7d67-42a0-9b75-0fd6272363e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:43:36.711080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f7920-7d67-42a0-9b75-0fd6272363e1 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:43:36.711370 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f7920-7d67-42a0-9b75-0fd6272363e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:43:36.711629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f7920-7d67-42a0-9b75-0fd6272363e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:43:36.721867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f7920-7d67-42a0-9b75-0fd6272363e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:43:36.723324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f7920-7d67-42a0-9b75-0fd6272363e1 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:43:36.733438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 767/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:43:46.363171 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=11 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:43:46.728923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=8 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:08.183287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f4198-b11c-4219-b47b-89a4a5b1796b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:08.184220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f4198-b11c-4219-b47b-89a4a5b1796b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:08.184324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f4198-b11c-4219-b47b-89a4a5b1796b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:08.214022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4f6f4198-b11c-4219-b47b-89a4a5b1796b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:08.215286 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4f6f4198-b11c-4219-b47b-89a4a5b1796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:08.231735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 773/1540] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:08.242051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447783a-ec10-48d3-b3ea-8b29b97704ba None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:08.242688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447783a-ec10-48d3-b3ea-8b29b97704ba None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:08.242926 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447783a-ec10-48d3-b3ea-8b29b97704ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:08.299100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9447783a-ec10-48d3-b3ea-8b29b97704ba None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:08.301530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9447783a-ec10-48d3-b3ea-8b29b97704ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:08.327746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 768/1541] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:08.333454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f4198-b11c-4219-b47b-89a4a5b1796b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:08.350802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f4198-b11c-4219-b47b-89a4a5b1796b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:08.356023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2fe5e-8b24-455d-ac35-8255da6cfb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:08.356676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2fe5e-8b24-455d-ac35-8255da6cfb73 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:08.356959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2fe5e-8b24-455d-ac35-8255da6cfb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:08.357232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2fe5e-8b24-455d-ac35-8255da6cfb73 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:08.357996 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2fe5e-8b24-455d-ac35-8255da6cfb73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:08.358303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2fe5e-8b24-455d-ac35-8255da6cfb73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:08.360350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c2fe5e-8b24-455d-ac35-8255da6cfb73 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:08.382282 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 774/1542] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:45:08.388519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447783a-ec10-48d3-b3ea-8b29b97704ba None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:08.411193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447783a-ec10-48d3-b3ea-8b29b97704ba None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:08.426812 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b07c81-cd4f-4931-b9fe-1f33a9f9fa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:08.428278 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b07c81-cd4f-4931-b9fe-1f33a9f9fa1c admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:08.428961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b07c81-cd4f-4931-b9fe-1f33a9f9fa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:08.429732 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b07c81-cd4f-4931-b9fe-1f33a9f9fa1c admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:08.431174 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b07c81-cd4f-4931-b9fe-1f33a9f9fa1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:08.435275 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b07c81-cd4f-4931-b9fe-1f33a9f9fa1c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:08.522968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf7027-23a9-4cd3-b426-687e2ccab699 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:08.523301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf7027-23a9-4cd3-b426-687e2ccab699 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:08.523680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf7027-23a9-4cd3-b426-687e2ccab699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:08.534133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 769/1543] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:08 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:45:08.542466 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b07c81-cd4f-4931-b9fe-1f33a9f9fa1c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:08.549055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-dedf7027-23a9-4cd3-b426-687e2ccab699 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:08.550414 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dedf7027-23a9-4cd3-b426-687e2ccab699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:08.658903 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 775/1544] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:45:08.668455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be53da-efd9-48cf-af3d-2a6d9fccca44 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:08.669024 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be53da-efd9-48cf-af3d-2a6d9fccca44 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:08.669432 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be53da-efd9-48cf-af3d-2a6d9fccca44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:08.708694 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-85be53da-efd9-48cf-af3d-2a6d9fccca44 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:08.709194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-85be53da-efd9-48cf-af3d-2a6d9fccca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:08.730753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 776/1545] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:08.735304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be53da-efd9-48cf-af3d-2a6d9fccca44 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:08.754231 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be53da-efd9-48cf-af3d-2a6d9fccca44 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:08.766937 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9444ecc-2dad-4989-a227-683bb3f7adc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:08.767767 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444ecc-2dad-4989-a227-683bb3f7adc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:08.768145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444ecc-2dad-4989-a227-683bb3f7adc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:08.768568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9444ecc-2dad-4989-a227-683bb3f7adc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:08.769596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9444ecc-2dad-4989-a227-683bb3f7adc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:08.770011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9444ecc-2dad-4989-a227-683bb3f7adc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:08.770379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b07c81-cd4f-4931-b9fe-1f33a9f9fa1c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:08.777319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9444ecc-2dad-4989-a227-683bb3f7adc2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:08.793227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef7aab-105e-4710-b3b7-b17f3d094614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:08.793904 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef7aab-105e-4710-b3b7-b17f3d094614 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:08.794178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef7aab-105e-4710-b3b7-b17f3d094614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:08.794443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef7aab-105e-4710-b3b7-b17f3d094614 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:08.795136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef7aab-105e-4710-b3b7-b17f3d094614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:08.796200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: WARNING py.warnings [None req-f3ef7aab-105e-4710-b3b7-b17f3d094614 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:45:08.796200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: warnings.warn(msg) Jul 26 02:45:08.796200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: Jul 26 02:45:08.797476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef7aab-105e-4710-b3b7-b17f3d094614 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:08.804599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 777/1546] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:08.810958 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e0366-641a-4194-b544-1069640e1d7b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:08.811223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e0366-641a-4194-b544-1069640e1d7b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:08.811545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e0366-641a-4194-b544-1069640e1d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:08.859264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 770/1547] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:08 2022] POST /identity/v3/users => generated 287 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:08.861109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef7aab-105e-4710-b3b7-b17f3d094614 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:08.873335 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-db6e0366-641a-4194-b544-1069640e1d7b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:08.876529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-db6e0366-641a-4194-b544-1069640e1d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:08.888315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef7aab-105e-4710-b3b7-b17f3d094614 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:08.901887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 778/1548] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:08.902979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f7872-0a83-4296-b318-9a3c27cbd3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:08.903199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e0366-641a-4194-b544-1069640e1d7b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:08.903731 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7872-0a83-4296-b318-9a3c27cbd3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:08.904020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7872-0a83-4296-b318-9a3c27cbd3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:08.904295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7872-0a83-4296-b318-9a3c27cbd3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:08.904998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f7872-0a83-4296-b318-9a3c27cbd3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:08.906952 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f7872-0a83-4296-b318-9a3c27cbd3c4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:08.919467 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e0366-641a-4194-b544-1069640e1d7b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:08.933324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92b3ff-f9a3-41f3-b99c-5468d2cbd451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:08.934221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92b3ff-f9a3-41f3-b99c-5468d2cbd451 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:08.934510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92b3ff-f9a3-41f3-b99c-5468d2cbd451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:08.934789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92b3ff-f9a3-41f3-b99c-5468d2cbd451 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:08.935505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92b3ff-f9a3-41f3-b99c-5468d2cbd451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:08.941055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92b3ff-f9a3-41f3-b99c-5468d2cbd451 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:08.964123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 779/1550] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:08.964465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 771/1550] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:08 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:08.966783 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a668ab-f58e-450b-86f7-f7d0c524cb08 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:08.967100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a668ab-f58e-450b-86f7-f7d0c524cb08 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:08.968864 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8409-a71c-4a57-a822-edd313038a1e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:08.969152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8409-a71c-4a57-a822-edd313038a1e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:08.969459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8409-a71c-4a57-a822-edd313038a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:08.970297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a668ab-f58e-450b-86f7-f7d0c524cb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.002797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1a1b8409-a71c-4a57-a822-edd313038a1e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:09.004669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1a1b8409-a71c-4a57-a822-edd313038a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:09.020011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b9a668ab-f58e-450b-86f7-f7d0c524cb08 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:09.021251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b9a668ab-f58e-450b-86f7-f7d0c524cb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:09.132829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 772/1551] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:09.134368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8409-a71c-4a57-a822-edd313038a1e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.145383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 780/1552] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:09.146764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a668ab-f58e-450b-86f7-f7d0c524cb08 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.157798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a668ab-f58e-450b-86f7-f7d0c524cb08 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.163272 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8409-a71c-4a57-a822-edd313038a1e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.165850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd757c-a8d5-47fe-ad20-c18804403e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.167323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd757c-a8d5-47fe-ad20-c18804403e22 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.167972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd757c-a8d5-47fe-ad20-c18804403e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.168218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd757c-a8d5-47fe-ad20-c18804403e22 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.169237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd757c-a8d5-47fe-ad20-c18804403e22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.170423 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327aa616-1465-459a-87d0-b9990357d38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.171309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aa616-1465-459a-87d0-b9990357d38a admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.171705 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd757c-a8d5-47fe-ad20-c18804403e22 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.172037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aa616-1465-459a-87d0-b9990357d38a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.172519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327aa616-1465-459a-87d0-b9990357d38a admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.173493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327aa616-1465-459a-87d0-b9990357d38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.175471 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327aa616-1465-459a-87d0-b9990357d38a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.193789 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 773/1553] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:09.195233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58718971-0a0d-4c6b-aeb3-e7e3d96e1f74 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.195523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58718971-0a0d-4c6b-aeb3-e7e3d96e1f74 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.195889 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58718971-0a0d-4c6b-aeb3-e7e3d96e1f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.205088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 781/1554] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/users => generated 292 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:09.205088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a16744-64ad-4cf9-bd33-cb52eb4a81d0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.205088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a16744-64ad-4cf9-bd33-cb52eb4a81d0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.205088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a16744-64ad-4cf9-bd33-cb52eb4a81d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.219234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-58718971-0a0d-4c6b-aeb3-e7e3d96e1f74 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:09.220916 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-58718971-0a0d-4c6b-aeb3-e7e3d96e1f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:09.226716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-82a16744-64ad-4cf9-bd33-cb52eb4a81d0 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:09.227893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-82a16744-64ad-4cf9-bd33-cb52eb4a81d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:09.229101 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 774/1555] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:09.230526 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1813a8-0364-4653-b637-6226d93754f4 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.230807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1813a8-0364-4653-b637-6226d93754f4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.231074 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1813a8-0364-4653-b637-6226d93754f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.241864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 782/1556] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:09.241864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a16744-64ad-4cf9-bd33-cb52eb4a81d0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.254496 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a16744-64ad-4cf9-bd33-cb52eb4a81d0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.255806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5e1813a8-0364-4653-b637-6226d93754f4 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:09.256993 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5e1813a8-0364-4653-b637-6226d93754f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:09.259989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caeba84-7779-4725-b787-e342e43dbe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.260735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caeba84-7779-4725-b787-e342e43dbe5e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.261044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caeba84-7779-4725-b787-e342e43dbe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.261325 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caeba84-7779-4725-b787-e342e43dbe5e admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.262096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caeba84-7779-4725-b787-e342e43dbe5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:09.262423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caeba84-7779-4725-b787-e342e43dbe5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.264009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caeba84-7779-4725-b787-e342e43dbe5e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.266746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 775/1557] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:09.267989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3268a-0c27-4ae3-978e-31548502b7a1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.268266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3268a-0c27-4ae3-978e-31548502b7a1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.268534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3268a-0c27-4ae3-978e-31548502b7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.278449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 783/1558] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:09.279507 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9ae40-4deb-45e3-ad0c-1a2acff72d45 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.279810 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9ae40-4deb-45e3-ad0c-1a2acff72d45 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.280061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9ae40-4deb-45e3-ad0c-1a2acff72d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.286607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:09.295055 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cbb3268a-0c27-4ae3-978e-31548502b7a1 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:09.296424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:09.297534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cbb3268a-0c27-4ae3-978e-31548502b7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:09.302649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-84c9ae40-4deb-45e3-ad0c-1a2acff72d45 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:09.303843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-84c9ae40-4deb-45e3-ad0c-1a2acff72d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:09.307597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 776/1559] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:09.308391 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3268a-0c27-4ae3-978e-31548502b7a1 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.320254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3268a-0c27-4ae3-978e-31548502b7a1 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.321968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 784/1560] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:09.322712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9ae40-4deb-45e3-ad0c-1a2acff72d45 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.331384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef466e-2125-41a2-92a0-039ee30678c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.332075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef466e-2125-41a2-92a0-039ee30678c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.332355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef466e-2125-41a2-92a0-039ee30678c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.332633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef466e-2125-41a2-92a0-039ee30678c7 admin admin] PATH_INFO: `/v3/projects/d8dff10829d44fa4927e69cb144ed263/users/8de4ea727e9543f285c86e649d36c760/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.333058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9ae40-4deb-45e3-ad0c-1a2acff72d45 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.342379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca3f4b-2fa4-4042-8d62-568040b88fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.343853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca3f4b-2fa4-4042-8d62-568040b88fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.343853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca3f4b-2fa4-4042-8d62-568040b88fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.344145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca3f4b-2fa4-4042-8d62-568040b88fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.344851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca3f4b-2fa4-4042-8d62-568040b88fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.346508 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca3f4b-2fa4-4042-8d62-568040b88fa7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.352403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef466e-2125-41a2-92a0-039ee30678c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8dff10829d44fa4927e69cb144ed263, user_id=8de4ea727e9543f285c86e649d36c760, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.356567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef466e-2125-41a2-92a0-039ee30678c7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.357835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 785/1561] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:09.359186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f47c-a6fb-43c6-a618-8b76bf818f2f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.359443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f47c-a6fb-43c6-a618-8b76bf818f2f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.359718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f47c-a6fb-43c6-a618-8b76bf818f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.371648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 777/1562] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:09 2022] PUT /identity/v3/projects/d8dff10829d44fa4927e69cb144ed263/users/8de4ea727e9543f285c86e649d36c760/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:09.375599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030e91b-6c29-491e-9055-639ff4762d77 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.375599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030e91b-6c29-491e-9055-639ff4762d77 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.375599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030e91b-6c29-491e-9055-639ff4762d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.386779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ae08f47c-a6fb-43c6-a618-8b76bf818f2f None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:09.388047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ae08f47c-a6fb-43c6-a618-8b76bf818f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:09.396949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d030e91b-6c29-491e-9055-639ff4762d77 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:09.398202 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d030e91b-6c29-491e-9055-639ff4762d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:09.457114 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 786/1563] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:09.458135 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08f47c-a6fb-43c6-a618-8b76bf818f2f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.468697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08f47c-a6fb-43c6-a618-8b76bf818f2f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.473579 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07fa7fa-61c6-4363-90a0-879666272929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.474207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fa7fa-61c6-4363-90a0-879666272929 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.474485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fa7fa-61c6-4363-90a0-879666272929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.474754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07fa7fa-61c6-4363-90a0-879666272929 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.478743 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 778/1564] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:09.478902 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fa7fa-61c6-4363-90a0-879666272929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:09.478902 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fa7fa-61c6-4363-90a0-879666272929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.479090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030e91b-6c29-491e-9055-639ff4762d77 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.479177 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07fa7fa-61c6-4363-90a0-879666272929 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.486004 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030e91b-6c29-491e-9055-639ff4762d77 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.491051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 787/1565] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:09.491195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd98534-1b7a-4ad6-a797-178380f946d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.491736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd98534-1b7a-4ad6-a797-178380f946d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.492012 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd98534-1b7a-4ad6-a797-178380f946d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.492124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f636-5477-4f09-b66c-b15c4b780dca None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.492288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd98534-1b7a-4ad6-a797-178380f946d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.492406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f636-5477-4f09-b66c-b15c4b780dca None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.492670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f636-5477-4f09-b66c-b15c4b780dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.492962 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd98534-1b7a-4ad6-a797-178380f946d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.494962 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd98534-1b7a-4ad6-a797-178380f946d4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.512425 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a393f636-5477-4f09-b66c-b15c4b780dca None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:09.513680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a393f636-5477-4f09-b66c-b15c4b780dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:09.522130 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 788/1566] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:09.523426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784b119-2dab-46e4-83de-7188c21005d5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.523757 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784b119-2dab-46e4-83de-7188c21005d5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.524059 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784b119-2dab-46e4-83de-7188c21005d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.528039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 779/1567] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:09.528930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd98534-1b7a-4ad6-a797-178380f946d4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.547603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6784b119-2dab-46e4-83de-7188c21005d5 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:09.548844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6784b119-2dab-46e4-83de-7188c21005d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:09.597684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd98534-1b7a-4ad6-a797-178380f946d4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.602672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb6ed4-6f0e-4efb-9b52-2f5802332df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.603297 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb6ed4-6f0e-4efb-9b52-2f5802332df9 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.603579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb6ed4-6f0e-4efb-9b52-2f5802332df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.603855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb6ed4-6f0e-4efb-9b52-2f5802332df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.604560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb6ed4-6f0e-4efb-9b52-2f5802332df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.606380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb6ed4-6f0e-4efb-9b52-2f5802332df9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.619851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 780/1568] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:09.621570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31efb26-03ff-459e-b8df-7c5a91a667a1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.621860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31efb26-03ff-459e-b8df-7c5a91a667a1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.622134 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31efb26-03ff-459e-b8df-7c5a91a667a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.625449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 789/1569] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:09.626747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784b119-2dab-46e4-83de-7188c21005d5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.638367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784b119-2dab-46e4-83de-7188c21005d5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.643393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b31efb26-03ff-459e-b8df-7c5a91a667a1 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:09.643786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11159785-24e7-46c3-9bad-f71a6f152e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.644404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159785-24e7-46c3-9bad-f71a6f152e00 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.644707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159785-24e7-46c3-9bad-f71a6f152e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.644865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b31efb26-03ff-459e-b8df-7c5a91a667a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:09.644964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11159785-24e7-46c3-9bad-f71a6f152e00 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.645728 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11159785-24e7-46c3-9bad-f71a6f152e00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:09.646034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11159785-24e7-46c3-9bad-f71a6f152e00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.647647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11159785-24e7-46c3-9bad-f71a6f152e00 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.660327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 781/1570] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:09.660327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31efb26-03ff-459e-b8df-7c5a91a667a1 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.671366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 790/1571] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:09.671366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11159785-24e7-46c3-9bad-f71a6f152e00 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.679637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31efb26-03ff-459e-b8df-7c5a91a667a1 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.683244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11159785-24e7-46c3-9bad-f71a6f152e00 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.684610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3c253-c667-450b-a7e6-d4390b6643e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.685378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3c253-c667-450b-a7e6-d4390b6643e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.685709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3c253-c667-450b-a7e6-d4390b6643e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.685928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a3c253-c667-450b-a7e6-d4390b6643e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.686645 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3c253-c667-450b-a7e6-d4390b6643e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:09.686972 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3c253-c667-450b-a7e6-d4390b6643e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.687994 dv-cinder-850840-2-smb devstack@keystone.service[86829]: WARNING py.warnings [None req-e7a3c253-c667-450b-a7e6-d4390b6643e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:45:09.687994 dv-cinder-850840-2-smb devstack@keystone.service[86829]: warnings.warn(msg) Jul 26 02:45:09.687994 dv-cinder-850840-2-smb devstack@keystone.service[86829]: Jul 26 02:45:09.688376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2963a6-7c4a-4d9c-bc69-b570af683064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.689028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a3c253-c667-450b-a7e6-d4390b6643e9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.689149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2963a6-7c4a-4d9c-bc69-b570af683064 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.689328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2963a6-7c4a-4d9c-bc69-b570af683064 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.689606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2963a6-7c4a-4d9c-bc69-b570af683064 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.690274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2963a6-7c4a-4d9c-bc69-b570af683064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.691283 dv-cinder-850840-2-smb devstack@keystone.service[86830]: WARNING py.warnings [None req-3c2963a6-7c4a-4d9c-bc69-b570af683064 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:45:09.691283 dv-cinder-850840-2-smb devstack@keystone.service[86830]: warnings.warn(msg) Jul 26 02:45:09.691283 dv-cinder-850840-2-smb devstack@keystone.service[86830]: Jul 26 02:45:09.692473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2963a6-7c4a-4d9c-bc69-b570af683064 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.702448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 782/1572] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:09.703324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3c253-c667-450b-a7e6-d4390b6643e9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.714124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a3c253-c667-450b-a7e6-d4390b6643e9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.720580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280427a7-9612-43d1-8f7f-92e58bad4524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.721207 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280427a7-9612-43d1-8f7f-92e58bad4524 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.721543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280427a7-9612-43d1-8f7f-92e58bad4524 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.721785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280427a7-9612-43d1-8f7f-92e58bad4524 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.722485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280427a7-9612-43d1-8f7f-92e58bad4524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:09.722785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280427a7-9612-43d1-8f7f-92e58bad4524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.723589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 791/1573] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:09.724418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2963a6-7c4a-4d9c-bc69-b570af683064 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.726344 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280427a7-9612-43d1-8f7f-92e58bad4524 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.739738 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 783/1574] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:09.740592 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280427a7-9612-43d1-8f7f-92e58bad4524 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.755936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280427a7-9612-43d1-8f7f-92e58bad4524 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.769269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:09.773831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:09.798632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2963a6-7c4a-4d9c-bc69-b570af683064 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.804485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3d04e-8dbf-40ce-a2bd-90aa7bff5442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.805428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3d04e-8dbf-40ce-a2bd-90aa7bff5442 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.805860 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3d04e-8dbf-40ce-a2bd-90aa7bff5442 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.806269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3d04e-8dbf-40ce-a2bd-90aa7bff5442 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.807153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3d04e-8dbf-40ce-a2bd-90aa7bff5442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.809430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3d04e-8dbf-40ce-a2bd-90aa7bff5442 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.829664 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4726d-822c-43d1-b3f0-266d79b120e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.830369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4726d-822c-43d1-b3f0-266d79b120e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.830640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4726d-822c-43d1-b3f0-266d79b120e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.830959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4726d-822c-43d1-b3f0-266d79b120e3 admin admin] PATH_INFO: `/v3/projects/7b979e4c7b8847c0972091a1607bb25d/users/69246ce0e0544e72a928af58b65930bd/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.837048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 792/1575] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:09.838338 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3d04e-8dbf-40ce-a2bd-90aa7bff5442 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.847205 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4726d-822c-43d1-b3f0-266d79b120e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b979e4c7b8847c0972091a1607bb25d, user_id=69246ce0e0544e72a928af58b65930bd, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.848872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3d04e-8dbf-40ce-a2bd-90aa7bff5442 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.850156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4726d-822c-43d1-b3f0-266d79b120e3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.855156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e991551-aa08-4d95-a9df-fe22105b7c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.855850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e991551-aa08-4d95-a9df-fe22105b7c51 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.856157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e991551-aa08-4d95-a9df-fe22105b7c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.856498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e991551-aa08-4d95-a9df-fe22105b7c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.857269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e991551-aa08-4d95-a9df-fe22105b7c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:09.859191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e991551-aa08-4d95-a9df-fe22105b7c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.859343 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e991551-aa08-4d95-a9df-fe22105b7c51 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:09.867495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 784/1576] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:09 2022] PUT /identity/v3/projects/7b979e4c7b8847c0972091a1607bb25d/users/69246ce0e0544e72a928af58b65930bd/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:09.871664 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4726d-822c-43d1-b3f0-266d79b120e3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.874915 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 793/1577] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:09.875892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e991551-aa08-4d95-a9df-fe22105b7c51 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:09.942955 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e991551-aa08-4d95-a9df-fe22105b7c51 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.952986 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4726d-822c-43d1-b3f0-266d79b120e3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:09.958548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49785b88-8df2-4e8e-8b94-5af849fc869c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:09.959180 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49785b88-8df2-4e8e-8b94-5af849fc869c admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:09.959591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49785b88-8df2-4e8e-8b94-5af849fc869c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:09.959875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49785b88-8df2-4e8e-8b94-5af849fc869c admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:09.960593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49785b88-8df2-4e8e-8b94-5af849fc869c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:09.962567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49785b88-8df2-4e8e-8b94-5af849fc869c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.001758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b6d25-6801-48f8-b5da-a212ba7cfce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.002392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b6d25-6801-48f8-b5da-a212ba7cfce5 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.002680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b6d25-6801-48f8-b5da-a212ba7cfce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.002952 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b6d25-6801-48f8-b5da-a212ba7cfce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.003188 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 785/1578] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:09 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:10.004009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49785b88-8df2-4e8e-8b94-5af849fc869c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.018078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b6d25-6801-48f8-b5da-a212ba7cfce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.020217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b6d25-6801-48f8-b5da-a212ba7cfce5 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.031182 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 794/1579] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:10.031997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b6d25-6801-48f8-b5da-a212ba7cfce5 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.042406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b6d25-6801-48f8-b5da-a212ba7cfce5 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.082581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49785b88-8df2-4e8e-8b94-5af849fc869c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.087386 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67342984-b1dd-452e-9d6d-7ca3c2bf1d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.088030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342984-b1dd-452e-9d6d-7ca3c2bf1d01 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.088311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342984-b1dd-452e-9d6d-7ca3c2bf1d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.088586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67342984-b1dd-452e-9d6d-7ca3c2bf1d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.089261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67342984-b1dd-452e-9d6d-7ca3c2bf1d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.092431 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67342984-b1dd-452e-9d6d-7ca3c2bf1d01 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.119309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04449c45-15a8-4258-ae28-60d6fb055e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.120097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04449c45-15a8-4258-ae28-60d6fb055e13 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.120385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04449c45-15a8-4258-ae28-60d6fb055e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.120655 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04449c45-15a8-4258-ae28-60d6fb055e13 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.121503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04449c45-15a8-4258-ae28-60d6fb055e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.123618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04449c45-15a8-4258-ae28-60d6fb055e13 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.126923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 786/1580] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:10 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:10.128181 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67342984-b1dd-452e-9d6d-7ca3c2bf1d01 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.147351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:10.148942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:10.157734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 795/1581] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:10 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:10.160746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04449c45-15a8-4258-ae28-60d6fb055e13 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.172078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04449c45-15a8-4258-ae28-60d6fb055e13 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.213497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67342984-b1dd-452e-9d6d-7ca3c2bf1d01 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.218863 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e266f-d3d6-46db-bae0-41ca288923aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.219580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e266f-d3d6-46db-bae0-41ca288923aa admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.219921 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e266f-d3d6-46db-bae0-41ca288923aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.220253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e266f-d3d6-46db-bae0-41ca288923aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.221146 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e266f-d3d6-46db-bae0-41ca288923aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.223020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e266f-d3d6-46db-bae0-41ca288923aa admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.243799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8deedd-a207-408e-b440-e12c79ddee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.244349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8deedd-a207-408e-b440-e12c79ddee5e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.244647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8deedd-a207-408e-b440-e12c79ddee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.244895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8deedd-a207-408e-b440-e12c79ddee5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.245658 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8deedd-a207-408e-b440-e12c79ddee5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.247604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8deedd-a207-408e-b440-e12c79ddee5e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.257570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 787/1582] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:10 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:10.258934 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985e4a6-c027-42d9-8aa5-d509194294eb None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.259194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985e4a6-c027-42d9-8aa5-d509194294eb None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.259477 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985e4a6-c027-42d9-8aa5-d509194294eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.261380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 796/1583] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:10.262273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8deedd-a207-408e-b440-e12c79ddee5e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.273504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8deedd-a207-408e-b440-e12c79ddee5e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.280368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c985e4a6-c027-42d9-8aa5-d509194294eb None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:10.281627 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c985e4a6-c027-42d9-8aa5-d509194294eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:10.352879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36be666-7d88-4223-ac94-11dbf1cc1c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.353889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36be666-7d88-4223-ac94-11dbf1cc1c12 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.358017 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 788/1584] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:10.358201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36be666-7d88-4223-ac94-11dbf1cc1c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.358201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36be666-7d88-4223-ac94-11dbf1cc1c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.358365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985e4a6-c027-42d9-8aa5-d509194294eb None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.358925 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36be666-7d88-4223-ac94-11dbf1cc1c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.358925 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36be666-7d88-4223-ac94-11dbf1cc1c12 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.375486 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985e4a6-c027-42d9-8aa5-d509194294eb None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.380457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed2e3c-49d7-48f7-92b8-e7392bab09c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.381379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed2e3c-49d7-48f7-92b8-e7392bab09c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.381875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed2e3c-49d7-48f7-92b8-e7392bab09c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.382339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed2e3c-49d7-48f7-92b8-e7392bab09c4 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.383189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed2e3c-49d7-48f7-92b8-e7392bab09c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.385173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed2e3c-49d7-48f7-92b8-e7392bab09c4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.397710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 797/1585] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:10 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:10.398479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36be666-7d88-4223-ac94-11dbf1cc1c12 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.432004 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 789/1586] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:10 2022] POST /identity/v3/users => generated 289 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:10.432004 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed2e3c-49d7-48f7-92b8-e7392bab09c4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.443453 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed2e3c-49d7-48f7-92b8-e7392bab09c4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.494170 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36be666-7d88-4223-ac94-11dbf1cc1c12 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.500429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147221b-f88b-46de-b5d6-f0dcf61906b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.501165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147221b-f88b-46de-b5d6-f0dcf61906b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.501541 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147221b-f88b-46de-b5d6-f0dcf61906b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.501819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147221b-f88b-46de-b5d6-f0dcf61906b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.502507 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147221b-f88b-46de-b5d6-f0dcf61906b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.504770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147221b-f88b-46de-b5d6-f0dcf61906b5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.523395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4411b-0edd-4842-aea0-e582eb859723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.523665 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4411b-0edd-4842-aea0-e582eb859723 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.523995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4411b-0edd-4842-aea0-e582eb859723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.524709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4411b-0edd-4842-aea0-e582eb859723 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.525460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4411b-0edd-4842-aea0-e582eb859723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.527224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4411b-0edd-4842-aea0-e582eb859723 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.537844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 798/1587] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:10 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:10.537844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147221b-f88b-46de-b5d6-f0dcf61906b5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.542339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 790/1588] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:10.543183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4411b-0edd-4842-aea0-e582eb859723 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.552458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147221b-f88b-46de-b5d6-f0dcf61906b5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.557485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4411b-0edd-4842-aea0-e582eb859723 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.561438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f79564-cb7d-4950-a0b5-8fc5bb4f3db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.562130 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f79564-cb7d-4950-a0b5-8fc5bb4f3db2 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.562376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f79564-cb7d-4950-a0b5-8fc5bb4f3db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.562637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f79564-cb7d-4950-a0b5-8fc5bb4f3db2 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.563322 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f79564-cb7d-4950-a0b5-8fc5bb4f3db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.564376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460ca13-5c6f-4cca-aa5c-6ea200e70652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.565125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460ca13-5c6f-4cca-aa5c-6ea200e70652 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.565374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f79564-cb7d-4950-a0b5-8fc5bb4f3db2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.565513 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460ca13-5c6f-4cca-aa5c-6ea200e70652 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.565721 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460ca13-5c6f-4cca-aa5c-6ea200e70652 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.566476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460ca13-5c6f-4cca-aa5c-6ea200e70652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.569848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460ca13-5c6f-4cca-aa5c-6ea200e70652 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.577681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:10.587517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 791/1589] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:10.588499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460ca13-5c6f-4cca-aa5c-6ea200e70652 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.593487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 799/1590] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:10 2022] POST /identity/v3/users => generated 296 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:10.594760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f79564-cb7d-4950-a0b5-8fc5bb4f3db2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.597984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:10.623293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f79564-cb7d-4950-a0b5-8fc5bb4f3db2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.629684 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7198b84-6a32-451e-b8b4-34f8b55ba1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.630625 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7198b84-6a32-451e-b8b4-34f8b55ba1ee admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.631145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7198b84-6a32-451e-b8b4-34f8b55ba1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.631715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7198b84-6a32-451e-b8b4-34f8b55ba1ee admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.633947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7198b84-6a32-451e-b8b4-34f8b55ba1ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.636338 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7198b84-6a32-451e-b8b4-34f8b55ba1ee admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.664107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 800/1591] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:10 2022] POST /identity/v3/users => generated 286 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:10.665613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7198b84-6a32-451e-b8b4-34f8b55ba1ee admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.671487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460ca13-5c6f-4cca-aa5c-6ea200e70652 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.680398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43addeaa-55ae-4903-9a3a-ce4f97bd36e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.680398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43addeaa-55ae-4903-9a3a-ce4f97bd36e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.680398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43addeaa-55ae-4903-9a3a-ce4f97bd36e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.680398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43addeaa-55ae-4903-9a3a-ce4f97bd36e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.680859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7198b84-6a32-451e-b8b4-34f8b55ba1ee admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.685055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b17bb7-6619-4ea1-9cea-73907db2b287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.686087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b17bb7-6619-4ea1-9cea-73907db2b287 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.686444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b17bb7-6619-4ea1-9cea-73907db2b287 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.686790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b17bb7-6619-4ea1-9cea-73907db2b287 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.687854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b17bb7-6619-4ea1-9cea-73907db2b287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.689470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b17bb7-6619-4ea1-9cea-73907db2b287 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.692202 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43addeaa-55ae-4903-9a3a-ce4f97bd36e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.694061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43addeaa-55ae-4903-9a3a-ce4f97bd36e4 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.703700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 801/1592] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:10.703700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b17bb7-6619-4ea1-9cea-73907db2b287 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.708599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 792/1593] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:10.709583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43addeaa-55ae-4903-9a3a-ce4f97bd36e4 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.714070 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b17bb7-6619-4ea1-9cea-73907db2b287 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.721327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43addeaa-55ae-4903-9a3a-ce4f97bd36e4 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.721751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465b057-a821-4612-a0c9-ef06223f0c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.722690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465b057-a821-4612-a0c9-ef06223f0c47 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.723094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465b057-a821-4612-a0c9-ef06223f0c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.723280 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a465b057-a821-4612-a0c9-ef06223f0c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.723989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465b057-a821-4612-a0c9-ef06223f0c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.725661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a465b057-a821-4612-a0c9-ef06223f0c47 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.728389 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e5a63-99a9-498d-851d-c4087e42da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.728993 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e5a63-99a9-498d-851d-c4087e42da41 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.729231 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e5a63-99a9-498d-851d-c4087e42da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.729548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e5a63-99a9-498d-851d-c4087e42da41 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.730256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e5a63-99a9-498d-851d-c4087e42da41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.731904 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e5a63-99a9-498d-851d-c4087e42da41 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.740134 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 802/1594] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:10.741088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465b057-a821-4612-a0c9-ef06223f0c47 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.751417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a465b057-a821-4612-a0c9-ef06223f0c47 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.752964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 793/1595] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:10.756434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e5a63-99a9-498d-851d-c4087e42da41 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.760479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce475e-a432-4035-a42f-25e36cf098e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.761180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce475e-a432-4035-a42f-25e36cf098e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.761816 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce475e-a432-4035-a42f-25e36cf098e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.761816 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce475e-a432-4035-a42f-25e36cf098e2 admin admin] PATH_INFO: `/v3/projects/ebd3e78dfd374d7d81b75ba3e6dfb757/users/963844f49e4440a9afeb28fdb83b8853/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.769240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e5a63-99a9-498d-851d-c4087e42da41 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.778626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bdbe1-e59b-4d60-abe3-3308086fd2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.778626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bdbe1-e59b-4d60-abe3-3308086fd2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.778626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bdbe1-e59b-4d60-abe3-3308086fd2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.778626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bdbe1-e59b-4d60-abe3-3308086fd2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.779072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bdbe1-e59b-4d60-abe3-3308086fd2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.780467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bdbe1-e59b-4d60-abe3-3308086fd2e3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.780772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce475e-a432-4035-a42f-25e36cf098e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd3e78dfd374d7d81b75ba3e6dfb757, user_id=963844f49e4440a9afeb28fdb83b8853, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.782640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: WARNING py.warnings [None req-5dce475e-a432-4035-a42f-25e36cf098e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:45:10.782640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: warnings.warn(msg) Jul 26 02:45:10.782640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: Jul 26 02:45:10.784528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce475e-a432-4035-a42f-25e36cf098e2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.796434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 794/1596] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:10.797427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bdbe1-e59b-4d60-abe3-3308086fd2e3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.816381 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 803/1597] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:10 2022] PUT /identity/v3/projects/ebd3e78dfd374d7d81b75ba3e6dfb757/users/963844f49e4440a9afeb28fdb83b8853/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:10.816381 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce475e-a432-4035-a42f-25e36cf098e2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.816709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bdbe1-e59b-4d60-abe3-3308086fd2e3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.894458 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c1890-55ac-45dd-9a9b-90866a1a1a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.895233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c1890-55ac-45dd-9a9b-90866a1a1a36 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.895435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c1890-55ac-45dd-9a9b-90866a1a1a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.895712 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c1890-55ac-45dd-9a9b-90866a1a1a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.896424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c1890-55ac-45dd-9a9b-90866a1a1a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.898206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c1890-55ac-45dd-9a9b-90866a1a1a36 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.918294 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce475e-a432-4035-a42f-25e36cf098e2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.922585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 795/1598] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:10.923579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c1890-55ac-45dd-9a9b-90866a1a1a36 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.925510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c1db2-611f-4684-82c6-7970e618337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.926464 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c1db2-611f-4684-82c6-7970e618337b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.927484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c1db2-611f-4684-82c6-7970e618337b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.928021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c1db2-611f-4684-82c6-7970e618337b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.930002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c1db2-611f-4684-82c6-7970e618337b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.932666 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c1db2-611f-4684-82c6-7970e618337b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.948267 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 804/1599] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:10.948744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c1890-55ac-45dd-9a9b-90866a1a1a36 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.950305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c1db2-611f-4684-82c6-7970e618337b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:10.960843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b7ea6-91df-44c8-92d1-76c042add6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.961639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b7ea6-91df-44c8-92d1-76c042add6bd admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.961927 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b7ea6-91df-44c8-92d1-76c042add6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.962269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b7ea6-91df-44c8-92d1-76c042add6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.963178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b7ea6-91df-44c8-92d1-76c042add6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:10.965201 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b7ea6-91df-44c8-92d1-76c042add6bd admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:10.966034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c1db2-611f-4684-82c6-7970e618337b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:10.974625 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8701d8a-bad6-4080-a6ad-2dbb497f4219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:10.975753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8701d8a-bad6-4080-a6ad-2dbb497f4219 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:10.976245 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8701d8a-bad6-4080-a6ad-2dbb497f4219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:10.976794 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8701d8a-bad6-4080-a6ad-2dbb497f4219 admin admin] PATH_INFO: `/v3/projects/ef23f59308744aca934e1bdee1638f74/users/e9721b0f80994f5aaf85f607c80f7119/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:10.985149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 796/1600] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:10.986164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b7ea6-91df-44c8-92d1-76c042add6bd admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:11.003224 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8701d8a-bad6-4080-a6ad-2dbb497f4219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef23f59308744aca934e1bdee1638f74, user_id=e9721b0f80994f5aaf85f607c80f7119, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:11.015921 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b7ea6-91df-44c8-92d1-76c042add6bd admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:11.017671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8701d8a-bad6-4080-a6ad-2dbb497f4219 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:11.034552 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689cc8b-799b-4dd1-b1f3-602048fed785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:11.035355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689cc8b-799b-4dd1-b1f3-602048fed785 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.035646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689cc8b-799b-4dd1-b1f3-602048fed785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.036243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689cc8b-799b-4dd1-b1f3-602048fed785 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.036654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689cc8b-799b-4dd1-b1f3-602048fed785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:11.038584 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689cc8b-799b-4dd1-b1f3-602048fed785 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:11.049611 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 805/1601] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:10 2022] PUT /identity/v3/projects/ef23f59308744aca934e1bdee1638f74/users/e9721b0f80994f5aaf85f607c80f7119/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:11.052451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136242e0-1fbb-47f0-a488-31badc82e229 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.052731 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136242e0-1fbb-47f0-a488-31badc82e229 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.053006 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136242e0-1fbb-47f0-a488-31badc82e229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.073573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 797/1602] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:11.074626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689cc8b-799b-4dd1-b1f3-602048fed785 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:11.106536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-136242e0-1fbb-47f0-a488-31badc82e229 None None] MFA Rules not processed for user `963844f49e4440a9afeb28fdb83b8853`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:11.108803 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-136242e0-1fbb-47f0-a488-31badc82e229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:11.110744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689cc8b-799b-4dd1-b1f3-602048fed785 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:11.182197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:11.209605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 806/1603] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:11.210981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136242e0-1fbb-47f0-a488-31badc82e229 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:11.242534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c79ff6-9b38-402c-9d85-5699ccf3678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:11.243191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c79ff6-9b38-402c-9d85-5699ccf3678d admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.243478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c79ff6-9b38-402c-9d85-5699ccf3678d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.244232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c79ff6-9b38-402c-9d85-5699ccf3678d admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.244967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c79ff6-9b38-402c-9d85-5699ccf3678d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:11.247632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c79ff6-9b38-402c-9d85-5699ccf3678d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:11.249480 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:11.274438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 798/1604] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:11.275220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c79ff6-9b38-402c-9d85-5699ccf3678d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:11.293526 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c79ff6-9b38-402c-9d85-5699ccf3678d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:11.310049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ba24c-8505-43c0-afa6-c8e5d8c2bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:11.310744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba24c-8505-43c0-afa6-c8e5d8c2bd73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.311024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba24c-8505-43c0-afa6-c8e5d8c2bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.311298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba24c-8505-43c0-afa6-c8e5d8c2bd73 admin admin] PATH_INFO: `/v3/projects/f4e2694e4ec547b8a028b545da0f3c9e/users/adea8e6fd0cb47f394e811865db51ade/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.323748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136242e0-1fbb-47f0-a488-31badc82e229 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:11.329326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9cc78-f8e9-4452-80fc-e6b8a183388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:11.330466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9cc78-f8e9-4452-80fc-e6b8a183388a admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.330740 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9cc78-f8e9-4452-80fc-e6b8a183388a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.331007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9cc78-f8e9-4452-80fc-e6b8a183388a admin admin] PATH_INFO: `/v3/projects/3c98e688d8074386aec985d804c02daa/users/6b6e9910ded44a2280a74bfefededc7c/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.343245 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ba24c-8505-43c0-afa6-c8e5d8c2bd73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e2694e4ec547b8a028b545da0f3c9e, user_id=adea8e6fd0cb47f394e811865db51ade, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:11.345956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ba24c-8505-43c0-afa6-c8e5d8c2bd73 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:11.356285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9cc78-f8e9-4452-80fc-e6b8a183388a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c98e688d8074386aec985d804c02daa, user_id=6b6e9910ded44a2280a74bfefededc7c, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:11.359689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9cc78-f8e9-4452-80fc-e6b8a183388a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:11.370243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 799/1605] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:11 2022] PUT /identity/v3/projects/f4e2694e4ec547b8a028b545da0f3c9e/users/adea8e6fd0cb47f394e811865db51ade/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:11.371772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20063d-96e9-404b-8d46-4a95ee0f8396 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.372056 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20063d-96e9-404b-8d46-4a95ee0f8396 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.372326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20063d-96e9-404b-8d46-4a95ee0f8396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.381061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 807/1606] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:11 2022] PUT /identity/v3/projects/3c98e688d8074386aec985d804c02daa/users/6b6e9910ded44a2280a74bfefededc7c/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:11.382111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9cc78-f8e9-4452-80fc-e6b8a183388a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:11.416624 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3b20063d-96e9-404b-8d46-4a95ee0f8396 None None] MFA Rules not processed for user `e9721b0f80994f5aaf85f607c80f7119`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:11.418055 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3b20063d-96e9-404b-8d46-4a95ee0f8396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:11.491503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 800/1607] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:11.492431 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20063d-96e9-404b-8d46-4a95ee0f8396 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:11.495301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9cc78-f8e9-4452-80fc-e6b8a183388a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:11.501471 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa207f2-90cd-4893-a83b-447d64ec994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:11.502166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa207f2-90cd-4893-a83b-447d64ec994c admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.502588 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa207f2-90cd-4893-a83b-447d64ec994c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.502718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa207f2-90cd-4893-a83b-447d64ec994c admin admin] PATH_INFO: `/v3/projects/cd58f56a1c614317ab83f279e354896b/users/e5ad4dddff55436095a7d6a43317426f/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.506057 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20063d-96e9-404b-8d46-4a95ee0f8396 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:11.512693 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b4b8d-3bd4-4f2a-90db-5b195bd045a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:11.513380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b4b8d-3bd4-4f2a-90db-5b195bd045a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.513638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b4b8d-3bd4-4f2a-90db-5b195bd045a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.513908 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b4b8d-3bd4-4f2a-90db-5b195bd045a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.514588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b4b8d-3bd4-4f2a-90db-5b195bd045a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:11.516610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b4b8d-3bd4-4f2a-90db-5b195bd045a9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:11.522511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa207f2-90cd-4893-a83b-447d64ec994c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd58f56a1c614317ab83f279e354896b, user_id=e5ad4dddff55436095a7d6a43317426f, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:11.525345 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa207f2-90cd-4893-a83b-447d64ec994c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:11.559084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 801/1609] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:11 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:11.559327 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 808/1609] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:11 2022] PUT /identity/v3/projects/cd58f56a1c614317ab83f279e354896b/users/e5ad4dddff55436095a7d6a43317426f/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:11.561333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bf498-ca6a-4f63-9f69-e190933240a8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.563416 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b4b8d-3bd4-4f2a-90db-5b195bd045a9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:11.564733 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bf498-ca6a-4f63-9f69-e190933240a8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.565317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bf498-ca6a-4f63-9f69-e190933240a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.594158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-932bf498-ca6a-4f63-9f69-e190933240a8 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:11.596019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-932bf498-ca6a-4f63-9f69-e190933240a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:11.664557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b4b8d-3bd4-4f2a-90db-5b195bd045a9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:11.671468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa18a7c-86ce-4428-9d2e-e5ff19df705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:11.672139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa18a7c-86ce-4428-9d2e-e5ff19df705e admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.672416 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa18a7c-86ce-4428-9d2e-e5ff19df705e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.673606 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa18a7c-86ce-4428-9d2e-e5ff19df705e admin admin] PATH_INFO: `/v3/projects/7008bd1e5297450b913949ab8dcbbd55/users/1a9b4c47a1984331b9b686d60f0fb90b/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.694142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa18a7c-86ce-4428-9d2e-e5ff19df705e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7008bd1e5297450b913949ab8dcbbd55, user_id=1a9b4c47a1984331b9b686d60f0fb90b, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:11.697320 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa18a7c-86ce-4428-9d2e-e5ff19df705e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:11.719490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 802/1610] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:11 2022] PUT /identity/v3/projects/7008bd1e5297450b913949ab8dcbbd55/users/1a9b4c47a1984331b9b686d60f0fb90b/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:11.724496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15398-b25c-4326-beb5-51d694b9b207 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.725216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15398-b25c-4326-beb5-51d694b9b207 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.725622 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15398-b25c-4326-beb5-51d694b9b207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.733276 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:11.750495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 809/1611] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:11.752058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a1fa3-e489-410c-994c-658a4ae42218 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.752863 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a1fa3-e489-410c-994c-658a4ae42218 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.753158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a1fa3-e489-410c-994c-658a4ae42218 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.755490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 810/1612] 10.222.0.39 () {54 vars in 962 bytes} [Tue Jul 26 02:45:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:45:11.756265 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a1fa3-e489-410c-994c-658a4ae42218 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:11.758206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6db15398-b25c-4326-beb5-51d694b9b207 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:11.759844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6db15398-b25c-4326-beb5-51d694b9b207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:11.785842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:11.843427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 803/1613] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:11.844879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9f67b-cfd2-40a6-9ae9-6bcb91ed53ba None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.849233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9f67b-cfd2-40a6-9ae9-6bcb91ed53ba None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.849233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9f67b-cfd2-40a6-9ae9-6bcb91ed53ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.864919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a1fa3-e489-410c-994c-658a4ae42218 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:11.870986 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86ef15-71b8-40bf-8ad2-efc8f2372ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:11.871899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86ef15-71b8-40bf-8ad2-efc8f2372ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.872084 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86ef15-71b8-40bf-8ad2-efc8f2372ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.872570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86ef15-71b8-40bf-8ad2-efc8f2372ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.873438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86ef15-71b8-40bf-8ad2-efc8f2372ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:11.873792 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7dd9f67b-cfd2-40a6-9ae9-6bcb91ed53ba None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:11.875662 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86ef15-71b8-40bf-8ad2-efc8f2372ef0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:11.877975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7dd9f67b-cfd2-40a6-9ae9-6bcb91ed53ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:11.898319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 804/1614] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:11.898319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20200b-0ced-4f21-9c28-4bdb7b5a9fe8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.898319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20200b-0ced-4f21-9c28-4bdb7b5a9fe8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.898319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20200b-0ced-4f21-9c28-4bdb7b5a9fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.919270 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 811/1615] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:11 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:11.921694 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607eea3-5811-45f5-a8a2-5155cb9aa831 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:11.922684 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607eea3-5811-45f5-a8a2-5155cb9aa831 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:11.923062 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607eea3-5811-45f5-a8a2-5155cb9aa831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:11.954632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7a20200b-0ced-4f21-9c28-4bdb7b5a9fe8 None None] MFA Rules not processed for user `1a9b4c47a1984331b9b686d60f0fb90b`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:11.956214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7a20200b-0ced-4f21-9c28-4bdb7b5a9fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:12.021079 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5607eea3-5811-45f5-a8a2-5155cb9aa831 None None] MFA Rules not processed for user `338b2744014940ca96c08d4e9262697b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:12.025154 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5607eea3-5811-45f5-a8a2-5155cb9aa831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:12.071848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 805/1616] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:12.072646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20200b-0ced-4f21-9c28-4bdb7b5a9fe8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:12.160261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20200b-0ced-4f21-9c28-4bdb7b5a9fe8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:12.165977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc66f70-ed0c-483f-9602-dc9bb6932489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:12.166873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc66f70-ed0c-483f-9602-dc9bb6932489 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:12.167305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc66f70-ed0c-483f-9602-dc9bb6932489 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:12.168045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc66f70-ed0c-483f-9602-dc9bb6932489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:12.185410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc66f70-ed0c-483f-9602-dc9bb6932489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:12.187081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc66f70-ed0c-483f-9602-dc9bb6932489 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:12.204803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 806/1617] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:12.207059 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc66f70-ed0c-483f-9602-dc9bb6932489 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:12.220556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc66f70-ed0c-483f-9602-dc9bb6932489 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:12.225856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbbc10-a4da-4b32-8094-dbb39e4fd840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:12.227243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbbc10-a4da-4b32-8094-dbb39e4fd840 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:12.228414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbbc10-a4da-4b32-8094-dbb39e4fd840 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:12.228846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbbc10-a4da-4b32-8094-dbb39e4fd840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:12.255991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 812/1618] 10.222.0.39 () {58 vars in 1059 bytes} [Tue Jul 26 02:45:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:12.257074 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbbc10-a4da-4b32-8094-dbb39e4fd840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:12.258700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbbc10-a4da-4b32-8094-dbb39e4fd840 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:12.259400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607eea3-5811-45f5-a8a2-5155cb9aa831 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:12.291010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607eea3-5811-45f5-a8a2-5155cb9aa831 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:12.292520 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 807/1619] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:12.296361 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbbc10-a4da-4b32-8094-dbb39e4fd840 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:12.302437 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686dc4b-ba72-454e-af07-e928a78f336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:12.303730 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686dc4b-ba72-454e-af07-e928a78f336b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:12.304300 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686dc4b-ba72-454e-af07-e928a78f336b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:12.305197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686dc4b-ba72-454e-af07-e928a78f336b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:12.306495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686dc4b-ba72-454e-af07-e928a78f336b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:12.308807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686dc4b-ba72-454e-af07-e928a78f336b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:12.314983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbbc10-a4da-4b32-8094-dbb39e4fd840 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:12.329113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 813/1620] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:12.333051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f655d-3952-4897-b8fe-108224a8f979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:12.333889 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f655d-3952-4897-b8fe-108224a8f979 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:12.334023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66396-78d8-44b9-8cba-712568e3c0be None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:12.334187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f655d-3952-4897-b8fe-108224a8f979 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:12.334298 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66396-78d8-44b9-8cba-712568e3c0be None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:12.334463 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f655d-3952-4897-b8fe-108224a8f979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:12.334570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba66396-78d8-44b9-8cba-712568e3c0be None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:12.336121 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 814/1621] 10.222.0.39 () {54 vars in 962 bytes} [Tue Jul 26 02:45:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:45:12.336885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba66396-78d8-44b9-8cba-712568e3c0be None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:12.361879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba66396-78d8-44b9-8cba-712568e3c0be None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:12.367675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f655d-3952-4897-b8fe-108224a8f979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:12.369072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f655d-3952-4897-b8fe-108224a8f979 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:12.373036 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d451e9-d81f-4c0e-ab62-0065815ba65d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:12.374030 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d451e9-d81f-4c0e-ab62-0065815ba65d service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:12.374608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d451e9-d81f-4c0e-ab62-0065815ba65d service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:12.374890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d451e9-d81f-4c0e-ab62-0065815ba65d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:12.398020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 808/1622] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:12.398956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f655d-3952-4897-b8fe-108224a8f979 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:12.426860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f655d-3952-4897-b8fe-108224a8f979 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:12.437392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab90d2b-5522-496b-94a4-33298560483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:12.438091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab90d2b-5522-496b-94a4-33298560483b admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:12.438374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab90d2b-5522-496b-94a4-33298560483b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:12.439058 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab90d2b-5522-496b-94a4-33298560483b admin admin] PATH_INFO: `/v3/projects/1d8294a6bd1248ce8439d530512fc92a/users/7d32dbb0069f41fca2cb9affb40ab9fc/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:12.482533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab90d2b-5522-496b-94a4-33298560483b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8294a6bd1248ce8439d530512fc92a, user_id=7d32dbb0069f41fca2cb9affb40ab9fc, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:12.488683 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab90d2b-5522-496b-94a4-33298560483b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:12.493493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:12.501873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d451e9-d81f-4c0e-ab62-0065815ba65d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:12.504795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d451e9-d81f-4c0e-ab62-0065815ba65d service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:12.528214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:12.541077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 815/1623] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:12.546372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82500ce-659e-4221-8f30-02220359d3f9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:12.547435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82500ce-659e-4221-8f30-02220359d3f9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:12.550382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 809/1624] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:12 2022] PUT /identity/v3/projects/1d8294a6bd1248ce8439d530512fc92a/users/7d32dbb0069f41fca2cb9affb40ab9fc/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:12.550558 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82500ce-659e-4221-8f30-02220359d3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:12.552633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab90d2b-5522-496b-94a4-33298560483b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:12.617267 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a82500ce-659e-4221-8f30-02220359d3f9 None None] MFA Rules not processed for user `338b2744014940ca96c08d4e9262697b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:12.618539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a82500ce-659e-4221-8f30-02220359d3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:12.768535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab90d2b-5522-496b-94a4-33298560483b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:12.784185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f74941-6b47-46cf-8015-6774964f808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:12.787852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74941-6b47-46cf-8015-6774964f808c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:12.788137 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74941-6b47-46cf-8015-6774964f808c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:12.790699 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f74941-6b47-46cf-8015-6774964f808c admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:12.792446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f74941-6b47-46cf-8015-6774964f808c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:12.797112 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f74941-6b47-46cf-8015-6774964f808c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:12.828185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 810/1625] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:12.830035 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f74941-6b47-46cf-8015-6774964f808c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:12.850906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 816/1626] 10.222.0.39 () {58 vars in 1059 bytes} [Tue Jul 26 02:45:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:12.858495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82500ce-659e-4221-8f30-02220359d3f9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:12.859664 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f74941-6b47-46cf-8015-6774964f808c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:12.872376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75844eb3-60f9-4be6-87e0-f22e3eaef98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:12.872554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75844eb3-60f9-4be6-87e0-f22e3eaef98c admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:12.872734 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75844eb3-60f9-4be6-87e0-f22e3eaef98c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:12.872970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75844eb3-60f9-4be6-87e0-f22e3eaef98c admin admin] PATH_INFO: `/v3/projects/1d8294a6bd1248ce8439d530512fc92a/users/7d32dbb0069f41fca2cb9affb40ab9fc/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:12.875208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75844eb3-60f9-4be6-87e0-f22e3eaef98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8294a6bd1248ce8439d530512fc92a, user_id=7d32dbb0069f41fca2cb9affb40ab9fc, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:12.877906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75844eb3-60f9-4be6-87e0-f22e3eaef98c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:12.886197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82500ce-659e-4221-8f30-02220359d3f9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:12.902087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e7d75-6992-4815-a15f-217d99bf624a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:12.905683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e7d75-6992-4815-a15f-217d99bf624a service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:12.906029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e7d75-6992-4815-a15f-217d99bf624a service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:12.907105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e7d75-6992-4815-a15f-217d99bf624a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:12.913845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 811/1627] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:12 2022] PUT /identity/v3/projects/1d8294a6bd1248ce8439d530512fc92a/users/7d32dbb0069f41fca2cb9affb40ab9fc/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:12.915861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744926b0-47f9-4bff-9622-c348f89d877b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:12.916154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744926b0-47f9-4bff-9622-c348f89d877b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:12.916431 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744926b0-47f9-4bff-9622-c348f89d877b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:12.986189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-744926b0-47f9-4bff-9622-c348f89d877b None None] MFA Rules not processed for user `7d32dbb0069f41fca2cb9affb40ab9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:12.987619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-744926b0-47f9-4bff-9622-c348f89d877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:13.078277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e7d75-6992-4815-a15f-217d99bf624a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:13.080227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e7d75-6992-4815-a15f-217d99bf624a service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:13.102226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 817/1628] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:45:13.103635 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b78fdb-de59-44cd-a05f-3c978aab5639 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:13.103963 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b78fdb-de59-44cd-a05f-3c978aab5639 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:13.104243 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b78fdb-de59-44cd-a05f-3c978aab5639 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:13.117067 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 818/1629] 10.222.0.39 () {54 vars in 912 bytes} [Tue Jul 26 02:45:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:45:13.119943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd89a4-79bd-4fc1-92c7-cc9efec5c739 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:13.120474 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd89a4-79bd-4fc1-92c7-cc9efec5c739 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:13.120632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd89a4-79bd-4fc1-92c7-cc9efec5c739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:13.142318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 812/1630] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:13.150323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744926b0-47f9-4bff-9622-c348f89d877b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:13.165354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-01bd89a4-79bd-4fc1-92c7-cc9efec5c739 None None] MFA Rules not processed for user `338b2744014940ca96c08d4e9262697b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:13.166531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-01bd89a4-79bd-4fc1-92c7-cc9efec5c739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:13.257661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744926b0-47f9-4bff-9622-c348f89d877b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:13.265132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c1d64-3912-4c6e-a7c2-6f1658a6beb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:13.265575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c1d64-3912-4c6e-a7c2-6f1658a6beb3 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:13.265853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c1d64-3912-4c6e-a7c2-6f1658a6beb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:13.266120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c1d64-3912-4c6e-a7c2-6f1658a6beb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:13.290241 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c1d64-3912-4c6e-a7c2-6f1658a6beb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:13.291724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c1d64-3912-4c6e-a7c2-6f1658a6beb3 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:13.312769 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 813/1631] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:13.316697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 819/1632] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:45:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:13.332143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c1d64-3912-4c6e-a7c2-6f1658a6beb3 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:13.353352 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c1d64-3912-4c6e-a7c2-6f1658a6beb3 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:13.356635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b7d90-6f3b-4d32-a424-62b0022dab20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:13.357329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b7d90-6f3b-4d32-a424-62b0022dab20 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:13.357602 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b7d90-6f3b-4d32-a424-62b0022dab20 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:13.357867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b7d90-6f3b-4d32-a424-62b0022dab20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:13.379419 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:13.384665 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b7d90-6f3b-4d32-a424-62b0022dab20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:13.387806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b7d90-6f3b-4d32-a424-62b0022dab20 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:13.421658 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 814/1633] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:13.513452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1f4a5-24ab-48bf-9fa6-5f5d5985140c None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:13.514109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1f4a5-24ab-48bf-9fa6-5f5d5985140c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:13.514230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1f4a5-24ab-48bf-9fa6-5f5d5985140c None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:13.515571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 820/1634] 10.222.0.39 () {54 vars in 912 bytes} [Tue Jul 26 02:45:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:45:13.528020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecb8dd-9851-4a24-bc21-8431bd819013 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:13.528359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecb8dd-9851-4a24-bc21-8431bd819013 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:13.528712 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecb8dd-9851-4a24-bc21-8431bd819013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:13.602572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-68ecb8dd-9851-4a24-bc21-8431bd819013 None None] MFA Rules not processed for user `338b2744014940ca96c08d4e9262697b`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:13.610131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-68ecb8dd-9851-4a24-bc21-8431bd819013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:13.641713 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 815/1635] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:45:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:45:13.657795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1f4a5-24ab-48bf-9fa6-5f5d5985140c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:13.677727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1f4a5-24ab-48bf-9fa6-5f5d5985140c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:13.698940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14a514-fe2d-4353-ab43-6001826511dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:13.699608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14a514-fe2d-4353-ab43-6001826511dc service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:13.699885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14a514-fe2d-4353-ab43-6001826511dc service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:13.700149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14a514-fe2d-4353-ab43-6001826511dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:13.725905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14a514-fe2d-4353-ab43-6001826511dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:13.727859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f14a514-fe2d-4353-ab43-6001826511dc service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:13.755192 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 821/1636] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:15.510522 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecb8dd-9851-4a24-bc21-8431bd819013 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:15.675608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecb8dd-9851-4a24-bc21-8431bd819013 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:15.686234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:15.689022 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:15.690066 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:15.690766 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] PATH_INFO: `/v3/users/963844f49e4440a9afeb28fdb83b8853` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:15.693029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] RBAC: Authorizing `identity:delete_user(user_id=963844f49e4440a9afeb28fdb83b8853)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:15.695823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:15.826882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963844f49e4440a9afeb28fdb83b8853'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:15.852908 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963844f49e4440a9afeb28fdb83b8853'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:15.854381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963844f49e4440a9afeb28fdb83b8853'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:15.875770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963844f49e4440a9afeb28fdb83b8853'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:15.876876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963844f49e4440a9afeb28fdb83b8853'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:15.909719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 816/1637] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:45:15 2022] DELETE /identity/v3/users/963844f49e4440a9afeb28fdb83b8853 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:15.910650 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd015-f33a-4dfd-9893-11c4fdeed9b4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:15.911148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd015-f33a-4dfd-9893-11c4fdeed9b4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:15.911238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd015-f33a-4dfd-9893-11c4fdeed9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:15.920407 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:15.948274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d83cd015-f33a-4dfd-9893-11c4fdeed9b4 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:15.949639 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d83cd015-f33a-4dfd-9893-11c4fdeed9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:16.104488 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 822/1638] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:16.146434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:16.148145 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:16.324331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c1723-5b37-45f1-b4b2-dfeaaf84f32d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:16.368302 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471966db-bc78-4c11-80e8-4c2412dd4684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:16.368987 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471966db-bc78-4c11-80e8-4c2412dd4684 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:16.369275 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471966db-bc78-4c11-80e8-4c2412dd4684 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:16.369794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471966db-bc78-4c11-80e8-4c2412dd4684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:16.385196 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471966db-bc78-4c11-80e8-4c2412dd4684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:16.387587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471966db-bc78-4c11-80e8-4c2412dd4684 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:16.401863 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 817/1639] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:17.150667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd015-f33a-4dfd-9893-11c4fdeed9b4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:17.153440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d83cd015-f33a-4dfd-9893-11c4fdeed9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:17.176250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd015-f33a-4dfd-9893-11c4fdeed9b4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:17.183812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:17.184962 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:17.185741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:17.186704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] PATH_INFO: `/v3/users/1a9b4c47a1984331b9b686d60f0fb90b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:17.188755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9b4c47a1984331b9b686d60f0fb90b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:17.190258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: WARNING py.warnings [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:45:17.190258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: warnings.warn(msg) Jul 26 02:45:17.190258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: Jul 26 02:45:17.192505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:17.333212 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9b4c47a1984331b9b686d60f0fb90b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:17.358883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9b4c47a1984331b9b686d60f0fb90b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:17.376560 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9b4c47a1984331b9b686d60f0fb90b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:17.378576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9b4c47a1984331b9b686d60f0fb90b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:17.420248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9b4c47a1984331b9b686d60f0fb90b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:17.439154 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 823/1640] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:45:17 2022] DELETE /identity/v3/users/1a9b4c47a1984331b9b686d60f0fb90b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:17.440219 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11942-59c2-431f-bf6f-93258f07710e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:17.441044 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11942-59c2-431f-bf6f-93258f07710e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:17.441504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11942-59c2-431f-bf6f-93258f07710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:17.463705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-01b11942-59c2-431f-bf6f-93258f07710e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:17.466023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-01b11942-59c2-431f-bf6f-93258f07710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:17.472825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:17.569258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 818/1641] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:17.614586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:17.616113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:17.697181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2202f6-dae2-4e32-908a-5ce6c8272bca admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:17.701891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42994fd4-d26d-45aa-bf22-c9deed9901ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:17.702815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42994fd4-d26d-45aa-bf22-c9deed9901ca service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:17.703199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42994fd4-d26d-45aa-bf22-c9deed9901ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:17.703573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42994fd4-d26d-45aa-bf22-c9deed9901ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:17.716762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42994fd4-d26d-45aa-bf22-c9deed9901ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:17.718977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42994fd4-d26d-45aa-bf22-c9deed9901ca service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:17.736488 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 824/1642] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:18.042928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b11942-59c2-431f-bf6f-93258f07710e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:18.045233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-01b11942-59c2-431f-bf6f-93258f07710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:18.066146 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b11942-59c2-431f-bf6f-93258f07710e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:18.081582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:18.083440 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:18.083440 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:18.083440 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] PATH_INFO: `/v3/projects/ebd3e78dfd374d7d81b75ba3e6dfb757` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:18.084072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd3e78dfd374d7d81b75ba3e6dfb757)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:18.085131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: WARNING py.warnings [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 02:45:18.085131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: warnings.warn(msg) Jul 26 02:45:18.085131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: Jul 26 02:45:18.086398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:18.220098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd3e78dfd374d7d81b75ba3e6dfb757', 'request_id': 'req-46f79ed9-3b24-4f35-ab73-5826402d6c1b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:18.254409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd3e78dfd374d7d81b75ba3e6dfb757', 'request_id': 'req-46f79ed9-3b24-4f35-ab73-5826402d6c1b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:18.268777 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd3e78dfd374d7d81b75ba3e6dfb757', 'request_id': 'req-46f79ed9-3b24-4f35-ab73-5826402d6c1b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:18.294863 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] The token cache is being invalidate because project ebd3e78dfd374d7d81b75ba3e6dfb757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:45:18.295167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:18.295926 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:18.297967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 819/1643] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:45:18 2022] DELETE /identity/v3/projects/ebd3e78dfd374d7d81b75ba3e6dfb757 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:18.310016 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42994fd4-d26d-45aa-bf22-c9deed9901ca service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:18.345499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42994fd4-d26d-45aa-bf22-c9deed9901ca service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:18.371698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:18.472702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f8269-2c5e-4acb-8bbe-05405d11e6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:18.473791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f8269-2c5e-4acb-8bbe-05405d11e6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:18.474197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f8269-2c5e-4acb-8bbe-05405d11e6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:18.474526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f8269-2c5e-4acb-8bbe-05405d11e6a5 admin admin] PATH_INFO: `/v3/users/7d32dbb0069f41fca2cb9affb40ab9fc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:18.476045 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f8269-2c5e-4acb-8bbe-05405d11e6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d32dbb0069f41fca2cb9affb40ab9fc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:18.479545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f8269-2c5e-4acb-8bbe-05405d11e6a5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:18.572090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-647f8269-2c5e-4acb-8bbe-05405d11e6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d32dbb0069f41fca2cb9affb40ab9fc'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:18.583607 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-647f8269-2c5e-4acb-8bbe-05405d11e6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d32dbb0069f41fca2cb9affb40ab9fc'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:18.597074 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-647f8269-2c5e-4acb-8bbe-05405d11e6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d32dbb0069f41fca2cb9affb40ab9fc'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:18.600066 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-647f8269-2c5e-4acb-8bbe-05405d11e6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d32dbb0069f41fca2cb9affb40ab9fc'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:18.638772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-647f8269-2c5e-4acb-8bbe-05405d11e6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d32dbb0069f41fca2cb9affb40ab9fc'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:18.659446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 825/1644] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:45:18 2022] DELETE /identity/v3/users/7d32dbb0069f41fca2cb9affb40ab9fc => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:19.137191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:19.143471 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:19.160134 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79ed9-3b24-4f35-ab73-5826402d6c1b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:19.272973 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:19.273779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:19.274099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:19.274453 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76 admin admin] PATH_INFO: `/v3/projects/7008bd1e5297450b913949ab8dcbbd55` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:19.276286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7008bd1e5297450b913949ab8dcbbd55)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:19.281666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:19.356456 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:19.384605 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7008bd1e5297450b913949ab8dcbbd55', 'request_id': 'req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:19.395726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7008bd1e5297450b913949ab8dcbbd55', 'request_id': 'req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:19.412742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7008bd1e5297450b913949ab8dcbbd55', 'request_id': 'req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:19.435909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76 admin admin] The token cache is being invalidate because project 7008bd1e5297450b913949ab8dcbbd55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:45:19.436613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:19.437724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e3f296b2-83ef-4ae2-93bb-6b64c0100a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:19.444732 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 820/1645] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:45:19 2022] DELETE /identity/v3/projects/7008bd1e5297450b913949ab8dcbbd55 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:19.445442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2f61f-ee2a-4fcd-9a2c-ddbeb234ba30 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:19.445892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2f61f-ee2a-4fcd-9a2c-ddbeb234ba30 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:19.446071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2f61f-ee2a-4fcd-9a2c-ddbeb234ba30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:19.528302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-51e2f61f-ee2a-4fcd-9a2c-ddbeb234ba30 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:19.529590 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-51e2f61f-ee2a-4fcd-9a2c-ddbeb234ba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:19.692580 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 826/1646] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:19.701704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be723db-0be1-43b3-8d7b-e8e87dade7e5 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:19.702842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be723db-0be1-43b3-8d7b-e8e87dade7e5 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:19.703229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be723db-0be1-43b3-8d7b-e8e87dade7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:19.743996 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4be723db-0be1-43b3-8d7b-e8e87dade7e5 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:19.745437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4be723db-0be1-43b3-8d7b-e8e87dade7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:19.767351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2f61f-ee2a-4fcd-9a2c-ddbeb234ba30 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:19.776768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 821/1647] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:19.783530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2f61f-ee2a-4fcd-9a2c-ddbeb234ba30 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:19.804602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b5643-88c5-4d99-8283-6b507185b878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:19.805718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b5643-88c5-4d99-8283-6b507185b878 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:19.806113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b5643-88c5-4d99-8283-6b507185b878 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:19.808747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b5643-88c5-4d99-8283-6b507185b878 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:19.808747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b5643-88c5-4d99-8283-6b507185b878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:19.808747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b5643-88c5-4d99-8283-6b507185b878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:19.820606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b5643-88c5-4d99-8283-6b507185b878 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:19.860896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 827/1648] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:19.866043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be723db-0be1-43b3-8d7b-e8e87dade7e5 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:19.877704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be723db-0be1-43b3-8d7b-e8e87dade7e5 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:19.890648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18596100-7650-4ad8-8845-d5596f5dcff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:19.894178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596100-7650-4ad8-8845-d5596f5dcff5 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:19.894488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596100-7650-4ad8-8845-d5596f5dcff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:19.894736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596100-7650-4ad8-8845-d5596f5dcff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:19.895501 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18596100-7650-4ad8-8845-d5596f5dcff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:19.905275 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18596100-7650-4ad8-8845-d5596f5dcff5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:19.974438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b5643-88c5-4d99-8283-6b507185b878 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:19.984030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 822/1649] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:19 2022] POST /identity/v3/projects => generated 357 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:19.989653 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b5643-88c5-4d99-8283-6b507185b878 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:20.054067 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:20.140537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748f39a-d55e-41eb-98c9-ccbd2d579cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:20.142535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748f39a-d55e-41eb-98c9-ccbd2d579cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:20.143611 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748f39a-d55e-41eb-98c9-ccbd2d579cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:20.145520 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748f39a-d55e-41eb-98c9-ccbd2d579cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:20.146414 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748f39a-d55e-41eb-98c9-ccbd2d579cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:20.150592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748f39a-d55e-41eb-98c9-ccbd2d579cb1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:20.189696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 828/1650] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:19 2022] POST /identity/v3/users => generated 279 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:20.194058 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18596100-7650-4ad8-8845-d5596f5dcff5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:20.213697 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18596100-7650-4ad8-8845-d5596f5dcff5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:20.227728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bb42e-1510-431b-bb26-5b7dce9aa702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:20.230526 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bb42e-1510-431b-bb26-5b7dce9aa702 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:20.233864 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bb42e-1510-431b-bb26-5b7dce9aa702 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:20.234342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0bb42e-1510-431b-bb26-5b7dce9aa702 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:20.235253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0bb42e-1510-431b-bb26-5b7dce9aa702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:20.238132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0bb42e-1510-431b-bb26-5b7dce9aa702 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:20.274717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 823/1651] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:20.278217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748f39a-d55e-41eb-98c9-ccbd2d579cb1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:20.294213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748f39a-d55e-41eb-98c9-ccbd2d579cb1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:20.310749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9cde3-19ca-48ee-86d4-d74841db1387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:20.311420 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9cde3-19ca-48ee-86d4-d74841db1387 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:20.311706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9cde3-19ca-48ee-86d4-d74841db1387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:20.311988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9cde3-19ca-48ee-86d4-d74841db1387 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:20.312704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9cde3-19ca-48ee-86d4-d74841db1387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:20.314918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9cde3-19ca-48ee-86d4-d74841db1387 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:20.356339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 829/1652] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:20.360756 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bb42e-1510-431b-bb26-5b7dce9aa702 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:20.372161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0bb42e-1510-431b-bb26-5b7dce9aa702 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:20.388974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b8520-755d-4eb4-bfe9-d3969a42bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:20.389814 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b8520-755d-4eb4-bfe9-d3969a42bfb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:20.390104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b8520-755d-4eb4-bfe9-d3969a42bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:20.390377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b8520-755d-4eb4-bfe9-d3969a42bfb4 admin admin] PATH_INFO: `/v3/projects/42ac3484f24840a08defb6a4c02f0fae/users/cf2ce978f5e94674b2d937ab3cc72770/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:20.403238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9cde3-19ca-48ee-86d4-d74841db1387 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:20.405783 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-55e9cde3-19ca-48ee-86d4-d74841db1387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:20.422276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b8520-755d-4eb4-bfe9-d3969a42bfb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ac3484f24840a08defb6a4c02f0fae, user_id=cf2ce978f5e94674b2d937ab3cc72770, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:20.426980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b8520-755d-4eb4-bfe9-d3969a42bfb4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:20.432597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9cde3-19ca-48ee-86d4-d74841db1387 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:20.450103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d833492-ce4d-4db6-9ce9-b0d8f578640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:20.450796 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d833492-ce4d-4db6-9ce9-b0d8f578640c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:20.451158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d833492-ce4d-4db6-9ce9-b0d8f578640c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:20.451695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d833492-ce4d-4db6-9ce9-b0d8f578640c admin admin] PATH_INFO: `/v3/projects/1d8294a6bd1248ce8439d530512fc92a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:20.453867 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d833492-ce4d-4db6-9ce9-b0d8f578640c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8294a6bd1248ce8439d530512fc92a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:20.459669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d833492-ce4d-4db6-9ce9-b0d8f578640c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:20.467152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 824/1653] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:20 2022] PUT /identity/v3/projects/42ac3484f24840a08defb6a4c02f0fae/users/cf2ce978f5e94674b2d937ab3cc72770/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:20.480962 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155bb81-dfba-4e27-9635-a8b99744d7ca None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:20.481251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155bb81-dfba-4e27-9635-a8b99744d7ca None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:20.481577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155bb81-dfba-4e27-9635-a8b99744d7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:20.538838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5155bb81-dfba-4e27-9635-a8b99744d7ca None None] MFA Rules not processed for user `cf2ce978f5e94674b2d937ab3cc72770`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:20.540345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5155bb81-dfba-4e27-9635-a8b99744d7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:20.584469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d833492-ce4d-4db6-9ce9-b0d8f578640c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8294a6bd1248ce8439d530512fc92a', 'request_id': 'req-0d833492-ce4d-4db6-9ce9-b0d8f578640c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:20.605693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d833492-ce4d-4db6-9ce9-b0d8f578640c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8294a6bd1248ce8439d530512fc92a', 'request_id': 'req-0d833492-ce4d-4db6-9ce9-b0d8f578640c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:20.617736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d833492-ce4d-4db6-9ce9-b0d8f578640c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8294a6bd1248ce8439d530512fc92a', 'request_id': 'req-0d833492-ce4d-4db6-9ce9-b0d8f578640c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:20.651197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d833492-ce4d-4db6-9ce9-b0d8f578640c admin admin] The token cache is being invalidate because project 1d8294a6bd1248ce8439d530512fc92a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:45:20.651495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d833492-ce4d-4db6-9ce9-b0d8f578640c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:20.653781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0d833492-ce4d-4db6-9ce9-b0d8f578640c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:20.657469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 830/1654] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:45:20 2022] DELETE /identity/v3/projects/1d8294a6bd1248ce8439d530512fc92a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:45:20.660790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef87ae-6496-4972-b0f4-cb775057bcbf None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:20.661532 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef87ae-6496-4972-b0f4-cb775057bcbf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:20.661532 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef87ae-6496-4972-b0f4-cb775057bcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:20.714957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 825/1655] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:20 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:20.716926 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e9ef87ae-6496-4972-b0f4-cb775057bcbf None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:20.718409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e9ef87ae-6496-4972-b0f4-cb775057bcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:20.720181 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155bb81-dfba-4e27-9635-a8b99744d7ca None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:20.721950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5155bb81-dfba-4e27-9635-a8b99744d7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:20.892170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:20.927714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 831/1656] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:20.929547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ee064-9e3f-4eea-b51c-0474c6f9cf7c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:20.929777 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155bb81-dfba-4e27-9635-a8b99744d7ca None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:20.929880 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ee064-9e3f-4eea-b51c-0474c6f9cf7c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:20.930072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ee064-9e3f-4eea-b51c-0474c6f9cf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:20.942985 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37a238-604f-42b0-b0c1-9483145e910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:20.944374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37a238-604f-42b0-b0c1-9483145e910c admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:20.944374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37a238-604f-42b0-b0c1-9483145e910c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:20.944374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37a238-604f-42b0-b0c1-9483145e910c admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:20.944826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37a238-604f-42b0-b0c1-9483145e910c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:20.946807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37a238-604f-42b0-b0c1-9483145e910c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:20.966745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-585ee064-9e3f-4eea-b51c-0474c6f9cf7c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:20.966745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-585ee064-9e3f-4eea-b51c-0474c6f9cf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:20.987535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 832/1657] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:45:20.988244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ee064-9e3f-4eea-b51c-0474c6f9cf7c None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:20.993927 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-585ee064-9e3f-4eea-b51c-0474c6f9cf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:21.021980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 826/1658] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:20 2022] POST /identity/v3/projects => generated 353 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:45:21.021980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37a238-604f-42b0-b0c1-9483145e910c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:21.030254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ee064-9e3f-4eea-b51c-0474c6f9cf7c None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:21.067016 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:21.157266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:21.157974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:21.158256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:21.158531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] PATH_INFO: `/v3/users/e9721b0f80994f5aaf85f607c80f7119` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:21.171023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9721b0f80994f5aaf85f607c80f7119)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:21.173186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:21.250689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37a238-604f-42b0-b0c1-9483145e910c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:21.256972 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a91b37-250b-40ee-ab66-2955940bd7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:21.258250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a91b37-250b-40ee-ab66-2955940bd7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:21.258477 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a91b37-250b-40ee-ab66-2955940bd7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:21.258745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a91b37-250b-40ee-ab66-2955940bd7b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:21.259834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a91b37-250b-40ee-ab66-2955940bd7b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:21.260364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a91b37-250b-40ee-ab66-2955940bd7b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:21.263046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a91b37-250b-40ee-ab66-2955940bd7b4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:21.293315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 827/1659] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:21.293739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a91b37-250b-40ee-ab66-2955940bd7b4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:21.320447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a91b37-250b-40ee-ab66-2955940bd7b4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:21.325190 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9721b0f80994f5aaf85f607c80f7119'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:21.333634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79b430-e463-431e-8608-97749f772e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:21.334584 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79b430-e463-431e-8608-97749f772e1d admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:21.335019 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79b430-e463-431e-8608-97749f772e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:21.335481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79b430-e463-431e-8608-97749f772e1d admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:21.336570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79b430-e463-431e-8608-97749f772e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:21.338707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79b430-e463-431e-8608-97749f772e1d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:21.362772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9721b0f80994f5aaf85f607c80f7119'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:21.382588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 828/1660] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:21 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:21.382588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79b430-e463-431e-8608-97749f772e1d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:21.387715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9721b0f80994f5aaf85f607c80f7119'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:21.391237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9721b0f80994f5aaf85f607c80f7119'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:21.396490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79b430-e463-431e-8608-97749f772e1d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:21.404882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c53e5-1fd7-4c97-b17c-c7f88ea62ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:21.405598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c53e5-1fd7-4c97-b17c-c7f88ea62ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:21.405883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c53e5-1fd7-4c97-b17c-c7f88ea62ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:21.406376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c53e5-1fd7-4c97-b17c-c7f88ea62ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:21.406859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c53e5-1fd7-4c97-b17c-c7f88ea62ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:21.419191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c53e5-1fd7-4c97-b17c-c7f88ea62ef4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:21.426915 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9721b0f80994f5aaf85f607c80f7119'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:21.442246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 833/1661] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:45:20 2022] DELETE /identity/v3/users/e9721b0f80994f5aaf85f607c80f7119 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:21.443116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:21.446558 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:21.465745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 829/1662] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:21 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:21.471051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7dcd4-7f84-4fde-934e-265b0503961b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:21.471051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7dcd4-7f84-4fde-934e-265b0503961b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:21.471051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7dcd4-7f84-4fde-934e-265b0503961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:21.490455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7ff7dcd4-7f84-4fde-934e-265b0503961b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:21.491705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7ff7dcd4-7f84-4fde-934e-265b0503961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:21.587267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 830/1663] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:21.588455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7dcd4-7f84-4fde-934e-265b0503961b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:21.590249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7ff7dcd4-7f84-4fde-934e-265b0503961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:21.610591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7dcd4-7f84-4fde-934e-265b0503961b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:21.623264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb114-beb5-4a6d-95e1-c71937297e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:21.623879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb114-beb5-4a6d-95e1-c71937297e7d admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:21.624180 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb114-beb5-4a6d-95e1-c71937297e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:21.624460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb114-beb5-4a6d-95e1-c71937297e7d admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:21.626553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cb114-beb5-4a6d-95e1-c71937297e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:21.637092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cb114-beb5-4a6d-95e1-c71937297e7d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:21.678281 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 831/1664] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:21 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:21.679826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb114-beb5-4a6d-95e1-c71937297e7d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:21.695935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef833d71-7fe4-4d0c-b981-ca6e7fa506d8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:21.697637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb114-beb5-4a6d-95e1-c71937297e7d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:21.703805 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5bb02-25bd-41e7-9ab2-5c131295b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:21.704716 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5bb02-25bd-41e7-9ab2-5c131295b309 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:21.705032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5bb02-25bd-41e7-9ab2-5c131295b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:21.705393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5bb02-25bd-41e7-9ab2-5c131295b309 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:21.707036 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5bb02-25bd-41e7-9ab2-5c131295b309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:21.709133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5bb02-25bd-41e7-9ab2-5c131295b309 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:21.713620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56158df-e024-4d1e-a237-d8339b2b6a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:21.714938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56158df-e024-4d1e-a237-d8339b2b6a59 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:21.715892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56158df-e024-4d1e-a237-d8339b2b6a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:21.716478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56158df-e024-4d1e-a237-d8339b2b6a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:21.717906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56158df-e024-4d1e-a237-d8339b2b6a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:21.727755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 832/1665] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:21.728747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5bb02-25bd-41e7-9ab2-5c131295b309 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:21.729238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56158df-e024-4d1e-a237-d8339b2b6a59 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:21.730657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-51c5bb02-25bd-41e7-9ab2-5c131295b309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:21.737561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:21.772995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 834/1666] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:21.774587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56158df-e024-4d1e-a237-d8339b2b6a59 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:21.811270 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56158df-e024-4d1e-a237-d8339b2b6a59 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:21.828846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de98a4b-a29a-448a-84b7-04dcfff6df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:21.830061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de98a4b-a29a-448a-84b7-04dcfff6df0b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:21.830905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5bb02-25bd-41e7-9ab2-5c131295b309 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:21.831435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de98a4b-a29a-448a-84b7-04dcfff6df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:21.831806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de98a4b-a29a-448a-84b7-04dcfff6df0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:21.842465 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de98a4b-a29a-448a-84b7-04dcfff6df0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:21.843025 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb778e-986c-4a39-ae25-1232734e83a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:21.843795 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb778e-986c-4a39-ae25-1232734e83a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:21.844145 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb778e-986c-4a39-ae25-1232734e83a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:21.844241 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de98a4b-a29a-448a-84b7-04dcfff6df0b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:21.844493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb778e-986c-4a39-ae25-1232734e83a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:21.867528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 835/1667] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:21.868417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de98a4b-a29a-448a-84b7-04dcfff6df0b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:21.873920 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb778e-986c-4a39-ae25-1232734e83a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:21.878644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb778e-986c-4a39-ae25-1232734e83a7 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:21.889751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de98a4b-a29a-448a-84b7-04dcfff6df0b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:21.901938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77686769-157e-4161-9c1b-019303c2b7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:21.902737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77686769-157e-4161-9c1b-019303c2b7d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:21.903025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77686769-157e-4161-9c1b-019303c2b7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:21.903293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77686769-157e-4161-9c1b-019303c2b7d3 admin admin] PATH_INFO: `/v3/projects/977f59b4e5a14a82a061df0e05fe080e/users/91d867a0f4154609bfac75979de71701/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:21.908290 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 833/1668] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:21.910476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb778e-986c-4a39-ae25-1232734e83a7 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:21.934468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb778e-986c-4a39-ae25-1232734e83a7 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:21.936437 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77686769-157e-4161-9c1b-019303c2b7d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=977f59b4e5a14a82a061df0e05fe080e, user_id=91d867a0f4154609bfac75979de71701, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:21.950026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77686769-157e-4161-9c1b-019303c2b7d3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:21.952037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d25f8-7ec6-46c6-89b2-9a8396a16cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:21.952427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d25f8-7ec6-46c6-89b2-9a8396a16cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:21.952844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d25f8-7ec6-46c6-89b2-9a8396a16cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:21.953118 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d25f8-7ec6-46c6-89b2-9a8396a16cfc admin admin] PATH_INFO: `/v3/projects/c5b5677c2164412d8d05066530f7542d/users/ea3a748c3be9495badedff5cf9b859b5/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:21.967027 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:21.973377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 836/1669] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:21 2022] PUT /identity/v3/projects/977f59b4e5a14a82a061df0e05fe080e/users/91d867a0f4154609bfac75979de71701/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:21.978105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77686769-157e-4161-9c1b-019303c2b7d3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:22.025991 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d25f8-7ec6-46c6-89b2-9a8396a16cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b5677c2164412d8d05066530f7542d, user_id=ea3a748c3be9495badedff5cf9b859b5, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:22.028791 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d25f8-7ec6-46c6-89b2-9a8396a16cfc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:22.068122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 834/1670] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:21 2022] PUT /identity/v3/projects/c5b5677c2164412d8d05066530f7542d/users/ea3a748c3be9495badedff5cf9b859b5/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:22.079694 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77686769-157e-4161-9c1b-019303c2b7d3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:22.082181 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31caf1-ab9d-4279-add7-cb41de111aa9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:22.082181 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31caf1-ab9d-4279-add7-cb41de111aa9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:22.082644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31caf1-ab9d-4279-add7-cb41de111aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:22.142836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-de31caf1-ab9d-4279-add7-cb41de111aa9 None None] MFA Rules not processed for user `ea3a748c3be9495badedff5cf9b859b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:22.144073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-de31caf1-ab9d-4279-add7-cb41de111aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:22.251060 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94829b83-825f-4a67-9116-4ff8e8d746a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:22.251436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94829b83-825f-4a67-9116-4ff8e8d746a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:22.251870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94829b83-825f-4a67-9116-4ff8e8d746a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:22.252277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94829b83-825f-4a67-9116-4ff8e8d746a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:22.253483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94829b83-825f-4a67-9116-4ff8e8d746a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:22.259555 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94829b83-825f-4a67-9116-4ff8e8d746a3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:22.296678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 837/1671] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:45:22.299854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94829b83-825f-4a67-9116-4ff8e8d746a3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:22.341676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94829b83-825f-4a67-9116-4ff8e8d746a3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:22.368076 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936450b6-0e23-474f-8d43-65d4784cc165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:22.369614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 835/1672] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:22.371785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936450b6-0e23-474f-8d43-65d4784cc165 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:22.372071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936450b6-0e23-474f-8d43-65d4784cc165 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:22.372344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936450b6-0e23-474f-8d43-65d4784cc165 admin admin] PATH_INFO: `/v3/projects/977f59b4e5a14a82a061df0e05fe080e/users/91d867a0f4154609bfac75979de71701/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:22.375837 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936450b6-0e23-474f-8d43-65d4784cc165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=977f59b4e5a14a82a061df0e05fe080e, user_id=91d867a0f4154609bfac75979de71701, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:22.376459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31caf1-ab9d-4279-add7-cb41de111aa9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:22.380822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936450b6-0e23-474f-8d43-65d4784cc165 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:22.398328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 838/1673] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:22 2022] PUT /identity/v3/projects/977f59b4e5a14a82a061df0e05fe080e/users/91d867a0f4154609bfac75979de71701/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:22.410130 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e39a87-d476-41e4-844e-4f2b443bfb91 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:22.410776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e39a87-d476-41e4-844e-4f2b443bfb91 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:22.411294 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e39a87-d476-41e4-844e-4f2b443bfb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:22.414309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31caf1-ab9d-4279-add7-cb41de111aa9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:22.469641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-38e39a87-d476-41e4-844e-4f2b443bfb91 None None] MFA Rules not processed for user `91d867a0f4154609bfac75979de71701`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:22.472346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-38e39a87-d476-41e4-844e-4f2b443bfb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:22.556318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116516b9-bdf8-4fe1-bafa-a3a0ab8982dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:22.557331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116516b9-bdf8-4fe1-bafa-a3a0ab8982dd admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:22.557533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116516b9-bdf8-4fe1-bafa-a3a0ab8982dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:22.557914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116516b9-bdf8-4fe1-bafa-a3a0ab8982dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:22.558738 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116516b9-bdf8-4fe1-bafa-a3a0ab8982dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:22.565532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116516b9-bdf8-4fe1-bafa-a3a0ab8982dd admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:22.601172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:22.619817 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 839/1674] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:22.623138 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 836/1675] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:22 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:22.632618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e39a87-d476-41e4-844e-4f2b443bfb91 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:22.638449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116516b9-bdf8-4fe1-bafa-a3a0ab8982dd admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:22.642542 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-116516b9-bdf8-4fe1-bafa-a3a0ab8982dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:22.659895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e39a87-d476-41e4-844e-4f2b443bfb91 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:22.682791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:22.739375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116516b9-bdf8-4fe1-bafa-a3a0ab8982dd admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:22.743527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23157e03-daf3-4ca7-8cbd-f6af008bbe49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:22.744627 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23157e03-daf3-4ca7-8cbd-f6af008bbe49 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:22.744913 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23157e03-daf3-4ca7-8cbd-f6af008bbe49 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:22.745370 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23157e03-daf3-4ca7-8cbd-f6af008bbe49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:22.791726 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9568ae-7558-4cd5-8da9-235687cedb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:22.792378 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9568ae-7558-4cd5-8da9-235687cedb86 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:22.792749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9568ae-7558-4cd5-8da9-235687cedb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:22.793028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9568ae-7558-4cd5-8da9-235687cedb86 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:22.793855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9568ae-7558-4cd5-8da9-235687cedb86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:22.805125 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9568ae-7558-4cd5-8da9-235687cedb86 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:22.842783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23157e03-daf3-4ca7-8cbd-f6af008bbe49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:22.844348 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23157e03-daf3-4ca7-8cbd-f6af008bbe49 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:22.848472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 840/1676] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:22 2022] POST /identity/v3/users => generated 295 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:22.852618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9568ae-7558-4cd5-8da9-235687cedb86 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:22.871708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9568ae-7558-4cd5-8da9-235687cedb86 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:22.880517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 837/1677] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:22 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:22.883461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefaccd-cba9-45e3-b18b-b4facfcd6a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:22.884118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefaccd-cba9-45e3-b18b-b4facfcd6a0e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:22.884397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefaccd-cba9-45e3-b18b-b4facfcd6a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:22.884663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefaccd-cba9-45e3-b18b-b4facfcd6a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:22.900199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefaccd-cba9-45e3-b18b-b4facfcd6a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:22.908397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefaccd-cba9-45e3-b18b-b4facfcd6a0e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:22.961110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23157e03-daf3-4ca7-8cbd-f6af008bbe49 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:22.988627 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23157e03-daf3-4ca7-8cbd-f6af008bbe49 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:22.993605 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f2ad6-eb48-4efc-856a-4cc8fbd6903b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:22.994319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f2ad6-eb48-4efc-856a-4cc8fbd6903b admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:22.994657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f2ad6-eb48-4efc-856a-4cc8fbd6903b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:22.994867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f2ad6-eb48-4efc-856a-4cc8fbd6903b admin admin] PATH_INFO: `/v3/projects/fea5c806776b42ce9e2d89bc2a8cd7cd/users/5579d3ec81f34cf99c6b4455962b7548/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:22.996447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 841/1678] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:23.025399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f2ad6-eb48-4efc-856a-4cc8fbd6903b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea5c806776b42ce9e2d89bc2a8cd7cd, user_id=5579d3ec81f34cf99c6b4455962b7548, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:23.028955 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f2ad6-eb48-4efc-856a-4cc8fbd6903b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:23.053656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 838/1679] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:22 2022] PUT /identity/v3/projects/fea5c806776b42ce9e2d89bc2a8cd7cd/users/5579d3ec81f34cf99c6b4455962b7548/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:23.055799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefaccd-cba9-45e3-b18b-b4facfcd6a0e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:23.064473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f2ad6-eb48-4efc-856a-4cc8fbd6903b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:23.074741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefaccd-cba9-45e3-b18b-b4facfcd6a0e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:23.198898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f2ad6-eb48-4efc-856a-4cc8fbd6903b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:23.207855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073c5e3-ede4-42a4-8635-b0f4d8c2d2ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:23.208502 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073c5e3-ede4-42a4-8635-b0f4d8c2d2ac service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:23.208788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073c5e3-ede4-42a4-8635-b0f4d8c2d2ac service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:23.209095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073c5e3-ede4-42a4-8635-b0f4d8c2d2ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:23.218523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1073c5e3-ede4-42a4-8635-b0f4d8c2d2ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:23.294757 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:23.321128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa42a1-9819-4b2f-bfe9-1da2fd4ef4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:23.329779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa42a1-9819-4b2f-bfe9-1da2fd4ef4cf admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:23.332452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa42a1-9819-4b2f-bfe9-1da2fd4ef4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:23.332986 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa42a1-9819-4b2f-bfe9-1da2fd4ef4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:23.334293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa42a1-9819-4b2f-bfe9-1da2fd4ef4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:23.346490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa42a1-9819-4b2f-bfe9-1da2fd4ef4cf admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:23.367704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073c5e3-ede4-42a4-8635-b0f4d8c2d2ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:23.371208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073c5e3-ede4-42a4-8635-b0f4d8c2d2ac service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:23.396893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 842/1680] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:23.401735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa42a1-9819-4b2f-bfe9-1da2fd4ef4cf admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:23.410025 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 839/1681] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:23 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:23.444416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa42a1-9819-4b2f-bfe9-1da2fd4ef4cf admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:23.461620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65b660-0e8d-41d9-9183-dd6fdf9e9124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:23.463490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65b660-0e8d-41d9-9183-dd6fdf9e9124 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:23.463864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65b660-0e8d-41d9-9183-dd6fdf9e9124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:23.464818 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65b660-0e8d-41d9-9183-dd6fdf9e9124 admin admin] PATH_INFO: `/v3/projects/fea5c806776b42ce9e2d89bc2a8cd7cd/users/5579d3ec81f34cf99c6b4455962b7548/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:23.472204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65b660-0e8d-41d9-9183-dd6fdf9e9124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea5c806776b42ce9e2d89bc2a8cd7cd, user_id=5579d3ec81f34cf99c6b4455962b7548, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:23.475122 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65b660-0e8d-41d9-9183-dd6fdf9e9124 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:23.503918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 843/1682] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:23 2022] PUT /identity/v3/projects/fea5c806776b42ce9e2d89bc2a8cd7cd/users/5579d3ec81f34cf99c6b4455962b7548/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:23.515938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8504a5-cefc-4ba6-be51-39cfd6738915 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:23.516388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8504a5-cefc-4ba6-be51-39cfd6738915 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:23.516811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8504a5-cefc-4ba6-be51-39cfd6738915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:23.592189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5d8504a5-cefc-4ba6-be51-39cfd6738915 None None] MFA Rules not processed for user `5579d3ec81f34cf99c6b4455962b7548`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:23.595047 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5d8504a5-cefc-4ba6-be51-39cfd6738915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:23.809947 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 840/1683] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:23.822716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65b660-0e8d-41d9-9183-dd6fdf9e9124 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:23.968637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65b660-0e8d-41d9-9183-dd6fdf9e9124 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:23.973243 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a2a08-9775-4617-8d5a-33e19b928e26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:23.973961 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a2a08-9775-4617-8d5a-33e19b928e26 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:23.974240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a2a08-9775-4617-8d5a-33e19b928e26 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:23.974511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a2a08-9775-4617-8d5a-33e19b928e26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:24.014920 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:24.055986 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a2a08-9775-4617-8d5a-33e19b928e26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:24.058024 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a2a08-9775-4617-8d5a-33e19b928e26 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:24.073035 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 844/1684] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:24.477336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8504a5-cefc-4ba6-be51-39cfd6738915 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:24.479951 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5d8504a5-cefc-4ba6-be51-39cfd6738915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:24.627787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8504a5-cefc-4ba6-be51-39cfd6738915 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:24.642363 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc60080-fa00-40b6-93f5-dc582847ea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:24.643192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc60080-fa00-40b6-93f5-dc582847ea14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:24.643569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc60080-fa00-40b6-93f5-dc582847ea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:24.643959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc60080-fa00-40b6-93f5-dc582847ea14 admin admin] PATH_INFO: `/v3/projects/ef23f59308744aca934e1bdee1638f74` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:24.645439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc60080-fa00-40b6-93f5-dc582847ea14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef23f59308744aca934e1bdee1638f74)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:24.647538 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc60080-fa00-40b6-93f5-dc582847ea14 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:24.754285 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6cc60080-fa00-40b6-93f5-dc582847ea14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef23f59308744aca934e1bdee1638f74', 'request_id': 'req-6cc60080-fa00-40b6-93f5-dc582847ea14'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:24.767909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6cc60080-fa00-40b6-93f5-dc582847ea14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef23f59308744aca934e1bdee1638f74', 'request_id': 'req-6cc60080-fa00-40b6-93f5-dc582847ea14'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:24.784416 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6cc60080-fa00-40b6-93f5-dc582847ea14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef23f59308744aca934e1bdee1638f74', 'request_id': 'req-6cc60080-fa00-40b6-93f5-dc582847ea14'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:24.788515 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:24.808589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6cc60080-fa00-40b6-93f5-dc582847ea14 admin admin] The token cache is being invalidate because project ef23f59308744aca934e1bdee1638f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:45:24.808891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6cc60080-fa00-40b6-93f5-dc582847ea14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:24.812251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6cc60080-fa00-40b6-93f5-dc582847ea14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:24.815831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 841/1685] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:45:24 2022] DELETE /identity/v3/projects/ef23f59308744aca934e1bdee1638f74 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:24.820988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c2058-a073-4b17-9e39-211bf75514a8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:24.821569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c2058-a073-4b17-9e39-211bf75514a8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:24.821991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c2058-a073-4b17-9e39-211bf75514a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:24.865326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f45c2058-a073-4b17-9e39-211bf75514a8 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:24.868785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f45c2058-a073-4b17-9e39-211bf75514a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:24.999359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80844d0c-190c-44fe-83fd-5f23e9d0e182 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:24.999965 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80844d0c-190c-44fe-83fd-5f23e9d0e182 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:25.000395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80844d0c-190c-44fe-83fd-5f23e9d0e182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:25.014733 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 845/1686] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:25.015721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee75a3-e0e5-4c0a-ac41-699cf2ae55b0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:25.016183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee75a3-e0e5-4c0a-ac41-699cf2ae55b0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:25.016565 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee75a3-e0e5-4c0a-ac41-699cf2ae55b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:25.046518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3fee75a3-e0e5-4c0a-ac41-699cf2ae55b0 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:25.048016 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3fee75a3-e0e5-4c0a-ac41-699cf2ae55b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:25.064201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 846/1687] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:25.065431 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee75a3-e0e5-4c0a-ac41-699cf2ae55b0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:25.078542 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee75a3-e0e5-4c0a-ac41-699cf2ae55b0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:25.084216 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73323e3d-385f-4575-9aec-b6a0ecb5aa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:25.085046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73323e3d-385f-4575-9aec-b6a0ecb5aa19 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:25.085489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73323e3d-385f-4575-9aec-b6a0ecb5aa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:25.085864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73323e3d-385f-4575-9aec-b6a0ecb5aa19 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:25.087193 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73323e3d-385f-4575-9aec-b6a0ecb5aa19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:25.087886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73323e3d-385f-4575-9aec-b6a0ecb5aa19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:25.089777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73323e3d-385f-4575-9aec-b6a0ecb5aa19 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:25.104138 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-80844d0c-190c-44fe-83fd-5f23e9d0e182 None None] MFA Rules not processed for user `69246ce0e0544e72a928af58b65930bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:25.105799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-80844d0c-190c-44fe-83fd-5f23e9d0e182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:25.114605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 847/1688] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:25.123370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73323e3d-385f-4575-9aec-b6a0ecb5aa19 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:25.138688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73323e3d-385f-4575-9aec-b6a0ecb5aa19 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:25.144559 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8addb-3773-4354-bc5d-1a1c1970298f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:25.149085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8addb-3773-4354-bc5d-1a1c1970298f admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:25.150063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8addb-3773-4354-bc5d-1a1c1970298f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:25.150063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8addb-3773-4354-bc5d-1a1c1970298f admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:25.156134 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8addb-3773-4354-bc5d-1a1c1970298f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:25.158697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8addb-3773-4354-bc5d-1a1c1970298f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:25.224158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 848/1689] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:25 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:25.225839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8addb-3773-4354-bc5d-1a1c1970298f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:25.429339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 842/1690] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:25.436037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8addb-3773-4354-bc5d-1a1c1970298f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:25.440970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80844d0c-190c-44fe-83fd-5f23e9d0e182 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:25.442536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a5b1f-66a3-46c9-8f29-50bec328a596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:25.443290 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-80844d0c-190c-44fe-83fd-5f23e9d0e182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:25.443610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a5b1f-66a3-46c9-8f29-50bec328a596 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:25.444284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a5b1f-66a3-46c9-8f29-50bec328a596 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:25.444710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a5b1f-66a3-46c9-8f29-50bec328a596 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:25.446238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a5b1f-66a3-46c9-8f29-50bec328a596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:25.450698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a5b1f-66a3-46c9-8f29-50bec328a596 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:25.489619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 849/1691] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:25 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:25.494472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a5b1f-66a3-46c9-8f29-50bec328a596 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:25.509963 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a5b1f-66a3-46c9-8f29-50bec328a596 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:25.518152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0769878-280d-4b98-ac38-6b8b0db0f483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:25.519908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0769878-280d-4b98-ac38-6b8b0db0f483 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:25.520365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0769878-280d-4b98-ac38-6b8b0db0f483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:25.520800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0769878-280d-4b98-ac38-6b8b0db0f483 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:25.522101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0769878-280d-4b98-ac38-6b8b0db0f483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:25.524720 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0769878-280d-4b98-ac38-6b8b0db0f483 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:25.539654 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 850/1692] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:25.544569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0769878-280d-4b98-ac38-6b8b0db0f483 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:25.567741 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80844d0c-190c-44fe-83fd-5f23e9d0e182 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:25.569684 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0769878-280d-4b98-ac38-6b8b0db0f483 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:25.587098 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac7943-ccdb-4712-bedd-45fba6a38b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:25.589792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac7943-ccdb-4712-bedd-45fba6a38b85 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:25.592969 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac7943-ccdb-4712-bedd-45fba6a38b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:25.593582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac7943-ccdb-4712-bedd-45fba6a38b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:25.595889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac7943-ccdb-4712-bedd-45fba6a38b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:25.601484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac7943-ccdb-4712-bedd-45fba6a38b85 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:25.613800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:25.666919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 851/1693] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:25.667995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac7943-ccdb-4712-bedd-45fba6a38b85 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:25.694427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac7943-ccdb-4712-bedd-45fba6a38b85 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:25.709881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab884bfb-347e-4d7c-b40d-e3bf221cf0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:25.711745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab884bfb-347e-4d7c-b40d-e3bf221cf0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:25.711745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab884bfb-347e-4d7c-b40d-e3bf221cf0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:25.712520 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab884bfb-347e-4d7c-b40d-e3bf221cf0e3 admin admin] PATH_INFO: `/v3/projects/6ee02c2b92384d5795a4881bb9b0ddb9/users/76bb632f2f874ccfaa2f19c6f6cb8512/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:25.779840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab884bfb-347e-4d7c-b40d-e3bf221cf0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee02c2b92384d5795a4881bb9b0ddb9, user_id=76bb632f2f874ccfaa2f19c6f6cb8512, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:25.787870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab884bfb-347e-4d7c-b40d-e3bf221cf0e3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:25.808736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cf6a2-a990-4d20-b7af-dde153f9947c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:25.809625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cf6a2-a990-4d20-b7af-dde153f9947c service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:25.809955 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cf6a2-a990-4d20-b7af-dde153f9947c service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:25.810227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cf6a2-a990-4d20-b7af-dde153f9947c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:25.827693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 852/1694] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:25 2022] PUT /identity/v3/projects/6ee02c2b92384d5795a4881bb9b0ddb9/users/76bb632f2f874ccfaa2f19c6f6cb8512/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:25.830058 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:25.844111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f2053-465e-495e-8f18-aa428d669fe8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:25.844111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f2053-465e-495e-8f18-aa428d669fe8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:25.844111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f2053-465e-495e-8f18-aa428d669fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:25.913011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-eb5f2053-465e-495e-8f18-aa428d669fe8 None None] MFA Rules not processed for user `76bb632f2f874ccfaa2f19c6f6cb8512`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:25.916749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eb5f2053-465e-495e-8f18-aa428d669fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:25.952274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cf6a2-a990-4d20-b7af-dde153f9947c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:25.955889 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cf6a2-a990-4d20-b7af-dde153f9947c service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:25.987767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 843/1695] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:45:26.144890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 853/1696] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:26.156428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cf6a2-a990-4d20-b7af-dde153f9947c service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:26.158527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ba5cf6a2-a990-4d20-b7af-dde153f9947c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:26.199198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cf6a2-a990-4d20-b7af-dde153f9947c service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:26.362075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dc3e6-2db2-400d-af85-a7792e31313d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:26.362831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dc3e6-2db2-400d-af85-a7792e31313d service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:26.363217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dc3e6-2db2-400d-af85-a7792e31313d service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:26.364691 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dc3e6-2db2-400d-af85-a7792e31313d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:26.395837 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71dc3e6-2db2-400d-af85-a7792e31313d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:26.397745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71dc3e6-2db2-400d-af85-a7792e31313d service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:26.418617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 844/1697] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:26.527906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a1717-a66a-49c4-b368-f5e0dc7e9e6e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:26.528198 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a1717-a66a-49c4-b368-f5e0dc7e9e6e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:26.528482 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a1717-a66a-49c4-b368-f5e0dc7e9e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:26.597491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b25a1717-a66a-49c4-b368-f5e0dc7e9e6e None None] MFA Rules not processed for user `8de4ea727e9543f285c86e649d36c760`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:26.598756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b25a1717-a66a-49c4-b368-f5e0dc7e9e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:26.790535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dc3e6-2db2-400d-af85-a7792e31313d service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:26.813183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 854/1698] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:26.829325 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a1717-a66a-49c4-b368-f5e0dc7e9e6e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:26.851851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a1717-a66a-49c4-b368-f5e0dc7e9e6e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:26.865183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64960689-7ce7-4314-ae23-8bb765d65989 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:26.865861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64960689-7ce7-4314-ae23-8bb765d65989 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:26.866147 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64960689-7ce7-4314-ae23-8bb765d65989 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:26.866420 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64960689-7ce7-4314-ae23-8bb765d65989 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:26.898188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64960689-7ce7-4314-ae23-8bb765d65989 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:26.902423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64960689-7ce7-4314-ae23-8bb765d65989 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:26.937232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 855/1699] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:45:26.954549 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dc3e6-2db2-400d-af85-a7792e31313d service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:26.963899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab5186-f4bc-416e-a48e-8f47fa890376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:26.964654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab5186-f4bc-416e-a48e-8f47fa890376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:26.964957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab5186-f4bc-416e-a48e-8f47fa890376 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:26.965213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab5186-f4bc-416e-a48e-8f47fa890376 admin admin] PATH_INFO: `/v3/users/76bb632f2f874ccfaa2f19c6f6cb8512` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:26.969101 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab5186-f4bc-416e-a48e-8f47fa890376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76bb632f2f874ccfaa2f19c6f6cb8512)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:26.975341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab5186-f4bc-416e-a48e-8f47fa890376 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:27.127963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:27.141493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-83ab5186-f4bc-416e-a48e-8f47fa890376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76bb632f2f874ccfaa2f19c6f6cb8512'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:27.168782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-83ab5186-f4bc-416e-a48e-8f47fa890376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76bb632f2f874ccfaa2f19c6f6cb8512'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:27.172990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-83ab5186-f4bc-416e-a48e-8f47fa890376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76bb632f2f874ccfaa2f19c6f6cb8512'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:27.240067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-83ab5186-f4bc-416e-a48e-8f47fa890376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76bb632f2f874ccfaa2f19c6f6cb8512'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:27.241026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64960689-7ce7-4314-ae23-8bb765d65989 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:27.242412 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-83ab5186-f4bc-416e-a48e-8f47fa890376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76bb632f2f874ccfaa2f19c6f6cb8512'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:27.243596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-64960689-7ce7-4314-ae23-8bb765d65989 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:27.287373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 845/1700] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:45:26 2022] DELETE /identity/v3/users/76bb632f2f874ccfaa2f19c6f6cb8512 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:45:27.292033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1993270-5fd5-40b6-a013-2dafda0dfe51 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:27.292658 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1993270-5fd5-40b6-a013-2dafda0dfe51 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:27.292968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1993270-5fd5-40b6-a013-2dafda0dfe51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:27.394413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-c1993270-5fd5-40b6-a013-2dafda0dfe51 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:27.400051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c1993270-5fd5-40b6-a013-2dafda0dfe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:27.453975 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:27.510891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64960689-7ce7-4314-ae23-8bb765d65989 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:27.640612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 846/1701] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:27.713306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1993270-5fd5-40b6-a013-2dafda0dfe51 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:27.714116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c1993270-5fd5-40b6-a013-2dafda0dfe51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:27.718498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47529b1-42a3-4442-bdb1-e42f66246320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:27.719159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47529b1-42a3-4442-bdb1-e42f66246320 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:27.719444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47529b1-42a3-4442-bdb1-e42f66246320 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:27.719721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47529b1-42a3-4442-bdb1-e42f66246320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:27.724578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b47529b1-42a3-4442-bdb1-e42f66246320 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:27.875637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1993270-5fd5-40b6-a013-2dafda0dfe51 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:27.886609 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4630d-1372-465a-a558-d20ea8854fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:27.890294 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4630d-1372-465a-a558-d20ea8854fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:27.890294 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4630d-1372-465a-a558-d20ea8854fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:27.890294 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4630d-1372-465a-a558-d20ea8854fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:27.926050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4630d-1372-465a-a558-d20ea8854fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:27.927614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4630d-1372-465a-a558-d20ea8854fc5 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:27.962752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47529b1-42a3-4442-bdb1-e42f66246320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:27.964236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47529b1-42a3-4442-bdb1-e42f66246320 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:27.968992 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 847/1702] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:27.979432 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 856/1703] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:30.690692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4630d-1372-465a-a558-d20ea8854fc5 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:30.692392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9fe4630d-1372-465a-a558-d20ea8854fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:30.734569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4630d-1372-465a-a558-d20ea8854fc5 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:30.747146 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac83bc-36a4-49b6-92f2-621a9e313185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:30.749812 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac83bc-36a4-49b6-92f2-621a9e313185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:30.750416 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac83bc-36a4-49b6-92f2-621a9e313185 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:30.751308 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac83bc-36a4-49b6-92f2-621a9e313185 admin admin] PATH_INFO: `/v3/projects/6ee02c2b92384d5795a4881bb9b0ddb9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:30.753308 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac83bc-36a4-49b6-92f2-621a9e313185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee02c2b92384d5795a4881bb9b0ddb9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:30.755648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac83bc-36a4-49b6-92f2-621a9e313185 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:30.770038 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d543650-9e14-40d3-85e5-990f59360679 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:30.771340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d543650-9e14-40d3-85e5-990f59360679 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:30.773830 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d543650-9e14-40d3-85e5-990f59360679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:30.907809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cbac83bc-36a4-49b6-92f2-621a9e313185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee02c2b92384d5795a4881bb9b0ddb9', 'request_id': 'req-cbac83bc-36a4-49b6-92f2-621a9e313185'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:30.915359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6d543650-9e14-40d3-85e5-990f59360679 None None] MFA Rules not processed for user `e5ad4dddff55436095a7d6a43317426f`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:30.924940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6d543650-9e14-40d3-85e5-990f59360679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:30.925900 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cbac83bc-36a4-49b6-92f2-621a9e313185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee02c2b92384d5795a4881bb9b0ddb9', 'request_id': 'req-cbac83bc-36a4-49b6-92f2-621a9e313185'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:30.941744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:30.958805 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cbac83bc-36a4-49b6-92f2-621a9e313185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee02c2b92384d5795a4881bb9b0ddb9', 'request_id': 'req-cbac83bc-36a4-49b6-92f2-621a9e313185'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:30.995918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cbac83bc-36a4-49b6-92f2-621a9e313185 admin admin] The token cache is being invalidate because project 6ee02c2b92384d5795a4881bb9b0ddb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:45:30.996215 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cbac83bc-36a4-49b6-92f2-621a9e313185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:30.998292 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cbac83bc-36a4-49b6-92f2-621a9e313185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:31.000971 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 848/1704] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:45:30 2022] DELETE /identity/v3/projects/6ee02c2b92384d5795a4881bb9b0ddb9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:31.011489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041a2ec-5ccd-44b9-9994-4de0132f6f1e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:31.011758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041a2ec-5ccd-44b9-9994-4de0132f6f1e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:31.012053 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041a2ec-5ccd-44b9-9994-4de0132f6f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:31.068773 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6041a2ec-5ccd-44b9-9994-4de0132f6f1e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:31.071740 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6041a2ec-5ccd-44b9-9994-4de0132f6f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:31.115716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 857/1705] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:31.127051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ddaf-0754-4585-8338-6c13f2b715a1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:31.127360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ddaf-0754-4585-8338-6c13f2b715a1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:31.127603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ddaf-0754-4585-8338-6c13f2b715a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:31.176673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a9f9ddaf-0754-4585-8338-6c13f2b715a1 None None] MFA Rules not processed for user `e5ad4dddff55436095a7d6a43317426f`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:31.177992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a9f9ddaf-0754-4585-8338-6c13f2b715a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:31.210971 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 849/1706] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:31.224479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 858/1707] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:31.236313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ddaf-0754-4585-8338-6c13f2b715a1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:31.238397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a9f9ddaf-0754-4585-8338-6c13f2b715a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:31.246871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2127bd3-abca-401e-867c-37b4e3aec04e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:31.247267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2127bd3-abca-401e-867c-37b4e3aec04e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:31.247914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2127bd3-abca-401e-867c-37b4e3aec04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:31.341730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d2127bd3-abca-401e-867c-37b4e3aec04e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:31.342985 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d2127bd3-abca-401e-867c-37b4e3aec04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:31.356133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 850/1708] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:31.360556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2127bd3-abca-401e-867c-37b4e3aec04e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:31.375378 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:31.384030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2127bd3-abca-401e-867c-37b4e3aec04e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:31.402544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66cda0-8230-4e3a-8285-97d44433e0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:31.405737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66cda0-8230-4e3a-8285-97d44433e0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:31.406025 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66cda0-8230-4e3a-8285-97d44433e0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:31.406304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66cda0-8230-4e3a-8285-97d44433e0c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:31.407049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66cda0-8230-4e3a-8285-97d44433e0c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:31.407359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66cda0-8230-4e3a-8285-97d44433e0c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:31.411636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66cda0-8230-4e3a-8285-97d44433e0c2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:31.456220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 851/1709] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:31.461343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66cda0-8230-4e3a-8285-97d44433e0c2 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:31.491682 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66cda0-8230-4e3a-8285-97d44433e0c2 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:31.510851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537446e7-fa84-4c21-ab85-1a97a1b21b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:31.515192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537446e7-fa84-4c21-ab85-1a97a1b21b1b admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:31.515481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537446e7-fa84-4c21-ab85-1a97a1b21b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:31.515762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537446e7-fa84-4c21-ab85-1a97a1b21b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:31.516478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537446e7-fa84-4c21-ab85-1a97a1b21b1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:31.523197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ddaf-0754-4585-8338-6c13f2b715a1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:31.530346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537446e7-fa84-4c21-ab85-1a97a1b21b1b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:31.546297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8019e-b76d-411f-82d8-b233f5b9f6eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:31.546992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8019e-b76d-411f-82d8-b233f5b9f6eb service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:31.547279 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8019e-b76d-411f-82d8-b233f5b9f6eb service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:31.547552 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8019e-b76d-411f-82d8-b233f5b9f6eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:31.624660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8019e-b76d-411f-82d8-b233f5b9f6eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:31.636506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8019e-b76d-411f-82d8-b233f5b9f6eb service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:31.704576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 852/1710] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:31 2022] POST /identity/v3/projects => generated 405 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:31.709066 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537446e7-fa84-4c21-ab85-1a97a1b21b1b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:31.721480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 859/1711] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:31.933487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537446e7-fa84-4c21-ab85-1a97a1b21b1b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:31.964324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc60d0f-ca11-4916-a0c8-e8ec744e2544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:31.966064 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc60d0f-ca11-4916-a0c8-e8ec744e2544 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:31.966529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc60d0f-ca11-4916-a0c8-e8ec744e2544 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:31.966959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc60d0f-ca11-4916-a0c8-e8ec744e2544 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:31.970728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc60d0f-ca11-4916-a0c8-e8ec744e2544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:31.973234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc60d0f-ca11-4916-a0c8-e8ec744e2544 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:32.086409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 853/1712] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:31 2022] POST /identity/v3/users => generated 303 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:32.088123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8019e-b76d-411f-82d8-b233f5b9f6eb service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:32.101515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8019e-b76d-411f-82d8-b233f5b9f6eb service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:32.115896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e739bee-d915-4d20-9d0e-ead29749711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:32.117003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e739bee-d915-4d20-9d0e-ead29749711e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:32.117853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e739bee-d915-4d20-9d0e-ead29749711e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:32.118323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e739bee-d915-4d20-9d0e-ead29749711e admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:32.121037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e739bee-d915-4d20-9d0e-ead29749711e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:32.123178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e739bee-d915-4d20-9d0e-ead29749711e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:32.139628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 860/1713] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:32.144026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc60d0f-ca11-4916-a0c8-e8ec744e2544 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:32.162024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc60d0f-ca11-4916-a0c8-e8ec744e2544 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:32.175157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d6032-aa78-46d6-a284-9b83c52532a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:32.176120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d6032-aa78-46d6-a284-9b83c52532a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:32.176542 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d6032-aa78-46d6-a284-9b83c52532a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:32.176942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d6032-aa78-46d6-a284-9b83c52532a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:32.177902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d6032-aa78-46d6-a284-9b83c52532a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:32.188540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d6032-aa78-46d6-a284-9b83c52532a8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:32.230205 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 854/1714] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:32.234786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e739bee-d915-4d20-9d0e-ead29749711e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:32.271119 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e739bee-d915-4d20-9d0e-ead29749711e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:32.282119 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059efcb9-0200-419b-83ab-94d8d6d29369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:32.283926 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059efcb9-0200-419b-83ab-94d8d6d29369 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:32.284441 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059efcb9-0200-419b-83ab-94d8d6d29369 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:32.286775 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059efcb9-0200-419b-83ab-94d8d6d29369 admin admin] PATH_INFO: `/v3/projects/9a563c4dd09d4c958ebbd87b64bc61ff/users/e7c2dedf3f4742d899dac1456c847dca/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:32.336302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059efcb9-0200-419b-83ab-94d8d6d29369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a563c4dd09d4c958ebbd87b64bc61ff, user_id=e7c2dedf3f4742d899dac1456c847dca, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:32.346399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059efcb9-0200-419b-83ab-94d8d6d29369 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:32.379542 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 861/1715] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:32 2022] PUT /identity/v3/projects/9a563c4dd09d4c958ebbd87b64bc61ff/users/e7c2dedf3f4742d899dac1456c847dca/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:32.387259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f3f19-ab58-4261-bc27-466859675230 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:32.387804 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f3f19-ab58-4261-bc27-466859675230 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:32.388290 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f3f19-ab58-4261-bc27-466859675230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:32.419840 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-417f3f19-ab58-4261-bc27-466859675230 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:32.425991 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-417f3f19-ab58-4261-bc27-466859675230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:32.468105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:32.473741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a665d-2bd3-4b10-9a07-0eae86209dbc None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:32.473916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a665d-2bd3-4b10-9a07-0eae86209dbc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:32.474345 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a665d-2bd3-4b10-9a07-0eae86209dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:32.505365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1c7a665d-2bd3-4b10-9a07-0eae86209dbc None None] MFA Rules not processed for user `69246ce0e0544e72a928af58b65930bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:32.514182 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1c7a665d-2bd3-4b10-9a07-0eae86209dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:32.558693 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 855/1716] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:45:32.628430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f3f19-ab58-4261-bc27-466859675230 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:32.630497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-417f3f19-ab58-4261-bc27-466859675230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:32.653149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 862/1717] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:32.870289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f3f19-ab58-4261-bc27-466859675230 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:32.886585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f857e-239f-4b3a-9e50-f2ed5e09f5f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:32.888416 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f857e-239f-4b3a-9e50-f2ed5e09f5f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:32.889957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f857e-239f-4b3a-9e50-f2ed5e09f5f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:32.890424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f857e-239f-4b3a-9e50-f2ed5e09f5f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:32.927377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f857e-239f-4b3a-9e50-f2ed5e09f5f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:32.935282 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f857e-239f-4b3a-9e50-f2ed5e09f5f2 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:33.009148 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 856/1718] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:33.054069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1065ae8-d502-4728-a41b-b24ed0e1fc1a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:33.054358 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1065ae8-d502-4728-a41b-b24ed0e1fc1a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:33.054820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1065ae8-d502-4728-a41b-b24ed0e1fc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:33.157529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b1065ae8-d502-4728-a41b-b24ed0e1fc1a None None] MFA Rules not processed for user `adea8e6fd0cb47f394e811865db51ade`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:33.158841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b1065ae8-d502-4728-a41b-b24ed0e1fc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:33.441382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 863/1719] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:33.588867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942517f-6d8e-4644-84d3-842236f20345 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:33.589155 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942517f-6d8e-4644-84d3-842236f20345 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:33.590126 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942517f-6d8e-4644-84d3-842236f20345 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:33.592170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 857/1720] 10.222.0.39 () {54 vars in 912 bytes} [Tue Jul 26 02:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:45:33.599568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9b3b9-dd3f-452a-9a92-c1cd0d54c35d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:33.600141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9b3b9-dd3f-452a-9a92-c1cd0d54c35d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:33.600808 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9b3b9-dd3f-452a-9a92-c1cd0d54c35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:33.651230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:33.681745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0ef9b3b9-dd3f-452a-9a92-c1cd0d54c35d None None] MFA Rules not processed for user `fe228871a7fd4a9bb15645955ff365c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:33.683087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0ef9b3b9-dd3f-452a-9a92-c1cd0d54c35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:33.701759 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 864/1721] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:45:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:33.737046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942517f-6d8e-4644-84d3-842236f20345 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:33.739379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9942517f-6d8e-4644-84d3-842236f20345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:33.769267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942517f-6d8e-4644-84d3-842236f20345 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:33.780241 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b0a21-503b-4779-8826-67ca492e0997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:33.782092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b0a21-503b-4779-8826-67ca492e0997 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:33.782564 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b0a21-503b-4779-8826-67ca492e0997 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:33.798561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150cea-a6cf-463c-9da6-5c94ea8a6435 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:33.798939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150cea-a6cf-463c-9da6-5c94ea8a6435 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:33.799526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f150cea-a6cf-463c-9da6-5c94ea8a6435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:33.804361 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b0a21-503b-4779-8826-67ca492e0997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:33.847657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b0a21-503b-4779-8826-67ca492e0997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:33.857234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b0a21-503b-4779-8826-67ca492e0997 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:33.867177 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8f150cea-a6cf-463c-9da6-5c94ea8a6435 None None] MFA Rules not processed for user `8de4ea727e9543f285c86e649d36c760`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:33.868449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8f150cea-a6cf-463c-9da6-5c94ea8a6435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:33.877829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 858/1722] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:33.889618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d3a4f-fd48-448e-b05a-65233bcceb4c None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:33.891032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d3a4f-fd48-448e-b05a-65233bcceb4c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:33.891572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d3a4f-fd48-448e-b05a-65233bcceb4c None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:33.896270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 859/1723] 10.222.0.39 () {54 vars in 912 bytes} [Tue Jul 26 02:45:33 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:45:33.918495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd8dd-d5d1-4cc0-b1b9-e0de19f7673d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:33.919557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd8dd-d5d1-4cc0-b1b9-e0de19f7673d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:33.921002 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bd8dd-d5d1-4cc0-b1b9-e0de19f7673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:34.017460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-232bd8dd-d5d1-4cc0-b1b9-e0de19f7673d None None] MFA Rules not processed for user `fe228871a7fd4a9bb15645955ff365c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:34.020351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-232bd8dd-d5d1-4cc0-b1b9-e0de19f7673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:34.030456 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 860/1724] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:45:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:34.036322 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 865/1725] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:34.093160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bd8dd-d5d1-4cc0-b1b9-e0de19f7673d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:34.107525 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bd8dd-d5d1-4cc0-b1b9-e0de19f7673d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:34.118565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3234d-1b91-499b-aba9-f713115c28aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:34.119319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3234d-1b91-499b-aba9-f713115c28aa service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:34.121561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3234d-1b91-499b-aba9-f713115c28aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:34.121561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3234d-1b91-499b-aba9-f713115c28aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:34.149200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3234d-1b91-499b-aba9-f713115c28aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:34.150854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3234d-1b91-499b-aba9-f713115c28aa service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:34.183025 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 861/1726] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:34.205397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167741b1-8b1b-4619-9051-71a0e19417c7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:34.206330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167741b1-8b1b-4619-9051-71a0e19417c7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:34.206807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167741b1-8b1b-4619-9051-71a0e19417c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:34.296436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-167741b1-8b1b-4619-9051-71a0e19417c7 None None] MFA Rules not processed for user `6b6e9910ded44a2280a74bfefededc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:34.298009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-167741b1-8b1b-4619-9051-71a0e19417c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:34.436920 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 866/1727] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:34.449049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1e6c-a357-47ea-8c9e-d4d1a8948eb6 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:34.449700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1e6c-a357-47ea-8c9e-d4d1a8948eb6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:34.450159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1e6c-a357-47ea-8c9e-d4d1a8948eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:34.487255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ae4c1e6c-a357-47ea-8c9e-d4d1a8948eb6 None None] MFA Rules not processed for user `6b6e9910ded44a2280a74bfefededc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:34.489321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ae4c1e6c-a357-47ea-8c9e-d4d1a8948eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:34.517259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 862/1728] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:35.077781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e867ef-0eab-4414-a615-6dfd8902acb4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:35.078084 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e867ef-0eab-4414-a615-6dfd8902acb4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:35.078397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e867ef-0eab-4414-a615-6dfd8902acb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:35.220523 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a2e867ef-0eab-4414-a615-6dfd8902acb4 None None] MFA Rules not processed for user `e7c2dedf3f4742d899dac1456c847dca`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:35.225388 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a2e867ef-0eab-4414-a615-6dfd8902acb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:35.415074 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 867/1729] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:35.418854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c1e6c-a357-47ea-8c9e-d4d1a8948eb6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:35.447160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c1e6c-a357-47ea-8c9e-d4d1a8948eb6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:35.470399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2a50f-06b5-4b73-a89b-5a5657b39c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:35.471343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2a50f-06b5-4b73-a89b-5a5657b39c35 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:35.471770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2a50f-06b5-4b73-a89b-5a5657b39c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:35.475044 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2a50f-06b5-4b73-a89b-5a5657b39c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:35.476263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2a50f-06b5-4b73-a89b-5a5657b39c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:35.486843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2a50f-06b5-4b73-a89b-5a5657b39c35 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:35.567863 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e867ef-0eab-4414-a615-6dfd8902acb4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:35.572480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a2e867ef-0eab-4414-a615-6dfd8902acb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:35.614200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 863/1730] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:35 2022] POST /identity/v3/projects => generated 405 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:35.620067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2a50f-06b5-4b73-a89b-5a5657b39c35 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:35.682024 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:35.862003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e867ef-0eab-4414-a615-6dfd8902acb4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:35.955128 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2a50f-06b5-4b73-a89b-5a5657b39c35 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:35.970097 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35985a84-4631-44d7-84e7-4d3f09ab173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:35.971052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35985a84-4631-44d7-84e7-4d3f09ab173c admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:35.971478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35985a84-4631-44d7-84e7-4d3f09ab173c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:35.971898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35985a84-4631-44d7-84e7-4d3f09ab173c admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:35.972966 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35985a84-4631-44d7-84e7-4d3f09ab173c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:35.977899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35985a84-4631-44d7-84e7-4d3f09ab173c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:36.015360 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:36.021069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb640e4-680e-4aee-96fc-610ea73d859c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:36.022098 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb640e4-680e-4aee-96fc-610ea73d859c service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:36.022475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb640e4-680e-4aee-96fc-610ea73d859c service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:36.023262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb640e4-680e-4aee-96fc-610ea73d859c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:36.041626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 864/1731] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:35 2022] POST /identity/v3/users => generated 309 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:36.043706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e16ed-da4b-4f7b-9c1d-f1743bc0335b None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:36.046468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e16ed-da4b-4f7b-9c1d-f1743bc0335b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:36.046884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e16ed-da4b-4f7b-9c1d-f1743bc0335b None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:36.049239 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 865/1732] 10.222.0.39 () {54 vars in 961 bytes} [Tue Jul 26 02:45:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:45:36.051956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e16ed-da4b-4f7b-9c1d-f1743bc0335b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:36.059924 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1d0e16ed-da4b-4f7b-9c1d-f1743bc0335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:36.179002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb640e4-680e-4aee-96fc-610ea73d859c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:36.180799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb640e4-680e-4aee-96fc-610ea73d859c service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:36.205397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 868/1733] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:36.206430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb640e4-680e-4aee-96fc-610ea73d859c service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:36.220092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e16ed-da4b-4f7b-9c1d-f1743bc0335b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:36.222754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb640e4-680e-4aee-96fc-610ea73d859c service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:36.232700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9843bb-f7c1-4159-89ab-892b3635037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:36.233428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bc592-7a6b-4c78-9fff-1307728b379b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629b38364f6a414aa14123c0749ba164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:36.233571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9843bb-f7c1-4159-89ab-892b3635037a admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:36.233790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9843bb-f7c1-4159-89ab-892b3635037a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:36.234085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc592-7a6b-4c78-9fff-1307728b379b service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:36.234376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc592-7a6b-4c78-9fff-1307728b379b service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:36.236529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc592-7a6b-4c78-9fff-1307728b379b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:36.236824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9843bb-f7c1-4159-89ab-892b3635037a admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:36.238265 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9843bb-f7c1-4159-89ab-892b3635037a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:36.241093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9843bb-f7c1-4159-89ab-892b3635037a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:36.243739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-958bc592-7a6b-4c78-9fff-1307728b379b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:36.266538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 869/1734] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:36.268484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb80e9-d156-4d46-84a7-ca0e94dc7d7f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:36.269009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb80e9-d156-4d46-84a7-ca0e94dc7d7f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:36.269780 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb80e9-d156-4d46-84a7-ca0e94dc7d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:36.270496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bc592-7a6b-4c78-9fff-1307728b379b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:36.272136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bc592-7a6b-4c78-9fff-1307728b379b service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:36.309706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 866/1735] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:36.311028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bc592-7a6b-4c78-9fff-1307728b379b service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:36.352230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bc592-7a6b-4c78-9fff-1307728b379b service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:36.355996 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-effb80e9-d156-4d46-84a7-ca0e94dc7d7f None None] MFA Rules not processed for user `629b38364f6a414aa14123c0749ba164`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:36.360316 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-effb80e9-d156-4d46-84a7-ca0e94dc7d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:36.369595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b43d41-4ef2-43e7-baaf-789a5fcbce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:36.370297 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b43d41-4ef2-43e7-baaf-789a5fcbce00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:36.370615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b43d41-4ef2-43e7-baaf-789a5fcbce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:36.370963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b43d41-4ef2-43e7-baaf-789a5fcbce00 admin admin] PATH_INFO: `/v3/projects/0b53fa88687d48e998abebbc526643b2/users/f204a6ee6d2e49699ce06c0a9d4a4761/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:36.380742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 870/1736] 10.222.0.39 () {58 vars in 1058 bytes} [Tue Jul 26 02:45:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:36.384669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb80e9-d156-4d46-84a7-ca0e94dc7d7f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:36.428847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b43d41-4ef2-43e7-baaf-789a5fcbce00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b53fa88687d48e998abebbc526643b2, user_id=f204a6ee6d2e49699ce06c0a9d4a4761, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:36.432147 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b43d41-4ef2-43e7-baaf-789a5fcbce00 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:36.442604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb80e9-d156-4d46-84a7-ca0e94dc7d7f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:36.464663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe5f17-be35-4503-8840-10b3798b1d93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:36.465864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe5f17-be35-4503-8840-10b3798b1d93 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:36.466228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe5f17-be35-4503-8840-10b3798b1d93 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:36.466645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe5f17-be35-4503-8840-10b3798b1d93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:36.474352 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 867/1737] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:36 2022] PUT /identity/v3/projects/0b53fa88687d48e998abebbc526643b2/users/f204a6ee6d2e49699ce06c0a9d4a4761/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:36.475199 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b43d41-4ef2-43e7-baaf-789a5fcbce00 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:36.598145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:36.680383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b43d41-4ef2-43e7-baaf-789a5fcbce00 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:36.690175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe5f17-be35-4503-8840-10b3798b1d93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:36.691693 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ce7a6-b63e-4995-99fe-2a5a81531488 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629b38364f6a414aa14123c0749ba164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:36.691994 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe5f17-be35-4503-8840-10b3798b1d93 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:36.692343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ce7a6-b63e-4995-99fe-2a5a81531488 service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:36.692627 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ce7a6-b63e-4995-99fe-2a5a81531488 service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:36.692901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ce7a6-b63e-4995-99fe-2a5a81531488 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:36.722388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ce7a6-b63e-4995-99fe-2a5a81531488 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:36.724024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ce7a6-b63e-4995-99fe-2a5a81531488 service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:36.736862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 871/1738] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:36.739243 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe5f17-be35-4503-8840-10b3798b1d93 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:36.750942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 868/1739] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:36.791814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe5f17-be35-4503-8840-10b3798b1d93 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:37.033724 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2981808-0f13-406d-b8d7-df6d7f9c44f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:37.034695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981808-0f13-406d-b8d7-df6d7f9c44f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:37.035294 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981808-0f13-406d-b8d7-df6d7f9c44f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:37.035778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981808-0f13-406d-b8d7-df6d7f9c44f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:37.036727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2981808-0f13-406d-b8d7-df6d7f9c44f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:37.039200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2981808-0f13-406d-b8d7-df6d7f9c44f8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:37.084786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 872/1740] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:37.089305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ce7a6-b63e-4995-99fe-2a5a81531488 service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:37.104527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ce7a6-b63e-4995-99fe-2a5a81531488 service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:37.112925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2466a-3efa-4b27-a390-7d93cbdd9414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:37.113845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2466a-3efa-4b27-a390-7d93cbdd9414 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:37.114813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2466a-3efa-4b27-a390-7d93cbdd9414 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:37.116964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2466a-3efa-4b27-a390-7d93cbdd9414 admin admin] PATH_INFO: `/v3/projects/0b53fa88687d48e998abebbc526643b2/users/f204a6ee6d2e49699ce06c0a9d4a4761/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:37.137269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2466a-3efa-4b27-a390-7d93cbdd9414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b53fa88687d48e998abebbc526643b2, user_id=f204a6ee6d2e49699ce06c0a9d4a4761, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:37.153945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2466a-3efa-4b27-a390-7d93cbdd9414 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:37.186284 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 869/1741] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:37 2022] PUT /identity/v3/projects/0b53fa88687d48e998abebbc526643b2/users/f204a6ee6d2e49699ce06c0a9d4a4761/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:45:38.032755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1fc5e-64b9-4ea6-89f2-3479e92671aa None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:38.033697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1fc5e-64b9-4ea6-89f2-3479e92671aa None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:38.034116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1fc5e-64b9-4ea6-89f2-3479e92671aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:38.086138 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-afa1fc5e-64b9-4ea6-89f2-3479e92671aa None None] MFA Rules not processed for user `e5ad4dddff55436095a7d6a43317426f`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:38.092047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-afa1fc5e-64b9-4ea6-89f2-3479e92671aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:38.353677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 873/1742] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:41.155935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0d3df-79fc-4089-ad07-8cda1aa699a6 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:41.156542 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0d3df-79fc-4089-ad07-8cda1aa699a6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:41.156639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0d3df-79fc-4089-ad07-8cda1aa699a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:41.225230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-72e0d3df-79fc-4089-ad07-8cda1aa699a6 None None] MFA Rules not processed for user `f204a6ee6d2e49699ce06c0a9d4a4761`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:41.226908 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-72e0d3df-79fc-4089-ad07-8cda1aa699a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:41.295497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:41.466157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 870/1743] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:41 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:41.698761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d98801-16f4-4de4-93ef-c1cf3337e0e3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:41.699287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d98801-16f4-4de4-93ef-c1cf3337e0e3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:41.699503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d98801-16f4-4de4-93ef-c1cf3337e0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:41.913314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c7d98801-16f4-4de4-93ef-c1cf3337e0e3 None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:41.920089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c7d98801-16f4-4de4-93ef-c1cf3337e0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:42.175268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:42.275683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 874/1744] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:45:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 578 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:42.754597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0d3df-79fc-4089-ad07-8cda1aa699a6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:42.756837 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-72e0d3df-79fc-4089-ad07-8cda1aa699a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:43.010394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0d3df-79fc-4089-ad07-8cda1aa699a6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:43.018556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ca04e-e882-4dcb-8d64-ce8b5c9d5cb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:43.019828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ca04e-e882-4dcb-8d64-ce8b5c9d5cb6 service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:43.020241 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ca04e-e882-4dcb-8d64-ce8b5c9d5cb6 service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:43.020644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ca04e-e882-4dcb-8d64-ce8b5c9d5cb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:43.037140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ca04e-e882-4dcb-8d64-ce8b5c9d5cb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:43.038535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ca04e-e882-4dcb-8d64-ce8b5c9d5cb6 service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:43.081772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 871/1745] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:45:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:45:44.751342 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16947ac2-5b0c-42df-b075-aae4a45f15a8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:44.752275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16947ac2-5b0c-42df-b075-aae4a45f15a8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:44.752275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16947ac2-5b0c-42df-b075-aae4a45f15a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:44.793579 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-16947ac2-5b0c-42df-b075-aae4a45f15a8 None None] MFA Rules not processed for user `adea8e6fd0cb47f394e811865db51ade`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:44.796010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-16947ac2-5b0c-42df-b075-aae4a45f15a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:45.018399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 875/1746] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:45.026700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ca04e-e882-4dcb-8d64-ce8b5c9d5cb6 service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:45.028248 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-500ca04e-e882-4dcb-8d64-ce8b5c9d5cb6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:45.159058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16947ac2-5b0c-42df-b075-aae4a45f15a8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:45.162943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-16947ac2-5b0c-42df-b075-aae4a45f15a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:45.205438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ca04e-e882-4dcb-8d64-ce8b5c9d5cb6 service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:45.217405 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790eec4b-f576-4a7c-95ce-055d1b759f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:45.218434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eec4b-f576-4a7c-95ce-055d1b759f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:45.218881 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eec4b-f576-4a7c-95ce-055d1b759f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:45.219339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790eec4b-f576-4a7c-95ce-055d1b759f30 admin admin] PATH_INFO: `/v3/users/cf2ce978f5e94674b2d937ab3cc72770` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:45.234305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eec4b-f576-4a7c-95ce-055d1b759f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2ce978f5e94674b2d937ab3cc72770)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:45.236430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790eec4b-f576-4a7c-95ce-055d1b759f30 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:45.317727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16947ac2-5b0c-42df-b075-aae4a45f15a8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:45.334162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9cc35-8209-4c52-940c-259793450a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:45.338077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9cc35-8209-4c52-940c-259793450a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:45.339673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9cc35-8209-4c52-940c-259793450a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:45.340538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9cc35-8209-4c52-940c-259793450a8a admin admin] PATH_INFO: `/v3/users/ea3a748c3be9495badedff5cf9b859b5` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:45.341211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:45.347516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9cc35-8209-4c52-940c-259793450a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea3a748c3be9495badedff5cf9b859b5)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:45.356286 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9cc35-8209-4c52-940c-259793450a8a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:45.371452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-790eec4b-f576-4a7c-95ce-055d1b759f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2ce978f5e94674b2d937ab3cc72770'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:45.392285 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-790eec4b-f576-4a7c-95ce-055d1b759f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2ce978f5e94674b2d937ab3cc72770'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:45.395190 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-790eec4b-f576-4a7c-95ce-055d1b759f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2ce978f5e94674b2d937ab3cc72770'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:45.438224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-790eec4b-f576-4a7c-95ce-055d1b759f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2ce978f5e94674b2d937ab3cc72770'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:45.443992 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-790eec4b-f576-4a7c-95ce-055d1b759f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2ce978f5e94674b2d937ab3cc72770'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:45.493002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d8e9cc35-8209-4c52-940c-259793450a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea3a748c3be9495badedff5cf9b859b5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:45.493252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 872/1747] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:45:45 2022] DELETE /identity/v3/users/cf2ce978f5e94674b2d937ab3cc72770 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:45.503682 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd678-57f0-4b75-a147-dd0da3086a78 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:45.506308 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd678-57f0-4b75-a147-dd0da3086a78 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:45.508224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dd678-57f0-4b75-a147-dd0da3086a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:45.513458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d8e9cc35-8209-4c52-940c-259793450a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea3a748c3be9495badedff5cf9b859b5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:45.546432 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d8e9cc35-8209-4c52-940c-259793450a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea3a748c3be9495badedff5cf9b859b5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:45.547624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d8e9cc35-8209-4c52-940c-259793450a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea3a748c3be9495badedff5cf9b859b5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:45.585416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d8e9cc35-8209-4c52-940c-259793450a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea3a748c3be9495badedff5cf9b859b5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:45.588185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-048dd678-57f0-4b75-a147-dd0da3086a78 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:45.597724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-048dd678-57f0-4b75-a147-dd0da3086a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:45.620176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 876/1748] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:45:45 2022] DELETE /identity/v3/users/ea3a748c3be9495badedff5cf9b859b5 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:45:45.625572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83e9ac-872c-4a2f-bb82-6c790aa4b7a6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:45.627640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83e9ac-872c-4a2f-bb82-6c790aa4b7a6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:45.629389 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83e9ac-872c-4a2f-bb82-6c790aa4b7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:45.721034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0b83e9ac-872c-4a2f-bb82-6c790aa4b7a6 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:45.724452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0b83e9ac-872c-4a2f-bb82-6c790aa4b7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:45.727274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 873/1749] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:45.729862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d5b9c-48e8-4ae5-bb9a-b78a6f9f0edf None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:45.730503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d5b9c-48e8-4ae5-bb9a-b78a6f9f0edf None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:45.731111 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d5b9c-48e8-4ae5-bb9a-b78a6f9f0edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:45.752254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:45.756394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5b0d5b9c-48e8-4ae5-bb9a-b78a6f9f0edf None None] MFA Rules not processed for user `fe228871a7fd4a9bb15645955ff365c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:45.758222 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5b0d5b9c-48e8-4ae5-bb9a-b78a6f9f0edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:45.861003 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 874/1750] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Jul 26 02:45:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:45.864186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d5b9c-48e8-4ae5-bb9a-b78a6f9f0edf None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:45.868269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5b0d5b9c-48e8-4ae5-bb9a-b78a6f9f0edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:45.895494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d5b9c-48e8-4ae5-bb9a-b78a6f9f0edf None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:45.904049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250d5d8-2ef4-491f-84c4-ec66bb8dc22d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:45.906117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250d5d8-2ef4-491f-84c4-ec66bb8dc22d service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:45.907746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250d5d8-2ef4-491f-84c4-ec66bb8dc22d service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:45.908173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250d5d8-2ef4-491f-84c4-ec66bb8dc22d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:45.914505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 877/1751] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:45.916422 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56a18f-f13e-48a3-89cf-fc27b5b0a7c5 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:45.916951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56a18f-f13e-48a3-89cf-fc27b5b0a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:45.917973 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56a18f-f13e-48a3-89cf-fc27b5b0a7c5 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:45.924190 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 878/1752] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 02:45:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:45:45.929434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250d5d8-2ef4-491f-84c4-ec66bb8dc22d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:45.931101 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250d5d8-2ef4-491f-84c4-ec66bb8dc22d service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:45.945888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 875/1753] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:45.975819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df01cf5-dcff-4a8f-a877-3cb7b08f757b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:45.976701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df01cf5-dcff-4a8f-a877-3cb7b08f757b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:45.977843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df01cf5-dcff-4a8f-a877-3cb7b08f757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:45.982419 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250d5d8-2ef4-491f-84c4-ec66bb8dc22d service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:46.004231 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250d5d8-2ef4-491f-84c4-ec66bb8dc22d service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:46.016189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d4328-8bfb-4187-a80c-88ff3606ac6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:46.017305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d4328-8bfb-4187-a80c-88ff3606ac6d service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:46.017745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d4328-8bfb-4187-a80c-88ff3606ac6d service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:46.018282 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d4328-8bfb-4187-a80c-88ff3606ac6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:46.040931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5df01cf5-dcff-4a8f-a877-3cb7b08f757b None None] MFA Rules not processed for user `629b38364f6a414aa14123c0749ba164`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:46.046183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5df01cf5-dcff-4a8f-a877-3cb7b08f757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:46.049390 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d4328-8bfb-4187-a80c-88ff3606ac6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:46.055081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d4328-8bfb-4187-a80c-88ff3606ac6d service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:46.083426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 876/1754] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:45:46.084439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d4328-8bfb-4187-a80c-88ff3606ac6d service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:46.094607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d4328-8bfb-4187-a80c-88ff3606ac6d service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:46.100435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7f363-8c38-45af-9470-d10ef2c8464b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:46.101063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7f363-8c38-45af-9470-d10ef2c8464b service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:46.101405 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7f363-8c38-45af-9470-d10ef2c8464b service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:46.101680 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7f363-8c38-45af-9470-d10ef2c8464b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:46.116080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7f363-8c38-45af-9470-d10ef2c8464b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:46.117659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7f363-8c38-45af-9470-d10ef2c8464b service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:46.131827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 877/1755] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:46.214210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 879/1756] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 02:45:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:46.280705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7f363-8c38-45af-9470-d10ef2c8464b service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:46.282402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0db7f363-8c38-45af-9470-d10ef2c8464b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:46.336066 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7f363-8c38-45af-9470-d10ef2c8464b service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:46.362196 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44951915-2139-4f24-9b2b-570d5c8e9f25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629b38364f6a414aa14123c0749ba164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:46.363031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44951915-2139-4f24-9b2b-570d5c8e9f25 service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:46.363425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44951915-2139-4f24-9b2b-570d5c8e9f25 service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:46.363802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44951915-2139-4f24-9b2b-570d5c8e9f25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:46.390784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44951915-2139-4f24-9b2b-570d5c8e9f25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:46.392676 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44951915-2139-4f24-9b2b-570d5c8e9f25 service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:46.446093 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 878/1757] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:48.560807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df01cf5-dcff-4a8f-a877-3cb7b08f757b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:48.563487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5df01cf5-dcff-4a8f-a877-3cb7b08f757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:48.597481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df01cf5-dcff-4a8f-a877-3cb7b08f757b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:48.621104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:48.622121 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:48.623371 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:48.624699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] PATH_INFO: `/v3/projects/c5b5677c2164412d8d05066530f7542d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:48.627350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b5677c2164412d8d05066530f7542d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:48.631490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:48.670989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44951915-2139-4f24-9b2b-570d5c8e9f25 service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:48.673411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-44951915-2139-4f24-9b2b-570d5c8e9f25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:48.746223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44951915-2139-4f24-9b2b-570d5c8e9f25 service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:48.763289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:48.783617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b5677c2164412d8d05066530f7542d', 'request_id': 'req-73437486-a7c8-40b2-b308-68dc7469c5d5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:48.814166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b5677c2164412d8d05066530f7542d', 'request_id': 'req-73437486-a7c8-40b2-b308-68dc7469c5d5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:48.838486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b5677c2164412d8d05066530f7542d', 'request_id': 'req-73437486-a7c8-40b2-b308-68dc7469c5d5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:48.900949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] The token cache is being invalidate because project c5b5677c2164412d8d05066530f7542d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:45:48.903001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:48.907732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:48.915084 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 880/1758] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:45:48 2022] DELETE /identity/v3/projects/c5b5677c2164412d8d05066530f7542d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:48.917650 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:48.926227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:49.003597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:49.004526 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:49.004726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:49.004977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] PATH_INFO: `/v3/projects/42ac3484f24840a08defb6a4c02f0fae` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:49.013322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ac3484f24840a08defb6a4c02f0fae)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:49.020937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:49.050583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:49.201188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73437486-a7c8-40b2-b308-68dc7469c5d5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:49.234074 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ac3484f24840a08defb6a4c02f0fae', 'request_id': 'req-643622ae-e508-4b90-b149-b9b1d791054e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.247850 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ac3484f24840a08defb6a4c02f0fae', 'request_id': 'req-643622ae-e508-4b90-b149-b9b1d791054e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.265857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ac3484f24840a08defb6a4c02f0fae', 'request_id': 'req-643622ae-e508-4b90-b149-b9b1d791054e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.315980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] The token cache is being invalidate because project 42ac3484f24840a08defb6a4c02f0fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:45:49.317442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.319706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.329026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 879/1759] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:45:48 2022] DELETE /identity/v3/projects/42ac3484f24840a08defb6a4c02f0fae => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:49.330123 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:49.335891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:49.443453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:49.444237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:49.444524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:49.444800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] PATH_INFO: `/v3/users/5579d3ec81f34cf99c6b4455962b7548` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:49.450459 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5579d3ec81f34cf99c6b4455962b7548)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:49.471205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:49.619514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643622ae-e508-4b90-b149-b9b1d791054e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:49.625832 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c85b1-01e6-4f98-b528-80225f66e12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:49.627372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c85b1-01e6-4f98-b528-80225f66e12e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:49.641132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c85b1-01e6-4f98-b528-80225f66e12e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:49.641519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c85b1-01e6-4f98-b528-80225f66e12e admin admin] PATH_INFO: `/v3/users/91d867a0f4154609bfac75979de71701` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:49.643872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c85b1-01e6-4f98-b528-80225f66e12e admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d867a0f4154609bfac75979de71701)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:49.657738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5579d3ec81f34cf99c6b4455962b7548'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.661529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c85b1-01e6-4f98-b528-80225f66e12e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:49.710702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5579d3ec81f34cf99c6b4455962b7548'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.725494 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5579d3ec81f34cf99c6b4455962b7548'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.726211 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5579d3ec81f34cf99c6b4455962b7548'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.754068 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:49.765270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ff5c85b1-01e6-4f98-b528-80225f66e12e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d867a0f4154609bfac75979de71701'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.787026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ff5c85b1-01e6-4f98-b528-80225f66e12e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d867a0f4154609bfac75979de71701'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.788161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ff5c85b1-01e6-4f98-b528-80225f66e12e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d867a0f4154609bfac75979de71701'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.822062 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5579d3ec81f34cf99c6b4455962b7548'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.825440 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ff5c85b1-01e6-4f98-b528-80225f66e12e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d867a0f4154609bfac75979de71701'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.828159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-ff5c85b1-01e6-4f98-b528-80225f66e12e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d867a0f4154609bfac75979de71701'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:49.842558 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 881/1760] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:45:48 2022] DELETE /identity/v3/users/5579d3ec81f34cf99c6b4455962b7548 => generated 0 bytes in 927 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:49.891247 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 880/1761] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:45:49 2022] DELETE /identity/v3/users/91d867a0f4154609bfac75979de71701 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:50.562181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:50.563952 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:50.799657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:50.807566 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f5837-ecd1-4ed8-9562-658f2e7936e2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:50.852448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c81e9-cc2c-44eb-b3aa-1f422473efe6 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:50.853468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c81e9-cc2c-44eb-b3aa-1f422473efe6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:50.853897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c81e9-cc2c-44eb-b3aa-1f422473efe6 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:50.856324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 881/1762] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 02:45:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 02:45:50.877975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98896ce-bd4d-4e33-9623-d96885510e2f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:50.878317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98896ce-bd4d-4e33-9623-d96885510e2f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:50.878601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98896ce-bd4d-4e33-9623-d96885510e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:50.931307 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b98896ce-bd4d-4e33-9623-d96885510e2f None None] MFA Rules not processed for user `338b2744014940ca96c08d4e9262697b`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:50.932620 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b98896ce-bd4d-4e33-9623-d96885510e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:51.057820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:51.059786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:51.060240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:51.060661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] PATH_INFO: `/v3/users/e7c2dedf3f4742d899dac1456c847dca` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:51.066302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7c2dedf3f4742d899dac1456c847dca)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:51.068602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:51.179976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 882/1763] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 02:45:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:51.186165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7c2dedf3f4742d899dac1456c847dca'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:51.213407 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7c2dedf3f4742d899dac1456c847dca'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:51.231194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7c2dedf3f4742d899dac1456c847dca'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:51.232231 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7c2dedf3f4742d899dac1456c847dca'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:51.257355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7c2dedf3f4742d899dac1456c847dca'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:51.274851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 882/1764] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:45:50 2022] DELETE /identity/v3/users/e7c2dedf3f4742d899dac1456c847dca => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:52.663455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98896ce-bd4d-4e33-9623-d96885510e2f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:52.665125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b98896ce-bd4d-4e33-9623-d96885510e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:52.730968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98896ce-bd4d-4e33-9623-d96885510e2f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:52.763071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:52.765817 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:52.914665 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfe1f7-38a7-40c8-97a8-09ccd742156f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:52.917335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe1f7-38a7-40c8-97a8-09ccd742156f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:52.918470 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe1f7-38a7-40c8-97a8-09ccd742156f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:52.918751 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfe1f7-38a7-40c8-97a8-09ccd742156f admin admin] PATH_INFO: `/v3/projects/fea5c806776b42ce9e2d89bc2a8cd7cd` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:52.922446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfe1f7-38a7-40c8-97a8-09ccd742156f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea5c806776b42ce9e2d89bc2a8cd7cd)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:52.939847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfe1f7-38a7-40c8-97a8-09ccd742156f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:52.964310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf8710-fed5-4cfb-92cd-18d680125f6d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:52.999154 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:52.999940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:53.001677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:53.001981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] PATH_INFO: `/v3/projects/9a563c4dd09d4c958ebbd87b64bc61ff` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:53.034255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a563c4dd09d4c958ebbd87b64bc61ff)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:53.048806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:53.088345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-abdfe1f7-38a7-40c8-97a8-09ccd742156f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea5c806776b42ce9e2d89bc2a8cd7cd', 'request_id': 'req-abdfe1f7-38a7-40c8-97a8-09ccd742156f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.092375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:53.103698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-abdfe1f7-38a7-40c8-97a8-09ccd742156f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea5c806776b42ce9e2d89bc2a8cd7cd', 'request_id': 'req-abdfe1f7-38a7-40c8-97a8-09ccd742156f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.126655 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-abdfe1f7-38a7-40c8-97a8-09ccd742156f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea5c806776b42ce9e2d89bc2a8cd7cd', 'request_id': 'req-abdfe1f7-38a7-40c8-97a8-09ccd742156f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.163229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-abdfe1f7-38a7-40c8-97a8-09ccd742156f admin admin] The token cache is being invalidate because project fea5c806776b42ce9e2d89bc2a8cd7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:45:53.164183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-abdfe1f7-38a7-40c8-97a8-09ccd742156f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.165184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-abdfe1f7-38a7-40c8-97a8-09ccd742156f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.169813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 883/1765] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:45:52 2022] DELETE /identity/v3/projects/fea5c806776b42ce9e2d89bc2a8cd7cd => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:45:53.177897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7badc7-a268-418d-8d16-01b5c0db8c12 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:53.179809 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7badc7-a268-418d-8d16-01b5c0db8c12 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:53.182375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7badc7-a268-418d-8d16-01b5c0db8c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:53.196732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:53.254306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a563c4dd09d4c958ebbd87b64bc61ff', 'request_id': 'req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.276750 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a563c4dd09d4c958ebbd87b64bc61ff', 'request_id': 'req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.291120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a563c4dd09d4c958ebbd87b64bc61ff', 'request_id': 'req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.306777 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-8e7badc7-a268-418d-8d16-01b5c0db8c12 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:53.308403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8e7badc7-a268-418d-8d16-01b5c0db8c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:53.309270 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] The token cache is being invalidate because project 9a563c4dd09d4c958ebbd87b64bc61ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:45:53.310217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.311132 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.313204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 883/1766] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:45:52 2022] DELETE /identity/v3/projects/9a563c4dd09d4c958ebbd87b64bc61ff => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:53.319119 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:53.320885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:53.496040 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46ec8e-95e7-4b4c-9048-93fb2a60851e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:53.509799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:53.511700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:53.512162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:53.512444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] PATH_INFO: `/v3/users/f204a6ee6d2e49699ce06c0a9d4a4761` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:53.516755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 884/1767] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:53.516964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f204a6ee6d2e49699ce06c0a9d4a4761)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:53.525347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f93e1-3c99-4ee0-9277-d25e19fc9d74 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:53.525763 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f93e1-3c99-4ee0-9277-d25e19fc9d74 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:53.526743 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f93e1-3c99-4ee0-9277-d25e19fc9d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:53.543905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:53.570631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-563f93e1-3c99-4ee0-9277-d25e19fc9d74 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:53.572090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-563f93e1-3c99-4ee0-9277-d25e19fc9d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:53.601225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 885/1768] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:45:53.602750 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f93e1-3c99-4ee0-9277-d25e19fc9d74 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:53.658919 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f93e1-3c99-4ee0-9277-d25e19fc9d74 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:53.674068 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beea0d-2adb-479a-8caf-ec92a3bc5ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:53.674774 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beea0d-2adb-479a-8caf-ec92a3bc5ebe admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:53.674986 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beea0d-2adb-479a-8caf-ec92a3bc5ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:53.678474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beea0d-2adb-479a-8caf-ec92a3bc5ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:53.679464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beea0d-2adb-479a-8caf-ec92a3bc5ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:53.680614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beea0d-2adb-479a-8caf-ec92a3bc5ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:53.689013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55beea0d-2adb-479a-8caf-ec92a3bc5ebe admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:53.717133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f204a6ee6d2e49699ce06c0a9d4a4761'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.732142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 886/1769] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:53.732569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beea0d-2adb-479a-8caf-ec92a3bc5ebe admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:53.733443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f204a6ee6d2e49699ce06c0a9d4a4761'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.737140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-55beea0d-2adb-479a-8caf-ec92a3bc5ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:53.750353 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f204a6ee6d2e49699ce06c0a9d4a4761'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.750479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f204a6ee6d2e49699ce06c0a9d4a4761'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.775484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55beea0d-2adb-479a-8caf-ec92a3bc5ebe admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:53.776446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f204a6ee6d2e49699ce06c0a9d4a4761'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.782853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27f44d-a152-4592-8961-6eb7e1ac41cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:53.783851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27f44d-a152-4592-8961-6eb7e1ac41cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:53.784531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27f44d-a152-4592-8961-6eb7e1ac41cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:53.785467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27f44d-a152-4592-8961-6eb7e1ac41cf admin admin] PATH_INFO: `/v3/projects/977f59b4e5a14a82a061df0e05fe080e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:53.787243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27f44d-a152-4592-8961-6eb7e1ac41cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=977f59b4e5a14a82a061df0e05fe080e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:53.788226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 884/1770] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:45:53 2022] DELETE /identity/v3/users/f204a6ee6d2e49699ce06c0a9d4a4761 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:53.789716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:53.790964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27f44d-a152-4592-8961-6eb7e1ac41cf admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:53.797167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:53.953141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-de27f44d-a152-4592-8961-6eb7e1ac41cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '977f59b4e5a14a82a061df0e05fe080e', 'request_id': 'req-de27f44d-a152-4592-8961-6eb7e1ac41cf'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.964588 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:53.966969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-de27f44d-a152-4592-8961-6eb7e1ac41cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '977f59b4e5a14a82a061df0e05fe080e', 'request_id': 'req-de27f44d-a152-4592-8961-6eb7e1ac41cf'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:53.992592 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-de27f44d-a152-4592-8961-6eb7e1ac41cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '977f59b4e5a14a82a061df0e05fe080e', 'request_id': 'req-de27f44d-a152-4592-8961-6eb7e1ac41cf'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:54.014681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e95902-25ab-460e-a240-6313a320f419 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:54.058310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-de27f44d-a152-4592-8961-6eb7e1ac41cf admin admin] The token cache is being invalidate because project 977f59b4e5a14a82a061df0e05fe080e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:45:54.058596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-de27f44d-a152-4592-8961-6eb7e1ac41cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:54.061768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-de27f44d-a152-4592-8961-6eb7e1ac41cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:54.063759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 887/1771] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:45:53 2022] DELETE /identity/v3/projects/977f59b4e5a14a82a061df0e05fe080e => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:54.069140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd65b76-2f49-4051-986e-f6644faaf168 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:54.069455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd65b76-2f49-4051-986e-f6644faaf168 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:54.069724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd65b76-2f49-4051-986e-f6644faaf168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:54.113071 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9bd65b76-2f49-4051-986e-f6644faaf168 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:54.114289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9bd65b76-2f49-4051-986e-f6644faaf168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:54.116602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323a4ee-eff2-4f71-bbfa-cb8cf106cdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:54.117717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323a4ee-eff2-4f71-bbfa-cb8cf106cdf5 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:54.120445 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323a4ee-eff2-4f71-bbfa-cb8cf106cdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:54.120830 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323a4ee-eff2-4f71-bbfa-cb8cf106cdf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:54.122908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323a4ee-eff2-4f71-bbfa-cb8cf106cdf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:54.128634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323a4ee-eff2-4f71-bbfa-cb8cf106cdf5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:54.130796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 888/1772] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:54.139695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ba75c-72d9-4ff6-9bff-5cf0639d980d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:54.139978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ba75c-72d9-4ff6-9bff-5cf0639d980d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:54.140254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ba75c-72d9-4ff6-9bff-5cf0639d980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:54.174566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7b9ba75c-72d9-4ff6-9bff-5cf0639d980d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:54.176537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7b9ba75c-72d9-4ff6-9bff-5cf0639d980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:54.198740 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 889/1773] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:45:54.199759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ba75c-72d9-4ff6-9bff-5cf0639d980d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:54.218552 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 885/1774] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:53 2022] POST /identity/v3/projects => generated 387 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:54.223905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323a4ee-eff2-4f71-bbfa-cb8cf106cdf5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:54.228849 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f323a4ee-eff2-4f71-bbfa-cb8cf106cdf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:54.231213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ba75c-72d9-4ff6-9bff-5cf0639d980d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:54.319606 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:54.393322 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323a4ee-eff2-4f71-bbfa-cb8cf106cdf5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:54.419522 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c53e30-344f-4fb0-bfee-b79c6908d88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:54.420247 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c53e30-344f-4fb0-bfee-b79c6908d88e admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:54.420536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c53e30-344f-4fb0-bfee-b79c6908d88e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:54.420815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c53e30-344f-4fb0-bfee-b79c6908d88e admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:54.421596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c53e30-344f-4fb0-bfee-b79c6908d88e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:54.423635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8614dce-105a-43b9-943b-554d8034ab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:54.424318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8614dce-105a-43b9-943b-554d8034ab42 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:54.424585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8614dce-105a-43b9-943b-554d8034ab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:54.424861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8614dce-105a-43b9-943b-554d8034ab42 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:54.425929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c53e30-344f-4fb0-bfee-b79c6908d88e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:54.431265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8614dce-105a-43b9-943b-554d8034ab42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:54.434672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8614dce-105a-43b9-943b-554d8034ab42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:54.436771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8614dce-105a-43b9-943b-554d8034ab42 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:54.460297 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 890/1775] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:54.468985 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8614dce-105a-43b9-943b-554d8034ab42 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:54.499077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8614dce-105a-43b9-943b-554d8034ab42 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:54.518503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e07c1-eafe-409f-91d0-f9dbf13fb355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:54.519480 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e07c1-eafe-409f-91d0-f9dbf13fb355 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:54.527965 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e07c1-eafe-409f-91d0-f9dbf13fb355 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:54.528437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e07c1-eafe-409f-91d0-f9dbf13fb355 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:54.532310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e07c1-eafe-409f-91d0-f9dbf13fb355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:54.542054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 886/1776] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:54 2022] POST /identity/v3/users => generated 294 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:54.543091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c53e30-344f-4fb0-bfee-b79c6908d88e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:54.544502 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e07c1-eafe-409f-91d0-f9dbf13fb355 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:54.550661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b6c53e30-344f-4fb0-bfee-b79c6908d88e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:54.600675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 891/1777] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:54 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:54.601913 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e07c1-eafe-409f-91d0-f9dbf13fb355 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:54.769586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:54.817218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e07c1-eafe-409f-91d0-f9dbf13fb355 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:54.825332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82748dc-2d7a-42ed-890a-484c58f4ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:54.826300 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82748dc-2d7a-42ed-890a-484c58f4ecd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:54.826810 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82748dc-2d7a-42ed-890a-484c58f4ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:54.827236 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82748dc-2d7a-42ed-890a-484c58f4ecd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:54.828331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82748dc-2d7a-42ed-890a-484c58f4ecd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:54.830782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82748dc-2d7a-42ed-890a-484c58f4ecd0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:54.833060 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c53e30-344f-4fb0-bfee-b79c6908d88e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:54.851725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 892/1778] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:54.853675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82748dc-2d7a-42ed-890a-484c58f4ecd0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:54.881116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82748dc-2d7a-42ed-890a-484c58f4ecd0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:54.892193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14c621-bc41-403e-82aa-72acff2b4d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:54.894149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14c621-bc41-403e-82aa-72acff2b4d2b admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:54.895582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14c621-bc41-403e-82aa-72acff2b4d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:54.896575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14c621-bc41-403e-82aa-72acff2b4d2b admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:54.897381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14c621-bc41-403e-82aa-72acff2b4d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:54.899984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14c621-bc41-403e-82aa-72acff2b4d2b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:54.984590 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 893/1779] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:54 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:54.988097 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14c621-bc41-403e-82aa-72acff2b4d2b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:54.992374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1a14c621-bc41-403e-82aa-72acff2b4d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:55.039292 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14c621-bc41-403e-82aa-72acff2b4d2b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:55.058776 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:55.059887 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:55.060328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:55.060881 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] PATH_INFO: `/v3/projects/0b53fa88687d48e998abebbc526643b2` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:55.064038 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c737140-4ce5-447f-a629-af1c369ffe7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:55.068733 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c737140-4ce5-447f-a629-af1c369ffe7f service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:55.069397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c737140-4ce5-447f-a629-af1c369ffe7f service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:55.069986 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c737140-4ce5-447f-a629-af1c369ffe7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:55.070319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b53fa88687d48e998abebbc526643b2)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:55.072512 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:55.075470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5c737140-4ce5-447f-a629-af1c369ffe7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:55.113196 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c737140-4ce5-447f-a629-af1c369ffe7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:55.115430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c737140-4ce5-447f-a629-af1c369ffe7f service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:55.149037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 887/1780] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:55.150101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c737140-4ce5-447f-a629-af1c369ffe7f service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:55.175904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c737140-4ce5-447f-a629-af1c369ffe7f service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:55.188865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459adc5-f1a2-48f8-8f79-1c1801602c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:55.191391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459adc5-f1a2-48f8-8f79-1c1801602c83 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:55.191718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459adc5-f1a2-48f8-8f79-1c1801602c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:55.192001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459adc5-f1a2-48f8-8f79-1c1801602c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:55.195055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459adc5-f1a2-48f8-8f79-1c1801602c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:55.196905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459adc5-f1a2-48f8-8f79-1c1801602c83 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:55.234692 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 888/1781] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:55.235647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459adc5-f1a2-48f8-8f79-1c1801602c83 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:55.254813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b53fa88687d48e998abebbc526643b2', 'request_id': 'req-71981f54-be23-4ad5-bc84-ce4409c9b129'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:55.269578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459adc5-f1a2-48f8-8f79-1c1801602c83 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:55.270498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b53fa88687d48e998abebbc526643b2', 'request_id': 'req-71981f54-be23-4ad5-bc84-ce4409c9b129'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:55.291269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b53fa88687d48e998abebbc526643b2', 'request_id': 'req-71981f54-be23-4ad5-bc84-ce4409c9b129'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:55.340829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] The token cache is being invalidate because project 0b53fa88687d48e998abebbc526643b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:45:55.340829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:55.340829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:45:55.340829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 894/1782] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:45:54 2022] DELETE /identity/v3/projects/0b53fa88687d48e998abebbc526643b2 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:55.340829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:55.343133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:55.363949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:55.485872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b8d3-3e74-4bea-8dca-9ea396e4f4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:55.486602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b8d3-3e74-4bea-8dca-9ea396e4f4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:55.486890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b8d3-3e74-4bea-8dca-9ea396e4f4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:55.487256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b8d3-3e74-4bea-8dca-9ea396e4f4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:55.488011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812b8d3-3e74-4bea-8dca-9ea396e4f4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:55.489810 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812b8d3-3e74-4bea-8dca-9ea396e4f4a5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:55.506296 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71981f54-be23-4ad5-bc84-ce4409c9b129 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:55.511850 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93543-874b-4561-b0d6-c38b55e5c039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:55.512748 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93543-874b-4561-b0d6-c38b55e5c039 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:55.513080 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93543-874b-4561-b0d6-c38b55e5c039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:55.513558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93543-874b-4561-b0d6-c38b55e5c039 admin admin] PATH_INFO: `/v3/projects/ea9aec288f1a4118b53c9a69b4ef477d/users/45a4091f735148208ea8056bf045d1e1/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:55.528850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 889/1783] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:55.535225 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba740-de57-46f3-aa4f-4eeb2defc729 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:55.535583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba740-de57-46f3-aa4f-4eeb2defc729 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:55.535869 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ba740-de57-46f3-aa4f-4eeb2defc729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:55.536051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93543-874b-4561-b0d6-c38b55e5c039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9aec288f1a4118b53c9a69b4ef477d, user_id=45a4091f735148208ea8056bf045d1e1, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:55.545763 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93543-874b-4561-b0d6-c38b55e5c039 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:55.588392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 895/1784] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:55 2022] PUT /identity/v3/projects/ea9aec288f1a4118b53c9a69b4ef477d/users/45a4091f735148208ea8056bf045d1e1/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:55.592000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93543-874b-4561-b0d6-c38b55e5c039 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:55.597727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f8c93543-874b-4561-b0d6-c38b55e5c039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:55.604383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c28ba740-de57-46f3-aa4f-4eeb2defc729 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:55.605745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c28ba740-de57-46f3-aa4f-4eeb2defc729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:55.747674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93543-874b-4561-b0d6-c38b55e5c039 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:55.755622 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7f952-29fb-48e0-9203-84d23c9d8875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:55.756786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7f952-29fb-48e0-9203-84d23c9d8875 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:55.757357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7f952-29fb-48e0-9203-84d23c9d8875 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:55.757482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7f952-29fb-48e0-9203-84d23c9d8875 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:55.758390 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7f952-29fb-48e0-9203-84d23c9d8875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:55.759874 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7f952-29fb-48e0-9203-84d23c9d8875 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:55.777466 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 896/1785] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:55.777466 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad679c91-6469-4228-8ec0-5b0e1c7fe998 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:55.777956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad679c91-6469-4228-8ec0-5b0e1c7fe998 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:55.778352 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad679c91-6469-4228-8ec0-5b0e1c7fe998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:55.825536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ad679c91-6469-4228-8ec0-5b0e1c7fe998 None None] MFA Rules not processed for user `45a4091f735148208ea8056bf045d1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:55.828225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ad679c91-6469-4228-8ec0-5b0e1c7fe998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:55.869185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 890/1786] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:55.870348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ba740-de57-46f3-aa4f-4eeb2defc729 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:55.888367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:55.900048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ba740-de57-46f3-aa4f-4eeb2defc729 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:55.910013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22319fae-6b09-4b56-ba1b-497dbe40fa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:55.910837 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22319fae-6b09-4b56-ba1b-497dbe40fa43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:55.911162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22319fae-6b09-4b56-ba1b-497dbe40fa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:55.911413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22319fae-6b09-4b56-ba1b-497dbe40fa43 admin admin] PATH_INFO: `/v3/projects/89ad05d71c9c41f693da368d6389d72c/users/8e67c00c94174674a84eaabef8ab351d/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:55.951066 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22319fae-6b09-4b56-ba1b-497dbe40fa43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ad05d71c9c41f693da368d6389d72c, user_id=8e67c00c94174674a84eaabef8ab351d, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:55.954138 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22319fae-6b09-4b56-ba1b-497dbe40fa43 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:55.987583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 897/1787] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:55.999365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 891/1788] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:55 2022] PUT /identity/v3/projects/89ad05d71c9c41f693da368d6389d72c/users/8e67c00c94174674a84eaabef8ab351d/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:55.999601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe6b5-2063-411d-9427-c36d45f56d85 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:55.999601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe6b5-2063-411d-9427-c36d45f56d85 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:55.999601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfe6b5-2063-411d-9427-c36d45f56d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:55.999821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22319fae-6b09-4b56-ba1b-497dbe40fa43 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:56.013183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-54cfe6b5-2063-411d-9427-c36d45f56d85 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:56.014530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-54cfe6b5-2063-411d-9427-c36d45f56d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:56.031559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:56.156608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 898/1789] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:56.158123 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1d13b-28f9-4ee4-adad-96fc05da7a79 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:56.158572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1d13b-28f9-4ee4-adad-96fc05da7a79 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:56.158900 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1d13b-28f9-4ee4-adad-96fc05da7a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:56.162669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22319fae-6b09-4b56-ba1b-497dbe40fa43 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:56.174113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f2e23-5615-4a7d-bf68-65237846b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:56.175302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f2e23-5615-4a7d-bf68-65237846b35d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:56.177589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f2e23-5615-4a7d-bf68-65237846b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:56.178132 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f2e23-5615-4a7d-bf68-65237846b35d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:56.179802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f2e23-5615-4a7d-bf68-65237846b35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:56.185548 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f2e23-5615-4a7d-bf68-65237846b35d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:56.221195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cfa1d13b-28f9-4ee4-adad-96fc05da7a79 None None] MFA Rules not processed for user `8e67c00c94174674a84eaabef8ab351d`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:56.222667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cfa1d13b-28f9-4ee4-adad-96fc05da7a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:56.263633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 892/1790] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:55 2022] POST /identity/v3/projects => generated 387 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:45:56.265721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f2e23-5615-4a7d-bf68-65237846b35d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:56.413156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 899/1791] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:56.414696 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1d13b-28f9-4ee4-adad-96fc05da7a79 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:56.433437 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f2e23-5615-4a7d-bf68-65237846b35d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:56.437736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1d13b-28f9-4ee4-adad-96fc05da7a79 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:56.448514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91ceec-be22-4fd4-b98a-b54906b4b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:56.449812 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d57d6-6511-4982-a505-532a72cbebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:56.451525 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d57d6-6511-4982-a505-532a72cbebd0 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:56.452979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91ceec-be22-4fd4-b98a-b54906b4b370 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:56.453314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91ceec-be22-4fd4-b98a-b54906b4b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:56.453941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d57d6-6511-4982-a505-532a72cbebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:56.454464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d57d6-6511-4982-a505-532a72cbebd0 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:56.455854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d57d6-6511-4982-a505-532a72cbebd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:56.459468 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91ceec-be22-4fd4-b98a-b54906b4b370 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:56.462019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91ceec-be22-4fd4-b98a-b54906b4b370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:56.462335 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91ceec-be22-4fd4-b98a-b54906b4b370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:56.463177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d57d6-6511-4982-a505-532a72cbebd0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:56.473998 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91ceec-be22-4fd4-b98a-b54906b4b370 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:56.502618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 893/1792] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:56.502618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91ceec-be22-4fd4-b98a-b54906b4b370 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:56.543818 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91ceec-be22-4fd4-b98a-b54906b4b370 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:56.547737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 900/1793] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:56 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:56.549112 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d57d6-6511-4982-a505-532a72cbebd0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:56.565183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78961604-9e16-4e4e-83c8-1cf938fe4592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:56.565899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78961604-9e16-4e4e-83c8-1cf938fe4592 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:56.566191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78961604-9e16-4e4e-83c8-1cf938fe4592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:56.566646 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78961604-9e16-4e4e-83c8-1cf938fe4592 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:56.567468 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78961604-9e16-4e4e-83c8-1cf938fe4592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:56.569698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78961604-9e16-4e4e-83c8-1cf938fe4592 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:56.595944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d57d6-6511-4982-a505-532a72cbebd0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:56.626107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358468-66b9-4b13-b733-d7407c3a65ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:56.626810 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358468-66b9-4b13-b733-d7407c3a65ad admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:56.627128 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358468-66b9-4b13-b733-d7407c3a65ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:56.627463 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358468-66b9-4b13-b733-d7407c3a65ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:56.628292 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3358468-66b9-4b13-b733-d7407c3a65ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:56.630374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3358468-66b9-4b13-b733-d7407c3a65ad admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:56.670382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 894/1794] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:56 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:56.673127 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78961604-9e16-4e4e-83c8-1cf938fe4592 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:56.702501 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 901/1795] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:56 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:56.704147 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358468-66b9-4b13-b733-d7407c3a65ad admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:56.758469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:56.817831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78961604-9e16-4e4e-83c8-1cf938fe4592 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:56.824977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358468-66b9-4b13-b733-d7407c3a65ad admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:56.826113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf16d9e-a431-46a7-a6e5-3b65ad537046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:56.826581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16d9e-a431-46a7-a6e5-3b65ad537046 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:56.827634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16d9e-a431-46a7-a6e5-3b65ad537046 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:56.827997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf16d9e-a431-46a7-a6e5-3b65ad537046 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:56.829269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf16d9e-a431-46a7-a6e5-3b65ad537046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:56.831072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf16d9e-a431-46a7-a6e5-3b65ad537046 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:56.832603 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55233012-51c2-4c97-8be1-e6877f6e6b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:56.833960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55233012-51c2-4c97-8be1-e6877f6e6b5f admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:56.834516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55233012-51c2-4c97-8be1-e6877f6e6b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:56.835179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55233012-51c2-4c97-8be1-e6877f6e6b5f admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:56.836157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55233012-51c2-4c97-8be1-e6877f6e6b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:56.838669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55233012-51c2-4c97-8be1-e6877f6e6b5f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:56.847710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 895/1796] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:56.848680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf16d9e-a431-46a7-a6e5-3b65ad537046 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:56.855009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:56.866689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf16d9e-a431-46a7-a6e5-3b65ad537046 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:56.884115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831cc62-403d-4605-95f1-24795599d37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:56.884115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831cc62-403d-4605-95f1-24795599d37c admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:56.884115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831cc62-403d-4605-95f1-24795599d37c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:56.884115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831cc62-403d-4605-95f1-24795599d37c admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:56.884978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831cc62-403d-4605-95f1-24795599d37c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:56.886985 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 902/1797] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:56 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:56.887145 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55233012-51c2-4c97-8be1-e6877f6e6b5f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:56.889408 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831cc62-403d-4605-95f1-24795599d37c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:56.911091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55233012-51c2-4c97-8be1-e6877f6e6b5f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:56.919264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6aa21d-fb7a-442d-820d-5b39a6c6f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:56.920533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aa21d-fb7a-442d-820d-5b39a6c6f932 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:56.921061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aa21d-fb7a-442d-820d-5b39a6c6f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:56.921538 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aa21d-fb7a-442d-820d-5b39a6c6f932 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:56.922615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6aa21d-fb7a-442d-820d-5b39a6c6f932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:56.925622 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6aa21d-fb7a-442d-820d-5b39a6c6f932 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:56.935323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 896/1798] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:56 2022] POST /identity/v3/users => generated 286 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:56.935911 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831cc62-403d-4605-95f1-24795599d37c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:56.943524 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 903/1799] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:56.944780 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6aa21d-fb7a-442d-820d-5b39a6c6f932 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:56.950089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831cc62-403d-4605-95f1-24795599d37c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:56.956250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d242725-702a-4486-96a0-63bb4d4c4f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:56.956907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d242725-702a-4486-96a0-63bb4d4c4f0a admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:56.957186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d242725-702a-4486-96a0-63bb4d4c4f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:56.957516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d242725-702a-4486-96a0-63bb4d4c4f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:56.958221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d242725-702a-4486-96a0-63bb4d4c4f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:56.959835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6aa21d-fb7a-442d-820d-5b39a6c6f932 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:56.959958 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d242725-702a-4486-96a0-63bb4d4c4f0a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:56.968009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d021f3b-02e3-419b-b6e0-a2db4ad0b693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:56.969047 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d021f3b-02e3-419b-b6e0-a2db4ad0b693 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:56.969937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d021f3b-02e3-419b-b6e0-a2db4ad0b693 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:56.970395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d021f3b-02e3-419b-b6e0-a2db4ad0b693 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:56.971300 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d021f3b-02e3-419b-b6e0-a2db4ad0b693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:56.984652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 897/1800] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:56.984652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d242725-702a-4486-96a0-63bb4d4c4f0a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:56.986156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d242725-702a-4486-96a0-63bb4d4c4f0a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:56.986475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d021f3b-02e3-419b-b6e0-a2db4ad0b693 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:56.992871 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83599f-1795-4435-9cbe-6d7c4d544c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:56.993158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83599f-1795-4435-9cbe-6d7c4d544c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:56.993465 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83599f-1795-4435-9cbe-6d7c4d544c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:56.993740 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83599f-1795-4435-9cbe-6d7c4d544c9b admin admin] PATH_INFO: `/v3/projects/5829aa71cc9243ed819c1fca9050e900/users/3c8f411821c544dc976494b87348bd7a/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:57.013082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83599f-1795-4435-9cbe-6d7c4d544c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5829aa71cc9243ed819c1fca9050e900, user_id=3c8f411821c544dc976494b87348bd7a, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:57.016603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83599f-1795-4435-9cbe-6d7c4d544c9b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:57.032744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 904/1801] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:57.034175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d021f3b-02e3-419b-b6e0-a2db4ad0b693 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:57.060129 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d021f3b-02e3-419b-b6e0-a2db4ad0b693 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:57.064238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 898/1802] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:56 2022] PUT /identity/v3/projects/5829aa71cc9243ed819c1fca9050e900/users/3c8f411821c544dc976494b87348bd7a/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:57.066030 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83599f-1795-4435-9cbe-6d7c4d544c9b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:57.182063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d3750-a15f-4900-973c-c0b74767c53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:57.182826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d3750-a15f-4900-973c-c0b74767c53d admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:57.183112 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d3750-a15f-4900-973c-c0b74767c53d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:57.183391 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d3750-a15f-4900-973c-c0b74767c53d admin admin] PATH_INFO: `/v3/projects/9155d064392e4c5f83ff6235ba148575/users/aae738867dff43109492463dcb78bf2b/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:57.207194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d3750-a15f-4900-973c-c0b74767c53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9155d064392e4c5f83ff6235ba148575, user_id=aae738867dff43109492463dcb78bf2b, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:57.210094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d3750-a15f-4900-973c-c0b74767c53d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:57.229017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83599f-1795-4435-9cbe-6d7c4d544c9b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:57.234940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 905/1803] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:57 2022] PUT /identity/v3/projects/9155d064392e4c5f83ff6235ba148575/users/aae738867dff43109492463dcb78bf2b/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:57.234940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2f39b-158b-4dd4-a5a0-63d03c316ef1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:57.234940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2f39b-158b-4dd4-a5a0-63d03c316ef1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:57.234940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2f39b-158b-4dd4-a5a0-63d03c316ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:57.272580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-44d2f39b-158b-4dd4-a5a0-63d03c316ef1 None None] MFA Rules not processed for user `3c8f411821c544dc976494b87348bd7a`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:57.274226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-44d2f39b-158b-4dd4-a5a0-63d03c316ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:57.320124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcf6a8-98c7-49cf-b8f7-3b70b5871ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:57.320316 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcf6a8-98c7-49cf-b8f7-3b70b5871ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:57.320686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcf6a8-98c7-49cf-b8f7-3b70b5871ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:57.320871 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fcf6a8-98c7-49cf-b8f7-3b70b5871ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:57.323009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcf6a8-98c7-49cf-b8f7-3b70b5871ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:57.325195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fcf6a8-98c7-49cf-b8f7-3b70b5871ea3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:57.337445 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 899/1804] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:57.338351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcf6a8-98c7-49cf-b8f7-3b70b5871ea3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:57.357975 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fcf6a8-98c7-49cf-b8f7-3b70b5871ea3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:57.381239 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a9b40-208a-4607-8fb1-7b33f9740a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:57.381966 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a9b40-208a-4607-8fb1-7b33f9740a43 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:57.382247 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a9b40-208a-4607-8fb1-7b33f9740a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:57.382518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a9b40-208a-4607-8fb1-7b33f9740a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:57.383547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a9b40-208a-4607-8fb1-7b33f9740a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:57.386258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a9b40-208a-4607-8fb1-7b33f9740a43 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:57.412062 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 900/1805] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:57.413338 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a9b40-208a-4607-8fb1-7b33f9740a43 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:57.429346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a9b40-208a-4607-8fb1-7b33f9740a43 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:57.441893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcf731-52cc-4212-aaf4-e56fe1a4bae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:57.443555 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcf731-52cc-4212-aaf4-e56fe1a4bae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:57.443896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcf731-52cc-4212-aaf4-e56fe1a4bae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:57.444112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcf731-52cc-4212-aaf4-e56fe1a4bae4 admin admin] PATH_INFO: `/v3/projects/168bb4ac8d0e46ba8b580a869a52cd3a/users/ecdd0b00995a4490af74ce72bff51cc3/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:57.445783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 906/1806] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:57.453595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b4478-5b02-46b0-90bd-11bddb421fce None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:57.454214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b4478-5b02-46b0-90bd-11bddb421fce None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:57.454685 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b4478-5b02-46b0-90bd-11bddb421fce None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:57.457661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 907/1807] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 02:45:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:45:57.458834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b4478-5b02-46b0-90bd-11bddb421fce None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:57.476868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:57.481964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b4478-5b02-46b0-90bd-11bddb421fce None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:57.485171 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcf731-52cc-4212-aaf4-e56fe1a4bae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=168bb4ac8d0e46ba8b580a869a52cd3a, user_id=ecdd0b00995a4490af74ce72bff51cc3, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:57.488588 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcf731-52cc-4212-aaf4-e56fe1a4bae4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:57.500665 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51789e-c5b4-4955-9056-4b9187e8352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:57.501527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51789e-c5b4-4955-9056-4b9187e8352f admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:57.501873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51789e-c5b4-4955-9056-4b9187e8352f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:57.502212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51789e-c5b4-4955-9056-4b9187e8352f admin admin] PATH_INFO: `/v3/projects/9155d064392e4c5f83ff6235ba148575/users/aae738867dff43109492463dcb78bf2b/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:57.505335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51789e-c5b4-4955-9056-4b9187e8352f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9155d064392e4c5f83ff6235ba148575, user_id=aae738867dff43109492463dcb78bf2b, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:57.522290 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51789e-c5b4-4955-9056-4b9187e8352f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:57.529239 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 901/1808] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:57 2022] PUT /identity/v3/projects/168bb4ac8d0e46ba8b580a869a52cd3a/users/ecdd0b00995a4490af74ce72bff51cc3/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:57.530271 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcf731-52cc-4212-aaf4-e56fe1a4bae4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:57.551912 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 908/1809] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:57 2022] PUT /identity/v3/projects/9155d064392e4c5f83ff6235ba148575/users/aae738867dff43109492463dcb78bf2b/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:57.560838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421a2c3-7fdf-48a2-877d-82985a050b43 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:57.560838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421a2c3-7fdf-48a2-877d-82985a050b43 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:57.560838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421a2c3-7fdf-48a2-877d-82985a050b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:57.624818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4421a2c3-7fdf-48a2-877d-82985a050b43 None None] MFA Rules not processed for user `338b2744014940ca96c08d4e9262697b`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:57.627406 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4421a2c3-7fdf-48a2-877d-82985a050b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:57.671023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcf731-52cc-4212-aaf4-e56fe1a4bae4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:57.677274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:57.746223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 909/1810] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 02:45:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:57.750249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e466ea-6f43-4775-9065-d1ed94fad515 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:57.750753 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e466ea-6f43-4775-9065-d1ed94fad515 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:57.751259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e466ea-6f43-4775-9065-d1ed94fad515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:57.819602 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b8e466ea-6f43-4775-9065-d1ed94fad515 None None] MFA Rules not processed for user `ecdd0b00995a4490af74ce72bff51cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:57.820854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b8e466ea-6f43-4775-9065-d1ed94fad515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:57.842806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6cbbf-ab8b-4623-89a7-771ae094726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:57.844974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6cbbf-ab8b-4623-89a7-771ae094726c admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:57.845613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6cbbf-ab8b-4623-89a7-771ae094726c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:57.846120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6cbbf-ab8b-4623-89a7-771ae094726c admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:57.847434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6cbbf-ab8b-4623-89a7-771ae094726c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:57.850912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6cbbf-ab8b-4623-89a7-771ae094726c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:57.914907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 902/1811] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:57 2022] POST /identity/v3/projects => generated 385 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:57.916216 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef150b64-a1b4-454b-9677-515925ca8c94 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:57.916504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef150b64-a1b4-454b-9677-515925ca8c94 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:57.917037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef150b64-a1b4-454b-9677-515925ca8c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:57.972475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 910/1812] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:57.972475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e466ea-6f43-4775-9065-d1ed94fad515 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:57.973716 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b8e466ea-6f43-4775-9065-d1ed94fad515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:57.976685 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ef150b64-a1b4-454b-9677-515925ca8c94 None None] MFA Rules not processed for user `aae738867dff43109492463dcb78bf2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:57.978496 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ef150b64-a1b4-454b-9677-515925ca8c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:57.995394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e466ea-6f43-4775-9065-d1ed94fad515 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:58.093259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 903/1813] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:58.094309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef150b64-a1b4-454b-9677-515925ca8c94 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:58.115283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d1063-67ea-4049-b7e7-452426fda7f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:58.116266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d1063-67ea-4049-b7e7-452426fda7f5 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:58.117009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d1063-67ea-4049-b7e7-452426fda7f5 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:58.117504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d1063-67ea-4049-b7e7-452426fda7f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:58.120543 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:58.129847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d1063-67ea-4049-b7e7-452426fda7f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:58.131601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d1063-67ea-4049-b7e7-452426fda7f5 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:58.144019 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 911/1814] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:58.144889 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d1063-67ea-4049-b7e7-452426fda7f5 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:58.257734 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:58.332577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d1063-67ea-4049-b7e7-452426fda7f5 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:58.338631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068b0f-98f0-495c-8358-7fd7b1b40547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:58.339443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068b0f-98f0-495c-8358-7fd7b1b40547 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:58.340194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068b0f-98f0-495c-8358-7fd7b1b40547 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:58.340531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29068b0f-98f0-495c-8358-7fd7b1b40547 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:58.341398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068b0f-98f0-495c-8358-7fd7b1b40547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:58.345124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29068b0f-98f0-495c-8358-7fd7b1b40547 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:58.382567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 912/1815] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:58 2022] POST /identity/v3/projects => generated 367 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:58.385099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068b0f-98f0-495c-8358-7fd7b1b40547 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:58.388111 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-29068b0f-98f0-495c-8358-7fd7b1b40547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:58.405110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef150b64-a1b4-454b-9677-515925ca8c94 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:58.495529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a112fb-55d7-4907-9b2a-533eb53e8ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:58.496275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a112fb-55d7-4907-9b2a-533eb53e8ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:58.496631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a112fb-55d7-4907-9b2a-533eb53e8ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:58.496971 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a112fb-55d7-4907-9b2a-533eb53e8ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:58.497890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a112fb-55d7-4907-9b2a-533eb53e8ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:58.500729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a112fb-55d7-4907-9b2a-533eb53e8ec1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:58.506834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29068b0f-98f0-495c-8358-7fd7b1b40547 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:58.513376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22f234-bb39-4d1a-bd5b-f92348722d03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:58.514322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22f234-bb39-4d1a-bd5b-f92348722d03 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:58.514737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22f234-bb39-4d1a-bd5b-f92348722d03 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:58.515163 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22f234-bb39-4d1a-bd5b-f92348722d03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:58.537620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 904/1816] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:58 2022] POST /identity/v3/users => generated 299 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:58.538671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a112fb-55d7-4907-9b2a-533eb53e8ec1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:58.556162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a112fb-55d7-4907-9b2a-533eb53e8ec1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:58.561737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdef48-771c-4f47-8074-247c9be78a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:58.562316 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdef48-771c-4f47-8074-247c9be78a31 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:58.562593 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdef48-771c-4f47-8074-247c9be78a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:58.563170 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdef48-771c-4f47-8074-247c9be78a31 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:58.563526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdef48-771c-4f47-8074-247c9be78a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:58.565614 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdef48-771c-4f47-8074-247c9be78a31 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:58.595410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 905/1817] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:45:58 2022] POST /identity/v3/users => generated 290 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:58.599177 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdef48-771c-4f47-8074-247c9be78a31 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:58.619329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdef48-771c-4f47-8074-247c9be78a31 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:58.633151 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55cd26-6a71-435c-afad-4d3dd50db4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:58.633151 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cd26-6a71-435c-afad-4d3dd50db4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:58.633151 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cd26-6a71-435c-afad-4d3dd50db4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:58.633151 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cd26-6a71-435c-afad-4d3dd50db4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:58.633805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55cd26-6a71-435c-afad-4d3dd50db4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:58.633805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55cd26-6a71-435c-afad-4d3dd50db4a6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:58.652660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22f234-bb39-4d1a-bd5b-f92348722d03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:58.654788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22f234-bb39-4d1a-bd5b-f92348722d03 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:58.656813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 906/1818] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:58.657938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55cd26-6a71-435c-afad-4d3dd50db4a6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:58.670310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 913/1819] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:58.671374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22f234-bb39-4d1a-bd5b-f92348722d03 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:58.681535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55cd26-6a71-435c-afad-4d3dd50db4a6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:58.685750 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22f234-bb39-4d1a-bd5b-f92348722d03 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:58.696018 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6ad62-d06d-4469-bff5-c07baca4da9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:58.696730 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6ad62-d06d-4469-bff5-c07baca4da9d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:58.697443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6ad62-d06d-4469-bff5-c07baca4da9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:58.697801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6ad62-d06d-4469-bff5-c07baca4da9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:58.699213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6ad62-d06d-4469-bff5-c07baca4da9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:58.702260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6ad62-d06d-4469-bff5-c07baca4da9d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:58.702662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9083c-f30a-4950-bf57-8e1dc92227d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:58.703595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9083c-f30a-4950-bf57-8e1dc92227d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:58.704033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9083c-f30a-4950-bf57-8e1dc92227d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:58.704474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9083c-f30a-4950-bf57-8e1dc92227d9 admin admin] PATH_INFO: `/v3/projects/e8db36b27300482c80044dfd353db05b/users/d8b52fde7c504f3ebb6f346d807e17ae/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:58.728375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9083c-f30a-4950-bf57-8e1dc92227d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8db36b27300482c80044dfd353db05b, user_id=d8b52fde7c504f3ebb6f346d807e17ae, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:58.733741 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9083c-f30a-4950-bf57-8e1dc92227d9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:58.734413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 907/1820] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:58.735445 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6ad62-d06d-4469-bff5-c07baca4da9d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:58.751677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6ad62-d06d-4469-bff5-c07baca4da9d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:58.772371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 914/1821] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:58 2022] PUT /identity/v3/projects/e8db36b27300482c80044dfd353db05b/users/d8b52fde7c504f3ebb6f346d807e17ae/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:58.778266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9083c-f30a-4950-bf57-8e1dc92227d9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:58.849053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c3511-d6c1-44bc-a67c-44220204870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:58.850067 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c3511-d6c1-44bc-a67c-44220204870c admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:58.850597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c3511-d6c1-44bc-a67c-44220204870c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:58.851142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c3511-d6c1-44bc-a67c-44220204870c admin admin] PATH_INFO: `/v3/projects/a3e084b667e24a7abe0fd0a409e9af00/users/99b09592b60645629b15283d90b0a6cf/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:58.864455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:58.874446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c3511-d6c1-44bc-a67c-44220204870c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e084b667e24a7abe0fd0a409e9af00, user_id=99b09592b60645629b15283d90b0a6cf, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:58.878300 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c3511-d6c1-44bc-a67c-44220204870c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:58.897508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:58.905794 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 908/1822] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:58 2022] PUT /identity/v3/projects/a3e084b667e24a7abe0fd0a409e9af00/users/99b09592b60645629b15283d90b0a6cf/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:58.910557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c3511-d6c1-44bc-a67c-44220204870c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:58.921050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9083c-f30a-4950-bf57-8e1dc92227d9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:59.012826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c3511-d6c1-44bc-a67c-44220204870c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:59.029359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7b2e6-d83c-4a76-bb61-722ee57fec56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:59.032613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7b2e6-d83c-4a76-bb61-722ee57fec56 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:59.033729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7b2e6-d83c-4a76-bb61-722ee57fec56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:59.034730 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7b2e6-d83c-4a76-bb61-722ee57fec56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:59.035917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7b2e6-d83c-4a76-bb61-722ee57fec56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:59.043425 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7b2e6-d83c-4a76-bb61-722ee57fec56 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:59.087667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 909/1823] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:59.089015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7b2e6-d83c-4a76-bb61-722ee57fec56 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:59.101914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ac440-fd0a-4c63-95bb-98be3a11f775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:59.102656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ac440-fd0a-4c63-95bb-98be3a11f775 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:59.102886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ac440-fd0a-4c63-95bb-98be3a11f775 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:59.103202 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ac440-fd0a-4c63-95bb-98be3a11f775 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:59.104216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ac440-fd0a-4c63-95bb-98be3a11f775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:59.108014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7b2e6-d83c-4a76-bb61-722ee57fec56 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:59.110638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ac440-fd0a-4c63-95bb-98be3a11f775 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:59.113444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52faa5-dfc1-4591-a472-fca6a4d50db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:59.115898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52faa5-dfc1-4591-a472-fca6a4d50db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:59.117215 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52faa5-dfc1-4591-a472-fca6a4d50db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:59.117720 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52faa5-dfc1-4591-a472-fca6a4d50db2 admin admin] PATH_INFO: `/v3/projects/a3e084b667e24a7abe0fd0a409e9af00/users/99b09592b60645629b15283d90b0a6cf/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:59.122629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52faa5-dfc1-4591-a472-fca6a4d50db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e084b667e24a7abe0fd0a409e9af00, user_id=99b09592b60645629b15283d90b0a6cf, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:59.127429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52faa5-dfc1-4591-a472-fca6a4d50db2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:59.131556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 915/1824] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:45:59.132502 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ac440-fd0a-4c63-95bb-98be3a11f775 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:59.141599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 910/1825] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:59 2022] PUT /identity/v3/projects/a3e084b667e24a7abe0fd0a409e9af00/users/99b09592b60645629b15283d90b0a6cf/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:59.151959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9011f1-be43-4379-ba2b-96cf988be56d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:59.152275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9011f1-be43-4379-ba2b-96cf988be56d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:59.152448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ac440-fd0a-4c63-95bb-98be3a11f775 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:59.152545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9011f1-be43-4379-ba2b-96cf988be56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:59.228055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4a9011f1-be43-4379-ba2b-96cf988be56d None None] MFA Rules not processed for user `99b09592b60645629b15283d90b0a6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:59.229831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4a9011f1-be43-4379-ba2b-96cf988be56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:59.264514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bc14d-df25-4731-88d3-dfee3fcafa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:59.265418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bc14d-df25-4731-88d3-dfee3fcafa7d admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:59.266956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bc14d-df25-4731-88d3-dfee3fcafa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:59.267241 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bc14d-df25-4731-88d3-dfee3fcafa7d admin admin] PATH_INFO: `/v3/projects/e8db36b27300482c80044dfd353db05b/users/d8b52fde7c504f3ebb6f346d807e17ae/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:59.275329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bc14d-df25-4731-88d3-dfee3fcafa7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8db36b27300482c80044dfd353db05b, user_id=d8b52fde7c504f3ebb6f346d807e17ae, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:59.281688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bc14d-df25-4731-88d3-dfee3fcafa7d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:59.298302 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 916/1826] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:45:59 2022] PUT /identity/v3/projects/e8db36b27300482c80044dfd353db05b/users/d8b52fde7c504f3ebb6f346d807e17ae/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:45:59.299535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bc14d-df25-4731-88d3-dfee3fcafa7d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:59.363502 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 911/1827] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:59.365329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069dbbd-869b-45ff-be84-0301dd02333f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:59.366579 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069dbbd-869b-45ff-be84-0301dd02333f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:59.367013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069dbbd-869b-45ff-be84-0301dd02333f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:59.416227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bc14d-df25-4731-88d3-dfee3fcafa7d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:59.422489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f069dbbd-869b-45ff-be84-0301dd02333f None None] MFA Rules not processed for user `d8b52fde7c504f3ebb6f346d807e17ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:45:59.424997 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb7cbf-d943-41e6-9f97-99444e195e83 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae738867dff43109492463dcb78bf2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9155d064392e4c5f83ff6235ba148575', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:59.426041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb7cbf-d943-41e6-9f97-99444e195e83 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:59.426392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb7cbf-d943-41e6-9f97-99444e195e83 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:59.426730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb7cbf-d943-41e6-9f97-99444e195e83 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:59.427519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb7cbf-d943-41e6-9f97-99444e195e83 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:59.427889 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb7cbf-d943-41e6-9f97-99444e195e83 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:59.430090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb7cbf-d943-41e6-9f97-99444e195e83 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:59.430979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f069dbbd-869b-45ff-be84-0301dd02333f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:59.448218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 917/1828] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:59.449457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb7cbf-d943-41e6-9f97-99444e195e83 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:59.451849 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-08fb7cbf-d943-41e6-9f97-99444e195e83 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:45:59.487168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:59.537064 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:45:59.558657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb7cbf-d943-41e6-9f97-99444e195e83 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:59.563651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b8d46-1102-49e8-96a8-a1451e99babe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:59.564686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b8d46-1102-49e8-96a8-a1451e99babe service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:59.565209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b8d46-1102-49e8-96a8-a1451e99babe service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:59.566002 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b8d46-1102-49e8-96a8-a1451e99babe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:59.575814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 912/1829] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:45:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:45:59.576905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069dbbd-869b-45ff-be84-0301dd02333f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:59.589982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069dbbd-869b-45ff-be84-0301dd02333f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:59.597276 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcda56-636e-4f27-a361-e9b503206f9c tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae738867dff43109492463dcb78bf2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9155d064392e4c5f83ff6235ba148575', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:59.598501 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcda56-636e-4f27-a361-e9b503206f9c tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:59.598789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcda56-636e-4f27-a361-e9b503206f9c tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:59.599071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcda56-636e-4f27-a361-e9b503206f9c tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:59.599758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcda56-636e-4f27-a361-e9b503206f9c tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:59.603256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcda56-636e-4f27-a361-e9b503206f9c tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:59.706782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 913/1830] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:45:59 2022] POST /identity/v3/projects => generated 355 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:45:59.707691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcda56-636e-4f27-a361-e9b503206f9c tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:59.731354 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b8d46-1102-49e8-96a8-a1451e99babe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:59.733052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b8d46-1102-49e8-96a8-a1451e99babe service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:59.748847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 918/1831] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:59.750085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b8d46-1102-49e8-96a8-a1451e99babe service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:59.767345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b8d46-1102-49e8-96a8-a1451e99babe service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:59.787324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcda56-636e-4f27-a361-e9b503206f9c tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:59.799370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503f119-3228-4d67-a5b0-235954f47d91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:59.800018 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503f119-3228-4d67-a5b0-235954f47d91 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:59.800301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503f119-3228-4d67-a5b0-235954f47d91 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:59.800569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503f119-3228-4d67-a5b0-235954f47d91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:59.904946 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56e548-fd87-43f9-9897-67fb398a6537 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae738867dff43109492463dcb78bf2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9155d064392e4c5f83ff6235ba148575', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:59.906202 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e548-fd87-43f9-9897-67fb398a6537 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:59.906663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e548-fd87-43f9-9897-67fb398a6537 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:59.907084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56e548-fd87-43f9-9897-67fb398a6537 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:45:59.908119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56e548-fd87-43f9-9897-67fb398a6537 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:45:59.909214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56e548-fd87-43f9-9897-67fb398a6537 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:59.912621 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56e548-fd87-43f9-9897-67fb398a6537 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:59.931845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 919/1832] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:45:59.932936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56e548-fd87-43f9-9897-67fb398a6537 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:45:59.934448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503f119-3228-4d67-a5b0-235954f47d91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:45:59.936370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503f119-3228-4d67-a5b0-235954f47d91 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:45:59.952559 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 914/1833] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:45:59.952781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56e548-fd87-43f9-9897-67fb398a6537 tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:45:59.956573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bf218-0308-4fce-bbf3-c380a9daeeff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:45:59.957266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bf218-0308-4fce-bbf3-c380a9daeeff service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:45:59.957750 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bf218-0308-4fce-bbf3-c380a9daeeff service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:45:59.958020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bf218-0308-4fce-bbf3-c380a9daeeff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:00.050580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bf218-0308-4fce-bbf3-c380a9daeeff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:00.050580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bf218-0308-4fce-bbf3-c380a9daeeff service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:00.072032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503f119-3228-4d67-a5b0-235954f47d91 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:00.086114 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 920/1834] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:45:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:00.103764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503f119-3228-4d67-a5b0-235954f47d91 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:00.122534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aae738867dff43109492463dcb78bf2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9155d064392e4c5f83ff6235ba148575', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:00.124818 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:00.125178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:00.125553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] PATH_INFO: `/v3/projects/5e2eeb25a8ca4bd785b0f1883170e96c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:00.132005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5e2eeb25a8ca4bd785b0f1883170e96c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:00.134383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:00.253446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e2eeb25a8ca4bd785b0f1883170e96c', 'request_id': 'req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:00.274543 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e2eeb25a8ca4bd785b0f1883170e96c', 'request_id': 'req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:00.279886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:00.281605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e2eeb25a8ca4bd785b0f1883170e96c', 'request_id': 'req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:00.308907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] The token cache is being invalidate because project 5e2eeb25a8ca4bd785b0f1883170e96c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:00.309273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:00.310050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-78e9e1bd-8c69-476c-97bd-34b55cae7c1f tempest-VolumeQuotaClassesTest-2017962132 tempest-VolumeQuotaClassesTest-2017962132-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:00.314587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 915/1835] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:00 2022] DELETE /identity/v3/projects/5e2eeb25a8ca4bd785b0f1883170e96c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:00.715504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bf218-0308-4fce-bbf3-c380a9daeeff service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:00.721806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:00.824487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bf218-0308-4fce-bbf3-c380a9daeeff service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:00.920016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:00.921337 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:00.921835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:00.922717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] PATH_INFO: `/v3/users/8e67c00c94174674a84eaabef8ab351d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:00.924699 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e67c00c94174674a84eaabef8ab351d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:00.927352 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:01.009537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e67c00c94174674a84eaabef8ab351d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:01.033964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e67c00c94174674a84eaabef8ab351d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:01.035476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e67c00c94174674a84eaabef8ab351d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:01.064201 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e67c00c94174674a84eaabef8ab351d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:01.065771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e67c00c94174674a84eaabef8ab351d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:01.088684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 921/1836] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:00 2022] DELETE /identity/v3/users/8e67c00c94174674a84eaabef8ab351d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:01.094266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938993f-0d67-4b7f-9695-c441f02338ec None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:01.094266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938993f-0d67-4b7f-9695-c441f02338ec None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:01.095154 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938993f-0d67-4b7f-9695-c441f02338ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:01.116629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7938993f-0d67-4b7f-9695-c441f02338ec None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:01.117914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7938993f-0d67-4b7f-9695-c441f02338ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:01.204305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 916/1837] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:01.216626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:01.217749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:01.256132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:01.302718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53956e-4757-4f0d-a0aa-974461b4e8db admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:01.307271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c3433-f250-4e3a-9545-110a6a156078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:01.307764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938993f-0d67-4b7f-9695-c441f02338ec None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:01.308068 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c3433-f250-4e3a-9545-110a6a156078 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:01.308411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c3433-f250-4e3a-9545-110a6a156078 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:01.308742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c3433-f250-4e3a-9545-110a6a156078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:01.309441 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7938993f-0d67-4b7f-9695-c441f02338ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:01.322072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c3433-f250-4e3a-9545-110a6a156078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:01.324046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c3433-f250-4e3a-9545-110a6a156078 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:01.337552 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 922/1838] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:46:01.475805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938993f-0d67-4b7f-9695-c441f02338ec None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:01.486992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280e66c-030a-4fa1-8960-ffaf99a7efd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:01.489968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280e66c-030a-4fa1-8960-ffaf99a7efd3 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:01.490259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280e66c-030a-4fa1-8960-ffaf99a7efd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:01.490536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280e66c-030a-4fa1-8960-ffaf99a7efd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:01.493320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9280e66c-030a-4fa1-8960-ffaf99a7efd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:01.597072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280e66c-030a-4fa1-8960-ffaf99a7efd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:01.599459 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280e66c-030a-4fa1-8960-ffaf99a7efd3 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:01.623873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 917/1839] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:46:01.785448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c3433-f250-4e3a-9545-110a6a156078 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:01.787106 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e42c3433-f250-4e3a-9545-110a6a156078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:01.811451 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c3433-f250-4e3a-9545-110a6a156078 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:01.821169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:01.822032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:01.822332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:01.822606 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4 admin admin] PATH_INFO: `/v3/projects/89ad05d71c9c41f693da368d6389d72c` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:01.823901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ad05d71c9c41f693da368d6389d72c)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:01.826352 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:01.935468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ad05d71c9c41f693da368d6389d72c', 'request_id': 'req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:01.948981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ad05d71c9c41f693da368d6389d72c', 'request_id': 'req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:01.965040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ad05d71c9c41f693da368d6389d72c', 'request_id': 'req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:01.987019 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4 admin admin] The token cache is being invalidate because project 89ad05d71c9c41f693da368d6389d72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:01.987314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:01.988818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cefd2ae4-0834-45c3-8bc9-5b0418f89fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:01.995666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 923/1840] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:01 2022] DELETE /identity/v3/projects/89ad05d71c9c41f693da368d6389d72c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:02.000718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280e66c-030a-4fa1-8960-ffaf99a7efd3 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:02.016094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280e66c-030a-4fa1-8960-ffaf99a7efd3 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:02.085803 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:02.112071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d06e3-23e0-4806-bfec-4d82e5fccb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:02.113029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d06e3-23e0-4806-bfec-4d82e5fccb36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:02.113341 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d06e3-23e0-4806-bfec-4d82e5fccb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:02.113618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d06e3-23e0-4806-bfec-4d82e5fccb36 admin admin] PATH_INFO: `/v3/users/aae738867dff43109492463dcb78bf2b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:02.115307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d06e3-23e0-4806-bfec-4d82e5fccb36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae738867dff43109492463dcb78bf2b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:02.117332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d06e3-23e0-4806-bfec-4d82e5fccb36 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:02.194037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a96d06e3-23e0-4806-bfec-4d82e5fccb36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae738867dff43109492463dcb78bf2b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:02.206927 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a96d06e3-23e0-4806-bfec-4d82e5fccb36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae738867dff43109492463dcb78bf2b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:02.218779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a96d06e3-23e0-4806-bfec-4d82e5fccb36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae738867dff43109492463dcb78bf2b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:02.220861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a96d06e3-23e0-4806-bfec-4d82e5fccb36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae738867dff43109492463dcb78bf2b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:02.241638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a96d06e3-23e0-4806-bfec-4d82e5fccb36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae738867dff43109492463dcb78bf2b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:02.248402 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 918/1841] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:01 2022] DELETE /identity/v3/users/aae738867dff43109492463dcb78bf2b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:02.416890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aa1e1-0e6e-4df9-9abd-0d7eec1fddc8 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:02.417528 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aa1e1-0e6e-4df9-9abd-0d7eec1fddc8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:02.417975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6aa1e1-0e6e-4df9-9abd-0d7eec1fddc8 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:02.420573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 924/1842] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 02:46:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:46:02.439995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78dec-bdb5-4d8d-9c02-dc802bf20671 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:02.440230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78dec-bdb5-4d8d-9c02-dc802bf20671 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:02.440514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78dec-bdb5-4d8d-9c02-dc802bf20671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:02.476057 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-eac78dec-bdb5-4d8d-9c02-dc802bf20671 None None] MFA Rules not processed for user `338b2744014940ca96c08d4e9262697b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:02.481339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eac78dec-bdb5-4d8d-9c02-dc802bf20671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:02.571115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 919/1843] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 02:46:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:02.654405 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78dec-bdb5-4d8d-9c02-dc802bf20671 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:02.655641 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aa1e1-0e6e-4df9-9abd-0d7eec1fddc8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:02.657025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eac78dec-bdb5-4d8d-9c02-dc802bf20671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:02.657485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0f6aa1e1-0e6e-4df9-9abd-0d7eec1fddc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:02.674784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78dec-bdb5-4d8d-9c02-dc802bf20671 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:02.687640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25a632-c9fb-4281-b7f8-0577bf36572a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:02.688652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25a632-c9fb-4281-b7f8-0577bf36572a service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:02.688652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25a632-c9fb-4281-b7f8-0577bf36572a service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:02.688844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25a632-c9fb-4281-b7f8-0577bf36572a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:02.698281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25a632-c9fb-4281-b7f8-0577bf36572a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:02.699909 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25a632-c9fb-4281-b7f8-0577bf36572a service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:02.711305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 920/1844] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:02.754127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6aa1e1-0e6e-4df9-9abd-0d7eec1fddc8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:02.760320 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d4846-9dae-4359-a5a8-6698bf801ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:02.761058 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d4846-9dae-4359-a5a8-6698bf801ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:02.761363 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d4846-9dae-4359-a5a8-6698bf801ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:02.761637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d4846-9dae-4359-a5a8-6698bf801ce7 admin admin] PATH_INFO: `/v3/projects/9155d064392e4c5f83ff6235ba148575` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:02.762840 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d4846-9dae-4359-a5a8-6698bf801ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9155d064392e4c5f83ff6235ba148575)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:02.764768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d4846-9dae-4359-a5a8-6698bf801ce7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:02.832833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fb1d4846-9dae-4359-a5a8-6698bf801ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9155d064392e4c5f83ff6235ba148575', 'request_id': 'req-fb1d4846-9dae-4359-a5a8-6698bf801ce7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:02.845626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fb1d4846-9dae-4359-a5a8-6698bf801ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9155d064392e4c5f83ff6235ba148575', 'request_id': 'req-fb1d4846-9dae-4359-a5a8-6698bf801ce7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:02.852535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:02.861876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fb1d4846-9dae-4359-a5a8-6698bf801ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9155d064392e4c5f83ff6235ba148575', 'request_id': 'req-fb1d4846-9dae-4359-a5a8-6698bf801ce7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:02.876019 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fb1d4846-9dae-4359-a5a8-6698bf801ce7 admin admin] The token cache is being invalidate because project 9155d064392e4c5f83ff6235ba148575 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:02.876306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fb1d4846-9dae-4359-a5a8-6698bf801ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:02.876979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fb1d4846-9dae-4359-a5a8-6698bf801ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:02.878630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 925/1845] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:02 2022] DELETE /identity/v3/projects/9155d064392e4c5f83ff6235ba148575 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:02.883807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554d10-2ec8-41a8-a410-d5d599b1147b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:02.884097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554d10-2ec8-41a8-a410-d5d599b1147b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:02.884368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554d10-2ec8-41a8-a410-d5d599b1147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:02.909342 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4b554d10-2ec8-41a8-a410-d5d599b1147b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:02.910737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4b554d10-2ec8-41a8-a410-d5d599b1147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:02.979336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:03.002479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 921/1846] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:03.011484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e306e-05a3-44dd-9b8d-95b55d3dbf05 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:03.011768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e306e-05a3-44dd-9b8d-95b55d3dbf05 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:03.012038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e306e-05a3-44dd-9b8d-95b55d3dbf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:03.036284 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d01e306e-05a3-44dd-9b8d-95b55d3dbf05 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:03.037628 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d01e306e-05a3-44dd-9b8d-95b55d3dbf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:03.049315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 926/1847] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:03.053863 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554d10-2ec8-41a8-a410-d5d599b1147b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:03.064381 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554d10-2ec8-41a8-a410-d5d599b1147b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:03.069753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71802ec-6235-444e-9012-f9ac937696fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:03.070401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71802ec-6235-444e-9012-f9ac937696fc admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:03.070683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71802ec-6235-444e-9012-f9ac937696fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:03.070959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71802ec-6235-444e-9012-f9ac937696fc admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:03.071677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71802ec-6235-444e-9012-f9ac937696fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:03.071984 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71802ec-6235-444e-9012-f9ac937696fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:03.073715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71802ec-6235-444e-9012-f9ac937696fc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:03.094207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 922/1848] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:46:03.094713 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e306e-05a3-44dd-9b8d-95b55d3dbf05 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:03.110508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e306e-05a3-44dd-9b8d-95b55d3dbf05 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:03.117439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e1cf3-d552-47d7-8398-ad26d1bc5c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:03.118311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e1cf3-d552-47d7-8398-ad26d1bc5c4c admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:03.118750 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e1cf3-d552-47d7-8398-ad26d1bc5c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:03.119169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e1cf3-d552-47d7-8398-ad26d1bc5c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:03.120060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e1cf3-d552-47d7-8398-ad26d1bc5c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:03.122218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e1cf3-d552-47d7-8398-ad26d1bc5c4c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:03.163673 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 927/1849] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:03 2022] POST /identity/v3/projects => generated 389 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:03.167795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71802ec-6235-444e-9012-f9ac937696fc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:03.179132 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71802ec-6235-444e-9012-f9ac937696fc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:03.257158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e53f-6b2d-418d-b308-8b9a4cc776f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:03.258282 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e53f-6b2d-418d-b308-8b9a4cc776f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:03.258781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e53f-6b2d-418d-b308-8b9a4cc776f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:03.259232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2e53f-6b2d-418d-b308-8b9a4cc776f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:03.260210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2e53f-6b2d-418d-b308-8b9a4cc776f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:03.262509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2e53f-6b2d-418d-b308-8b9a4cc776f1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:03.292815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 923/1850] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:03 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:46:03.293999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e1cf3-d552-47d7-8398-ad26d1bc5c4c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:03.310593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e1cf3-d552-47d7-8398-ad26d1bc5c4c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:03.315251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa24bf3-f49f-43e1-9ef9-8bcace046680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:03.315888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa24bf3-f49f-43e1-9ef9-8bcace046680 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:03.316167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa24bf3-f49f-43e1-9ef9-8bcace046680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:03.316443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa24bf3-f49f-43e1-9ef9-8bcace046680 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:03.317152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa24bf3-f49f-43e1-9ef9-8bcace046680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:03.318828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa24bf3-f49f-43e1-9ef9-8bcace046680 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:03.331740 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 928/1851] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:03.336283 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e53f-6b2d-418d-b308-8b9a4cc776f1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:03.353610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2e53f-6b2d-418d-b308-8b9a4cc776f1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:03.360752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61fd77-b4e4-4791-bc2f-7c2bfb7612ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:03.361506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61fd77-b4e4-4791-bc2f-7c2bfb7612ba admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:03.361863 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61fd77-b4e4-4791-bc2f-7c2bfb7612ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:03.362203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61fd77-b4e4-4791-bc2f-7c2bfb7612ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:03.362972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61fd77-b4e4-4791-bc2f-7c2bfb7612ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:03.364686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61fd77-b4e4-4791-bc2f-7c2bfb7612ba admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:03.381322 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 924/1852] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:46:03.383641 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa24bf3-f49f-43e1-9ef9-8bcace046680 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:03.395328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa24bf3-f49f-43e1-9ef9-8bcace046680 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:03.400227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802867c-2574-4f6d-ace3-bbaf071fca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:03.400924 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802867c-2574-4f6d-ace3-bbaf071fca7c admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:03.401460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802867c-2574-4f6d-ace3-bbaf071fca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:03.401565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802867c-2574-4f6d-ace3-bbaf071fca7c admin admin] PATH_INFO: `/v3/projects/eb170df93bbf4859852d0e1a82bdf69f/users/ef03a1eca8b94689955204dea799d6a1/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:03.420899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802867c-2574-4f6d-ace3-bbaf071fca7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb170df93bbf4859852d0e1a82bdf69f, user_id=ef03a1eca8b94689955204dea799d6a1, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:03.424395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802867c-2574-4f6d-ace3-bbaf071fca7c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:03.442527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 929/1853] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:03 2022] PUT /identity/v3/projects/eb170df93bbf4859852d0e1a82bdf69f/users/ef03a1eca8b94689955204dea799d6a1/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:03.463858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fb48e-0d3d-4147-bfd3-597a97dab654 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:03.463858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fb48e-0d3d-4147-bfd3-597a97dab654 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:03.463858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fb48e-0d3d-4147-bfd3-597a97dab654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:03.497505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b77fb48e-0d3d-4147-bfd3-597a97dab654 None None] MFA Rules not processed for user `ef03a1eca8b94689955204dea799d6a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:03.498735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b77fb48e-0d3d-4147-bfd3-597a97dab654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:03.566999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 925/1854] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:03.572591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802867c-2574-4f6d-ace3-bbaf071fca7c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:03.649195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802867c-2574-4f6d-ace3-bbaf071fca7c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:03.654404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c48f3b-a331-4e03-bffa-ec56c3433dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:03.655040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c48f3b-a331-4e03-bffa-ec56c3433dda admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:03.655318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c48f3b-a331-4e03-bffa-ec56c3433dda admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:03.655641 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c48f3b-a331-4e03-bffa-ec56c3433dda admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:03.656327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c48f3b-a331-4e03-bffa-ec56c3433dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:03.658339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c48f3b-a331-4e03-bffa-ec56c3433dda admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:03.705252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 930/1855] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:03 2022] POST /identity/v3/projects => generated 389 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:03.711256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fb48e-0d3d-4147-bfd3-597a97dab654 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:03.725775 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fb48e-0d3d-4147-bfd3-597a97dab654 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:03.770230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:03.801958 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c3851-00dd-4f36-a3ac-96c06efa0b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:03.802744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c3851-00dd-4f36-a3ac-96c06efa0b61 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:03.803019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c3851-00dd-4f36-a3ac-96c06efa0b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:03.803350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c3851-00dd-4f36-a3ac-96c06efa0b61 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:03.805326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c3851-00dd-4f36-a3ac-96c06efa0b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:03.806167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c3851-00dd-4f36-a3ac-96c06efa0b61 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:03.830614 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 926/1856] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:03 2022] POST /identity/v3/users => generated 301 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:03.835186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c48f3b-a331-4e03-bffa-ec56c3433dda admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:03.848725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c48f3b-a331-4e03-bffa-ec56c3433dda admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:03.854974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f896b-775f-454d-b8df-99813e06dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:03.855623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f896b-775f-454d-b8df-99813e06dfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:03.855904 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f896b-775f-454d-b8df-99813e06dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:03.856176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f896b-775f-454d-b8df-99813e06dfc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:03.856896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f896b-775f-454d-b8df-99813e06dfc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:03.858617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f896b-775f-454d-b8df-99813e06dfc2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:03.873365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 931/1857] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:46:03.875525 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c3851-00dd-4f36-a3ac-96c06efa0b61 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:03.887862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c3851-00dd-4f36-a3ac-96c06efa0b61 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:03.893617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0009c3-a514-41c7-9a2a-5e4dd07499aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:03.894360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0009c3-a514-41c7-9a2a-5e4dd07499aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:03.894748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0009c3-a514-41c7-9a2a-5e4dd07499aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:03.895560 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0009c3-a514-41c7-9a2a-5e4dd07499aa admin admin] PATH_INFO: `/v3/projects/70407c9a0f674df8be7f9129f56a855d/users/f64f2076273b49b7a49d1f953e135d92/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:03.923064 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0009c3-a514-41c7-9a2a-5e4dd07499aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=70407c9a0f674df8be7f9129f56a855d, user_id=f64f2076273b49b7a49d1f953e135d92, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:03.928407 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0009c3-a514-41c7-9a2a-5e4dd07499aa admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:03.955580 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 927/1858] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:03 2022] PUT /identity/v3/projects/70407c9a0f674df8be7f9129f56a855d/users/f64f2076273b49b7a49d1f953e135d92/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:03.959967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f896b-775f-454d-b8df-99813e06dfc2 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:03.971882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f896b-775f-454d-b8df-99813e06dfc2 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:04.029971 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:04.037298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6726c-4f63-4b9c-9eb1-b7a1768f35ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:04.037926 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6726c-4f63-4b9c-9eb1-b7a1768f35ca admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:04.038206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6726c-4f63-4b9c-9eb1-b7a1768f35ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:04.038479 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6726c-4f63-4b9c-9eb1-b7a1768f35ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:04.039199 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6726c-4f63-4b9c-9eb1-b7a1768f35ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:04.041415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6726c-4f63-4b9c-9eb1-b7a1768f35ca admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:04.054912 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 932/1859] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:04.059453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0009c3-a514-41c7-9a2a-5e4dd07499aa admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:04.070958 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0009c3-a514-41c7-9a2a-5e4dd07499aa admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:04.077300 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa23fc-3219-42c3-8c72-7d16f38b8db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:04.078008 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa23fc-3219-42c3-8c72-7d16f38b8db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:04.078299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa23fc-3219-42c3-8c72-7d16f38b8db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:04.078569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa23fc-3219-42c3-8c72-7d16f38b8db8 admin admin] PATH_INFO: `/v3/projects/70407c9a0f674df8be7f9129f56a855d/users/f64f2076273b49b7a49d1f953e135d92/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:04.080564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa23fc-3219-42c3-8c72-7d16f38b8db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70407c9a0f674df8be7f9129f56a855d, user_id=f64f2076273b49b7a49d1f953e135d92, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:04.083293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa23fc-3219-42c3-8c72-7d16f38b8db8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:04.098324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 928/1860] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:04 2022] PUT /identity/v3/projects/70407c9a0f674df8be7f9129f56a855d/users/f64f2076273b49b7a49d1f953e135d92/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:04.109851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81c944-5ee1-4789-b6b5-2e0eff7fb6ab None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:04.110119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81c944-5ee1-4789-b6b5-2e0eff7fb6ab None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:04.110393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81c944-5ee1-4789-b6b5-2e0eff7fb6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:04.145194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-bc81c944-5ee1-4789-b6b5-2e0eff7fb6ab None None] MFA Rules not processed for user `f64f2076273b49b7a49d1f953e135d92`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:04.146472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-bc81c944-5ee1-4789-b6b5-2e0eff7fb6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:04.245694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 933/1861] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:04.256736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa23fc-3219-42c3-8c72-7d16f38b8db8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:04.258579 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a6fa23fc-3219-42c3-8c72-7d16f38b8db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:04.348715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa23fc-3219-42c3-8c72-7d16f38b8db8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:04.352533 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f135e0-094b-438b-bdc4-d7532ef48d45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:04.353173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f135e0-094b-438b-bdc4-d7532ef48d45 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:04.353508 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f135e0-094b-438b-bdc4-d7532ef48d45 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:04.353783 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f135e0-094b-438b-bdc4-d7532ef48d45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:04.364609 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f135e0-094b-438b-bdc4-d7532ef48d45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:04.366117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f135e0-094b-438b-bdc4-d7532ef48d45 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:04.377143 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 929/1862] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:04.595905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81c944-5ee1-4789-b6b5-2e0eff7fb6ab None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:04.737721 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81c944-5ee1-4789-b6b5-2e0eff7fb6ab None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:04.757926 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:04.758770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:04.759150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:04.759526 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] PATH_INFO: `/v3/users/ef03a1eca8b94689955204dea799d6a1` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:04.763187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef03a1eca8b94689955204dea799d6a1)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:04.770484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:04.860619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef03a1eca8b94689955204dea799d6a1'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:04.872725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef03a1eca8b94689955204dea799d6a1'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:04.880884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef03a1eca8b94689955204dea799d6a1'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:04.899346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef03a1eca8b94689955204dea799d6a1'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:04.900626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef03a1eca8b94689955204dea799d6a1'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:04.907159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:04.928030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 934/1863] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:04 2022] DELETE /identity/v3/users/ef03a1eca8b94689955204dea799d6a1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:04.929972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0a606-e80c-4124-8304-dcede916a2e5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:04.930272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0a606-e80c-4124-8304-dcede916a2e5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:04.930587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0a606-e80c-4124-8304-dcede916a2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:04.995379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-38f0a606-e80c-4124-8304-dcede916a2e5 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:04.996636 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-38f0a606-e80c-4124-8304-dcede916a2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:05.119072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 930/1864] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:05.126493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:05.128105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:05.210913 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c69153-2aed-4b5d-b347-30f818e943a1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:05.218989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561eea0-5871-4ca7-8a7e-7e6fa66b89a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:05.221494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561eea0-5871-4ca7-8a7e-7e6fa66b89a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:05.221494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561eea0-5871-4ca7-8a7e-7e6fa66b89a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:05.221827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561eea0-5871-4ca7-8a7e-7e6fa66b89a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:05.235324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561eea0-5871-4ca7-8a7e-7e6fa66b89a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:05.236841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561eea0-5871-4ca7-8a7e-7e6fa66b89a4 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:05.253064 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 935/1865] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:05.656355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0a606-e80c-4124-8304-dcede916a2e5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:05.658411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-38f0a606-e80c-4124-8304-dcede916a2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:05.679965 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0a606-e80c-4124-8304-dcede916a2e5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:05.685609 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:05.687156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:05.687652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:05.688142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] PATH_INFO: `/v3/projects/eb170df93bbf4859852d0e1a82bdf69f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:05.690526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb170df93bbf4859852d0e1a82bdf69f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:05.697800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:05.750403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:05.781916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb170df93bbf4859852d0e1a82bdf69f', 'request_id': 'req-a9b751d7-ee60-4a25-a216-a6103ca81c31'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:05.795255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb170df93bbf4859852d0e1a82bdf69f', 'request_id': 'req-a9b751d7-ee60-4a25-a216-a6103ca81c31'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:05.802086 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb170df93bbf4859852d0e1a82bdf69f', 'request_id': 'req-a9b751d7-ee60-4a25-a216-a6103ca81c31'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:05.814586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] The token cache is being invalidate because project eb170df93bbf4859852d0e1a82bdf69f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:05.814906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:05.815545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:05.817324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 931/1866] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:05 2022] DELETE /identity/v3/projects/eb170df93bbf4859852d0e1a82bdf69f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:05.821745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561eea0-5871-4ca7-8a7e-7e6fa66b89a4 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:05.835948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561eea0-5871-4ca7-8a7e-7e6fa66b89a4 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:05.924983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:05.925925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:05.926336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:05.926704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] PATH_INFO: `/v3/users/f64f2076273b49b7a49d1f953e135d92` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:05.928196 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64f2076273b49b7a49d1f953e135d92)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:05.930409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:05.994590 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64f2076273b49b7a49d1f953e135d92'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:06.026570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64f2076273b49b7a49d1f953e135d92'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:06.027255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64f2076273b49b7a49d1f953e135d92'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:06.050766 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64f2076273b49b7a49d1f953e135d92'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:06.053796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64f2076273b49b7a49d1f953e135d92'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:06.077164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 936/1867] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:05 2022] DELETE /identity/v3/users/f64f2076273b49b7a49d1f953e135d92 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:06.394565 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:06.395330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:06.519258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b751d7-ee60-4a25-a216-a6103ca81c31 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:06.575021 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:06.577110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:06.658588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:06.660745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39da1c-0f0e-4735-8375-ed85c7046ad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:06.661627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39da1c-0f0e-4735-8375-ed85c7046ad4 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:06.661860 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39da1c-0f0e-4735-8375-ed85c7046ad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:06.662118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39da1c-0f0e-4735-8375-ed85c7046ad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:06.665944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cc39da1c-0f0e-4735-8375-ed85c7046ad4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:06.797125 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39da1c-0f0e-4735-8375-ed85c7046ad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:06.797842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8b017-8b77-4299-a9ef-1c8b16fb254c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:06.798668 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc39da1c-0f0e-4735-8375-ed85c7046ad4 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:06.806096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381ed8b-8c71-4205-9dae-6f772fda57ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:06.807386 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381ed8b-8c71-4205-9dae-6f772fda57ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:06.807938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381ed8b-8c71-4205-9dae-6f772fda57ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:06.808308 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381ed8b-8c71-4205-9dae-6f772fda57ce admin admin] PATH_INFO: `/v3/projects/70407c9a0f674df8be7f9129f56a855d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:06.811517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381ed8b-8c71-4205-9dae-6f772fda57ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=70407c9a0f674df8be7f9129f56a855d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:06.813518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381ed8b-8c71-4205-9dae-6f772fda57ce admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:06.824532 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 932/1868] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:06.961586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1381ed8b-8c71-4205-9dae-6f772fda57ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70407c9a0f674df8be7f9129f56a855d', 'request_id': 'req-1381ed8b-8c71-4205-9dae-6f772fda57ce'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:06.975284 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1381ed8b-8c71-4205-9dae-6f772fda57ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70407c9a0f674df8be7f9129f56a855d', 'request_id': 'req-1381ed8b-8c71-4205-9dae-6f772fda57ce'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:06.990637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1381ed8b-8c71-4205-9dae-6f772fda57ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70407c9a0f674df8be7f9129f56a855d', 'request_id': 'req-1381ed8b-8c71-4205-9dae-6f772fda57ce'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:07.043688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1381ed8b-8c71-4205-9dae-6f772fda57ce admin admin] The token cache is being invalidate because project 70407c9a0f674df8be7f9129f56a855d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:07.043992 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1381ed8b-8c71-4205-9dae-6f772fda57ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:07.045921 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1381ed8b-8c71-4205-9dae-6f772fda57ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:07.048791 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 937/1869] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:06 2022] DELETE /identity/v3/projects/70407c9a0f674df8be7f9129f56a855d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:07.054229 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3993bd-a644-4bc1-b44c-7e8e3dfb8b82 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:07.054569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3993bd-a644-4bc1-b44c-7e8e3dfb8b82 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:07.054764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3993bd-a644-4bc1-b44c-7e8e3dfb8b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:07.083074 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fd3993bd-a644-4bc1-b44c-7e8e3dfb8b82 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:07.084307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fd3993bd-a644-4bc1-b44c-7e8e3dfb8b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:07.114828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:07.182807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 933/1870] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:07.196940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043ab7f-f332-4222-9eab-9b7330a0452c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:07.198174 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043ab7f-f332-4222-9eab-9b7330a0452c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:07.198174 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043ab7f-f332-4222-9eab-9b7330a0452c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:07.225910 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6043ab7f-f332-4222-9eab-9b7330a0452c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:07.228437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6043ab7f-f332-4222-9eab-9b7330a0452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:07.248113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 938/1871] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:07.249654 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3993bd-a644-4bc1-b44c-7e8e3dfb8b82 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:07.268258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3993bd-a644-4bc1-b44c-7e8e3dfb8b82 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:07.279932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226f982-aedb-4fb6-bce5-decf3039dbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:07.280379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226f982-aedb-4fb6-bce5-decf3039dbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:07.280671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226f982-aedb-4fb6-bce5-decf3039dbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:07.280948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226f982-aedb-4fb6-bce5-decf3039dbd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:07.281736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226f982-aedb-4fb6-bce5-decf3039dbd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:07.282048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226f982-aedb-4fb6-bce5-decf3039dbd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:07.284102 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226f982-aedb-4fb6-bce5-decf3039dbd8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:07.301046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 934/1872] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:46:07.306184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043ab7f-f332-4222-9eab-9b7330a0452c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:07.320866 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043ab7f-f332-4222-9eab-9b7330a0452c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:07.331359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c926caa-9705-433f-8dfe-9abdd5fa32b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:07.332023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c926caa-9705-433f-8dfe-9abdd5fa32b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:07.332305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c926caa-9705-433f-8dfe-9abdd5fa32b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:07.332577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c926caa-9705-433f-8dfe-9abdd5fa32b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:07.333297 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c926caa-9705-433f-8dfe-9abdd5fa32b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:07.335281 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c926caa-9705-433f-8dfe-9abdd5fa32b4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:07.398347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 939/1873] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:07 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:07.402379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226f982-aedb-4fb6-bce5-decf3039dbd8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:07.418039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226f982-aedb-4fb6-bce5-decf3039dbd8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:07.590558 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ba15b-4789-4f1c-a9d5-122e5dd3b58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:07.592476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba15b-4789-4f1c-a9d5-122e5dd3b58a admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:07.592787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba15b-4789-4f1c-a9d5-122e5dd3b58a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:07.593067 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba15b-4789-4f1c-a9d5-122e5dd3b58a admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:07.593818 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ba15b-4789-4f1c-a9d5-122e5dd3b58a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:07.601498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ba15b-4789-4f1c-a9d5-122e5dd3b58a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:07.644747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 935/1874] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:07 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:46:07.645478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c926caa-9705-433f-8dfe-9abdd5fa32b4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:07.670108 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c926caa-9705-433f-8dfe-9abdd5fa32b4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:07.686939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29088b-566c-4a07-915b-39d5714f9b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:07.686939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29088b-566c-4a07-915b-39d5714f9b09 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:07.689703 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29088b-566c-4a07-915b-39d5714f9b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:07.691478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29088b-566c-4a07-915b-39d5714f9b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:07.692271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29088b-566c-4a07-915b-39d5714f9b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:07.693989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29088b-566c-4a07-915b-39d5714f9b09 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:07.717022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ba15b-4789-4f1c-a9d5-122e5dd3b58a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:07.729474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 940/1875] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:46:07.730040 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ba15b-4789-4f1c-a9d5-122e5dd3b58a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:07.735951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bb78f-6f5a-4447-a8dc-19ff3d32993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:07.736604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bb78f-6f5a-4447-a8dc-19ff3d32993b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:07.736911 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bb78f-6f5a-4447-a8dc-19ff3d32993b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:07.737182 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bb78f-6f5a-4447-a8dc-19ff3d32993b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:07.737964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bb78f-6f5a-4447-a8dc-19ff3d32993b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:07.739619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bb78f-6f5a-4447-a8dc-19ff3d32993b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:07.773466 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29088b-566c-4a07-915b-39d5714f9b09 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:07.787055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 936/1876] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:07.789520 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29088b-566c-4a07-915b-39d5714f9b09 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:07.813234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f07ce-7271-4e7e-b127-b7540f01f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:07.814083 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f07ce-7271-4e7e-b127-b7540f01f949 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:07.814454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f07ce-7271-4e7e-b127-b7540f01f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:07.814796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f07ce-7271-4e7e-b127-b7540f01f949 admin admin] PATH_INFO: `/v3/projects/3710edd7e3144440866816a6d7863de5/users/ba59121da54c41e7b5d6adf8b9b81d91/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:07.859675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f07ce-7271-4e7e-b127-b7540f01f949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3710edd7e3144440866816a6d7863de5, user_id=ba59121da54c41e7b5d6adf8b9b81d91, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:07.872168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f07ce-7271-4e7e-b127-b7540f01f949 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:07.899041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 941/1877] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:07 2022] PUT /identity/v3/projects/3710edd7e3144440866816a6d7863de5/users/ba59121da54c41e7b5d6adf8b9b81d91/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:07.910384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8b7c2-fb88-4899-b7c5-19d25e5cb986 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:07.910862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8b7c2-fb88-4899-b7c5-19d25e5cb986 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:07.911146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8b7c2-fb88-4899-b7c5-19d25e5cb986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:07.951149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-82c8b7c2-fb88-4899-b7c5-19d25e5cb986 None None] MFA Rules not processed for user `ba59121da54c41e7b5d6adf8b9b81d91`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:07.952897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-82c8b7c2-fb88-4899-b7c5-19d25e5cb986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:08.048673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 937/1878] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:08.062175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f07ce-7271-4e7e-b127-b7540f01f949 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:08.121638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:08.142810 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f07ce-7271-4e7e-b127-b7540f01f949 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:08.149177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee5684-e067-4271-9d70-3014bc0ebe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:08.150344 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee5684-e067-4271-9d70-3014bc0ebe59 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:08.150865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee5684-e067-4271-9d70-3014bc0ebe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:08.151459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee5684-e067-4271-9d70-3014bc0ebe59 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:08.152506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee5684-e067-4271-9d70-3014bc0ebe59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:08.155185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee5684-e067-4271-9d70-3014bc0ebe59 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:08.205347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 942/1879] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:08 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:46:08.208679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8b7c2-fb88-4899-b7c5-19d25e5cb986 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:08.223548 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8b7c2-fb88-4899-b7c5-19d25e5cb986 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:08.258928 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:08.302945 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220397f-189f-4a37-93b4-e94362a0d648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:08.303637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220397f-189f-4a37-93b4-e94362a0d648 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:08.303948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220397f-189f-4a37-93b4-e94362a0d648 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:08.304227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220397f-189f-4a37-93b4-e94362a0d648 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:08.304905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220397f-189f-4a37-93b4-e94362a0d648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:08.306885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220397f-189f-4a37-93b4-e94362a0d648 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:08.338333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 938/1880] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:08 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:08.343110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee5684-e067-4271-9d70-3014bc0ebe59 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:08.354391 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee5684-e067-4271-9d70-3014bc0ebe59 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:08.359419 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367319ad-984c-48ba-9dc6-c2993d22ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:08.360424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367319ad-984c-48ba-9dc6-c2993d22ad8b admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:08.360941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367319ad-984c-48ba-9dc6-c2993d22ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:08.361306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367319ad-984c-48ba-9dc6-c2993d22ad8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:08.362233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367319ad-984c-48ba-9dc6-c2993d22ad8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:08.364454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367319ad-984c-48ba-9dc6-c2993d22ad8b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:08.378523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 943/1881] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:08.382693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220397f-189f-4a37-93b4-e94362a0d648 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:08.393516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220397f-189f-4a37-93b4-e94362a0d648 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:08.398319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977da2b-930f-4c1d-bb26-37dd7439bf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:08.399025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977da2b-930f-4c1d-bb26-37dd7439bf8e admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:08.399304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977da2b-930f-4c1d-bb26-37dd7439bf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:08.399573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977da2b-930f-4c1d-bb26-37dd7439bf8e admin admin] PATH_INFO: `/v3/projects/6dc5321a94324032a455aaabfeae795b/users/9393834e61464fc2ae029e7a12df30b3/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:08.415951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977da2b-930f-4c1d-bb26-37dd7439bf8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc5321a94324032a455aaabfeae795b, user_id=9393834e61464fc2ae029e7a12df30b3, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:08.418721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977da2b-930f-4c1d-bb26-37dd7439bf8e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:08.434083 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 939/1882] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:08 2022] PUT /identity/v3/projects/6dc5321a94324032a455aaabfeae795b/users/9393834e61464fc2ae029e7a12df30b3/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:08.438715 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367319ad-984c-48ba-9dc6-c2993d22ad8b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:08.449745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367319ad-984c-48ba-9dc6-c2993d22ad8b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:08.531258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2520bb-8604-40d5-8749-7e58688b97e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:08.531905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2520bb-8604-40d5-8749-7e58688b97e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:08.532191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2520bb-8604-40d5-8749-7e58688b97e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:08.532468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2520bb-8604-40d5-8749-7e58688b97e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:08.533181 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2520bb-8604-40d5-8749-7e58688b97e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:08.534841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2520bb-8604-40d5-8749-7e58688b97e5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:08.545826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 944/1883] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:08.549920 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977da2b-930f-4c1d-bb26-37dd7439bf8e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:08.560742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977da2b-930f-4c1d-bb26-37dd7439bf8e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:08.565344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56e793-eb3c-4d21-b353-dd1f51a904ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:08.566189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56e793-eb3c-4d21-b353-dd1f51a904ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:08.566467 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56e793-eb3c-4d21-b353-dd1f51a904ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:08.566737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56e793-eb3c-4d21-b353-dd1f51a904ff admin admin] PATH_INFO: `/v3/projects/6dc5321a94324032a455aaabfeae795b/users/9393834e61464fc2ae029e7a12df30b3/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:08.569747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56e793-eb3c-4d21-b353-dd1f51a904ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc5321a94324032a455aaabfeae795b, user_id=9393834e61464fc2ae029e7a12df30b3, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:08.572383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56e793-eb3c-4d21-b353-dd1f51a904ff admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:08.588674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 940/1884] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:08 2022] PUT /identity/v3/projects/6dc5321a94324032a455aaabfeae795b/users/9393834e61464fc2ae029e7a12df30b3/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:08.600296 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f96c1e-4aed-4b12-bb6d-eac6bc0ae921 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:08.600626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f96c1e-4aed-4b12-bb6d-eac6bc0ae921 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:08.600847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f96c1e-4aed-4b12-bb6d-eac6bc0ae921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:08.667655 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-05f96c1e-4aed-4b12-bb6d-eac6bc0ae921 None None] MFA Rules not processed for user `9393834e61464fc2ae029e7a12df30b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:08.669842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-05f96c1e-4aed-4b12-bb6d-eac6bc0ae921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:08.751018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 945/1885] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:08.758823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56e793-eb3c-4d21-b353-dd1f51a904ff admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:08.760776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2f56e793-eb3c-4d21-b353-dd1f51a904ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:08.822285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56e793-eb3c-4d21-b353-dd1f51a904ff admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:08.825946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ecd2b-a55a-4fd2-afa1-96a661bf1617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:08.826590 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ecd2b-a55a-4fd2-afa1-96a661bf1617 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:08.826872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ecd2b-a55a-4fd2-afa1-96a661bf1617 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:08.827141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ecd2b-a55a-4fd2-afa1-96a661bf1617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:08.837516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ecd2b-a55a-4fd2-afa1-96a661bf1617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:08.839026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ecd2b-a55a-4fd2-afa1-96a661bf1617 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:08.849961 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 941/1886] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:09.338823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f96c1e-4aed-4b12-bb6d-eac6bc0ae921 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:09.459884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:09.500424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f96c1e-4aed-4b12-bb6d-eac6bc0ae921 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:09.507560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:09.508352 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:09.508896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:09.509178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] PATH_INFO: `/v3/users/ba59121da54c41e7b5d6adf8b9b81d91` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:09.510638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba59121da54c41e7b5d6adf8b9b81d91)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:09.512593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:09.583315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba59121da54c41e7b5d6adf8b9b81d91'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:09.592305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba59121da54c41e7b5d6adf8b9b81d91'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:09.593405 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba59121da54c41e7b5d6adf8b9b81d91'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:09.616311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba59121da54c41e7b5d6adf8b9b81d91'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:09.617126 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba59121da54c41e7b5d6adf8b9b81d91'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:09.646813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 946/1887] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:09 2022] DELETE /identity/v3/users/ba59121da54c41e7b5d6adf8b9b81d91 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:09.651604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d215f-c9f6-414d-8268-ca39540fa419 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:09.651846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d215f-c9f6-414d-8268-ca39540fa419 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:09.652123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d215f-c9f6-414d-8268-ca39540fa419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:09.676769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-188d215f-c9f6-414d-8268-ca39540fa419 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:09.678105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-188d215f-c9f6-414d-8268-ca39540fa419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:09.813034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 942/1888] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:09.823753 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:09.825403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:09.895735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66de876-9f85-40c4-9438-e8d3d9945384 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:09.899647 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28798d-80d0-4c54-9e4a-5c0597131af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:09.900403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28798d-80d0-4c54-9e4a-5c0597131af7 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:09.900583 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28798d-80d0-4c54-9e4a-5c0597131af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:09.900831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28798d-80d0-4c54-9e4a-5c0597131af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:09.922805 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28798d-80d0-4c54-9e4a-5c0597131af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:09.924825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28798d-80d0-4c54-9e4a-5c0597131af7 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:09.941054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 947/1889] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:09.976288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d215f-c9f6-414d-8268-ca39540fa419 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:09.978660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-188d215f-c9f6-414d-8268-ca39540fa419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:10.009802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d215f-c9f6-414d-8268-ca39540fa419 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:10.016091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:10.016984 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:10.017455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:10.017899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] PATH_INFO: `/v3/users/45a4091f735148208ea8056bf045d1e1` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:10.019476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a4091f735148208ea8056bf045d1e1)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:10.022957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:10.039866 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:10.088782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a4091f735148208ea8056bf045d1e1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.098029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a4091f735148208ea8056bf045d1e1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.108734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a4091f735148208ea8056bf045d1e1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.109457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a4091f735148208ea8056bf045d1e1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.138636 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a4091f735148208ea8056bf045d1e1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.153378 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 943/1890] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:09 2022] DELETE /identity/v3/users/45a4091f735148208ea8056bf045d1e1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:10.155652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdf727-2bf6-4f6b-a4b9-ee74daca422d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:10.155977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdf727-2bf6-4f6b-a4b9-ee74daca422d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:10.156283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdf727-2bf6-4f6b-a4b9-ee74daca422d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:10.179446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-81fdf727-2bf6-4f6b-a4b9-ee74daca422d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:10.180675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-81fdf727-2bf6-4f6b-a4b9-ee74daca422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:10.263866 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 948/1891] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:10.275658 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:10.278828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:10.279979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdf727-2bf6-4f6b-a4b9-ee74daca422d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:10.281563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-81fdf727-2bf6-4f6b-a4b9-ee74daca422d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:10.291722 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:10.307794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdf727-2bf6-4f6b-a4b9-ee74daca422d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:10.314900 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:10.315566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:10.315882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:10.316094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] PATH_INFO: `/v3/projects/3710edd7e3144440866816a6d7863de5` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:10.317297 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3710edd7e3144440866816a6d7863de5)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:10.319292 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:10.372162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b810bb-265c-4b82-a690-aa662b778f36 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:10.377246 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3710edd7e3144440866816a6d7863de5', 'request_id': 'req-0fd9568b-b2f2-4301-9861-27a8c53034ca'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.387168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3710edd7e3144440866816a6d7863de5', 'request_id': 'req-0fd9568b-b2f2-4301-9861-27a8c53034ca'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.396929 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3710edd7e3144440866816a6d7863de5', 'request_id': 'req-0fd9568b-b2f2-4301-9861-27a8c53034ca'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.410161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] The token cache is being invalidate because project 3710edd7e3144440866816a6d7863de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:10.410496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.411141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.413079 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 949/1892] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:10 2022] DELETE /identity/v3/projects/3710edd7e3144440866816a6d7863de5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:10.416897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:10.418295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:10.462088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe734fc-5fa4-4bc2-8abf-4c7f98b46596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:10.462758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe734fc-5fa4-4bc2-8abf-4c7f98b46596 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:10.463100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe734fc-5fa4-4bc2-8abf-4c7f98b46596 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:10.463396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe734fc-5fa4-4bc2-8abf-4c7f98b46596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:10.466506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-abe734fc-5fa4-4bc2-8abf-4c7f98b46596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:10.545123 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9568b-b2f2-4301-9861-27a8c53034ca admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:10.550440 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:10.551258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:10.551902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:10.552614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] PATH_INFO: `/v3/users/9393834e61464fc2ae029e7a12df30b3` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:10.553776 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9393834e61464fc2ae029e7a12df30b3)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:10.556188 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:10.567953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe734fc-5fa4-4bc2-8abf-4c7f98b46596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:10.569686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe734fc-5fa4-4bc2-8abf-4c7f98b46596 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:10.581938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:10.590069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 944/1893] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:10.632185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9393834e61464fc2ae029e7a12df30b3'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.647345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9393834e61464fc2ae029e7a12df30b3'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.649729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9393834e61464fc2ae029e7a12df30b3'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.673506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9393834e61464fc2ae029e7a12df30b3'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.674504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9393834e61464fc2ae029e7a12df30b3'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:10.697714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 950/1894] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:10 2022] DELETE /identity/v3/users/9393834e61464fc2ae029e7a12df30b3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:11.692028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe734fc-5fa4-4bc2-8abf-4c7f98b46596 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:11.693663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-abe734fc-5fa4-4bc2-8abf-4c7f98b46596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:11.717503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe734fc-5fa4-4bc2-8abf-4c7f98b46596 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:11.855624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:11.857066 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:11.857066 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:11.857066 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] PATH_INFO: `/v3/projects/ea9aec288f1a4118b53c9a69b4ef477d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:11.858330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9aec288f1a4118b53c9a69b4ef477d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:11.860423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:11.956262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9aec288f1a4118b53c9a69b4ef477d', 'request_id': 'req-f7b46250-ae45-4d5f-8f71-ce962787dbae'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:11.971707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9aec288f1a4118b53c9a69b4ef477d', 'request_id': 'req-f7b46250-ae45-4d5f-8f71-ce962787dbae'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:11.984369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9aec288f1a4118b53c9a69b4ef477d', 'request_id': 'req-f7b46250-ae45-4d5f-8f71-ce962787dbae'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:12.005125 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] The token cache is being invalidate because project ea9aec288f1a4118b53c9a69b4ef477d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:12.006823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:12.007785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:12.010800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 945/1895] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:11 2022] DELETE /identity/v3/projects/ea9aec288f1a4118b53c9a69b4ef477d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:12.015594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:12.018113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:12.031502 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:12.036143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36267e-2e96-443d-ba4b-40fd3912998f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:12.132637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a463ba-724b-4a00-98df-425eb25edce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:12.133523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a463ba-724b-4a00-98df-425eb25edce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:12.133878 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a463ba-724b-4a00-98df-425eb25edce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:12.134210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a463ba-724b-4a00-98df-425eb25edce5 admin admin] PATH_INFO: `/v3/users/3c8f411821c544dc976494b87348bd7a` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:12.135576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a463ba-724b-4a00-98df-425eb25edce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8f411821c544dc976494b87348bd7a)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:12.137935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a463ba-724b-4a00-98df-425eb25edce5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:12.177487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:12.179229 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:12.194551 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b46250-ae45-4d5f-8f71-ce962787dbae admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:12.200277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129deeb-a781-4c1c-882f-465e5d25d43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:12.201064 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129deeb-a781-4c1c-882f-465e5d25d43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:12.201485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129deeb-a781-4c1c-882f-465e5d25d43b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:12.202073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129deeb-a781-4c1c-882f-465e5d25d43b admin admin] PATH_INFO: `/v3/projects/6dc5321a94324032a455aaabfeae795b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:12.203401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129deeb-a781-4c1c-882f-465e5d25d43b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc5321a94324032a455aaabfeae795b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:12.205780 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129deeb-a781-4c1c-882f-465e5d25d43b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:12.215990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c2a463ba-724b-4a00-98df-425eb25edce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8f411821c544dc976494b87348bd7a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:12.270015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c2a463ba-724b-4a00-98df-425eb25edce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8f411821c544dc976494b87348bd7a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:12.271932 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c2a463ba-724b-4a00-98df-425eb25edce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8f411821c544dc976494b87348bd7a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:12.290029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c2a463ba-724b-4a00-98df-425eb25edce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8f411821c544dc976494b87348bd7a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:12.290719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c2a463ba-724b-4a00-98df-425eb25edce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8f411821c544dc976494b87348bd7a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:12.331516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7129deeb-a781-4c1c-882f-465e5d25d43b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc5321a94324032a455aaabfeae795b', 'request_id': 'req-7129deeb-a781-4c1c-882f-465e5d25d43b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:12.351815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7129deeb-a781-4c1c-882f-465e5d25d43b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc5321a94324032a455aaabfeae795b', 'request_id': 'req-7129deeb-a781-4c1c-882f-465e5d25d43b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:12.361482 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7129deeb-a781-4c1c-882f-465e5d25d43b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc5321a94324032a455aaabfeae795b', 'request_id': 'req-7129deeb-a781-4c1c-882f-465e5d25d43b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:12.370652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 951/1896] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:12 2022] DELETE /identity/v3/users/3c8f411821c544dc976494b87348bd7a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:12.384370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7129deeb-a781-4c1c-882f-465e5d25d43b admin admin] The token cache is being invalidate because project 6dc5321a94324032a455aaabfeae795b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:12.384667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7129deeb-a781-4c1c-882f-465e5d25d43b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:12.386833 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7129deeb-a781-4c1c-882f-465e5d25d43b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:12.394129 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 946/1897] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:12 2022] DELETE /identity/v3/projects/6dc5321a94324032a455aaabfeae795b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:12.396291 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b15d8-e6a1-426c-972f-903d9dbfaf95 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:12.396589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b15d8-e6a1-426c-972f-903d9dbfaf95 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:12.397513 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b15d8-e6a1-426c-972f-903d9dbfaf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:12.433275 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4b3b15d8-e6a1-426c-972f-903d9dbfaf95 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:12.434616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4b3b15d8-e6a1-426c-972f-903d9dbfaf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:12.503155 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 952/1898] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:12.512217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de10986-1449-4a3b-a69b-89688e6a2687 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:12.512555 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de10986-1449-4a3b-a69b-89688e6a2687 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:12.512789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de10986-1449-4a3b-a69b-89688e6a2687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:12.536108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3de10986-1449-4a3b-a69b-89688e6a2687 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:12.537687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3de10986-1449-4a3b-a69b-89688e6a2687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:12.547490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 947/1899] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:12.552136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b15d8-e6a1-426c-972f-903d9dbfaf95 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:12.570683 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b15d8-e6a1-426c-972f-903d9dbfaf95 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:12.577297 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba746920-9207-4ade-9841-7420b19d403c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:12.578478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746920-9207-4ade-9841-7420b19d403c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:12.578478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746920-9207-4ade-9841-7420b19d403c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:12.578478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba746920-9207-4ade-9841-7420b19d403c admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:12.579282 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba746920-9207-4ade-9841-7420b19d403c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:12.579891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba746920-9207-4ade-9841-7420b19d403c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:12.582217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba746920-9207-4ade-9841-7420b19d403c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:12.600963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 953/1900] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:46:12.607083 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de10986-1449-4a3b-a69b-89688e6a2687 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:12.613125 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:12.626504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de10986-1449-4a3b-a69b-89688e6a2687 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:12.639414 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7ba13-e51c-4161-ab4a-76e5dd837d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:12.640284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7ba13-e51c-4161-ab4a-76e5dd837d7d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:12.640651 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7ba13-e51c-4161-ab4a-76e5dd837d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:12.641046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7ba13-e51c-4161-ab4a-76e5dd837d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:12.642139 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7ba13-e51c-4161-ab4a-76e5dd837d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:12.645208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7ba13-e51c-4161-ab4a-76e5dd837d7d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:12.698894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 948/1901] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:12 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:12.699493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba746920-9207-4ade-9841-7420b19d403c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:12.717186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba746920-9207-4ade-9841-7420b19d403c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:12.744167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:12.824341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4447323-5518-4c28-b74d-7c8b29c4855f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:12.825107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4447323-5518-4c28-b74d-7c8b29c4855f admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:12.825550 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4447323-5518-4c28-b74d-7c8b29c4855f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:12.825883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4447323-5518-4c28-b74d-7c8b29c4855f admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:12.826760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4447323-5518-4c28-b74d-7c8b29c4855f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:12.828992 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4447323-5518-4c28-b74d-7c8b29c4855f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:12.864834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 954/1902] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:12 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:12.867927 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7ba13-e51c-4161-ab4a-76e5dd837d7d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:12.888917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7ba13-e51c-4161-ab4a-76e5dd837d7d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:12.898456 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5e0ee-ea2f-4e0e-ae78-baf7f072fcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:12.899394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5e0ee-ea2f-4e0e-ae78-baf7f072fcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:12.899816 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5e0ee-ea2f-4e0e-ae78-baf7f072fcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:12.900588 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5e0ee-ea2f-4e0e-ae78-baf7f072fcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:12.902492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5e0ee-ea2f-4e0e-ae78-baf7f072fcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:12.904387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5e0ee-ea2f-4e0e-ae78-baf7f072fcd7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:12.919287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 949/1903] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:12.923247 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4447323-5518-4c28-b74d-7c8b29c4855f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:12.936143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4447323-5518-4c28-b74d-7c8b29c4855f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:12.942742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1edafe-6936-4e38-971b-4bddcb86ea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:12.943718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1edafe-6936-4e38-971b-4bddcb86ea6c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:12.944141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1edafe-6936-4e38-971b-4bddcb86ea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:12.944561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1edafe-6936-4e38-971b-4bddcb86ea6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:12.945507 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1edafe-6936-4e38-971b-4bddcb86ea6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:12.947499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1edafe-6936-4e38-971b-4bddcb86ea6c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:12.963663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 955/1904] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:12.968289 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5e0ee-ea2f-4e0e-ae78-baf7f072fcd7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:12.984881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5e0ee-ea2f-4e0e-ae78-baf7f072fcd7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:12.994022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fabc02-275e-46af-b7fb-1c86bdea863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:12.995006 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fabc02-275e-46af-b7fb-1c86bdea863b admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:12.995427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fabc02-275e-46af-b7fb-1c86bdea863b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:12.996165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fabc02-275e-46af-b7fb-1c86bdea863b admin admin] PATH_INFO: `/v3/projects/8fd4983b364a40a496c1ffb5c42a178d/users/dd9cea39bdd74499b1dadeb947f3d449/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:13.018252 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fabc02-275e-46af-b7fb-1c86bdea863b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd4983b364a40a496c1ffb5c42a178d, user_id=dd9cea39bdd74499b1dadeb947f3d449, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:13.021886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fabc02-275e-46af-b7fb-1c86bdea863b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:13.050092 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 950/1905] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:12 2022] PUT /identity/v3/projects/8fd4983b364a40a496c1ffb5c42a178d/users/dd9cea39bdd74499b1dadeb947f3d449/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:13.053922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af0b9-9b01-4996-ace7-26aad30cf4dd None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:13.054426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af0b9-9b01-4996-ace7-26aad30cf4dd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:13.055280 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6af0b9-9b01-4996-ace7-26aad30cf4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:13.071691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fabc02-275e-46af-b7fb-1c86bdea863b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:13.075007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-45fabc02-275e-46af-b7fb-1c86bdea863b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:13.090845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5e6af0b9-9b01-4996-ace7-26aad30cf4dd None None] MFA Rules not processed for user `dd9cea39bdd74499b1dadeb947f3d449`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:13.092770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5e6af0b9-9b01-4996-ace7-26aad30cf4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:13.195021 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 956/1906] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:13.210645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fabc02-275e-46af-b7fb-1c86bdea863b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:13.212828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6af0b9-9b01-4996-ace7-26aad30cf4dd None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:13.215696 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5e6af0b9-9b01-4996-ace7-26aad30cf4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:13.219811 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:13.220507 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:13.220800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:13.221078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] PATH_INFO: `/v3/projects/5829aa71cc9243ed819c1fca9050e900` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:13.223191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5829aa71cc9243ed819c1fca9050e900)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:13.225226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:13.288557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6af0b9-9b01-4996-ace7-26aad30cf4dd None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:13.293402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5676dc-595a-47b8-b1f0-359c85064422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:13.294750 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5676dc-595a-47b8-b1f0-359c85064422 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:13.295276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5676dc-595a-47b8-b1f0-359c85064422 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:13.295649 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5676dc-595a-47b8-b1f0-359c85064422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:13.308836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5676dc-595a-47b8-b1f0-359c85064422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:13.310508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5676dc-595a-47b8-b1f0-359c85064422 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:13.323654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 957/1907] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:46:13.349909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5676dc-595a-47b8-b1f0-359c85064422 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:13.362233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5676dc-595a-47b8-b1f0-359c85064422 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:13.383219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5829aa71cc9243ed819c1fca9050e900', 'request_id': 'req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.383717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:13.400198 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5829aa71cc9243ed819c1fca9050e900', 'request_id': 'req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.413647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5829aa71cc9243ed819c1fca9050e900', 'request_id': 'req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.439700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] The token cache is being invalidate because project 5829aa71cc9243ed819c1fca9050e900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:13.439909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05077550-2214-4030-ba44-e7253e4b3856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:13.440352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.440489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077550-2214-4030-ba44-e7253e4b3856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:13.440841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077550-2214-4030-ba44-e7253e4b3856 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:13.441188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.441319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077550-2214-4030-ba44-e7253e4b3856 admin admin] PATH_INFO: `/v3/users/dd9cea39bdd74499b1dadeb947f3d449` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:13.442508 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05077550-2214-4030-ba44-e7253e4b3856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9cea39bdd74499b1dadeb947f3d449)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:13.446203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 951/1908] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:13 2022] DELETE /identity/v3/projects/5829aa71cc9243ed819c1fca9050e900 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:13.446356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05077550-2214-4030-ba44-e7253e4b3856 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:13.447376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:13.448876 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:13.468262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa619b-18c5-44db-9bd5-4b5f951aa00c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:13.474126 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:13.474935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:13.475288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:13.475634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] PATH_INFO: `/v3/users/d8b52fde7c504f3ebb6f346d807e17ae` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:13.476991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b52fde7c504f3ebb6f346d807e17ae)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:13.479167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:13.525570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-05077550-2214-4030-ba44-e7253e4b3856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9cea39bdd74499b1dadeb947f3d449'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.535228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-05077550-2214-4030-ba44-e7253e4b3856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9cea39bdd74499b1dadeb947f3d449'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.536087 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-05077550-2214-4030-ba44-e7253e4b3856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9cea39bdd74499b1dadeb947f3d449'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.549710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:13.559120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-05077550-2214-4030-ba44-e7253e4b3856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9cea39bdd74499b1dadeb947f3d449'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.560186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-05077550-2214-4030-ba44-e7253e4b3856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9cea39bdd74499b1dadeb947f3d449'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.579373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b52fde7c504f3ebb6f346d807e17ae'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.592929 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 958/1909] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:13 2022] DELETE /identity/v3/users/dd9cea39bdd74499b1dadeb947f3d449 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:13.597575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8775-c20e-4c5a-8efa-ba86838dc737 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:13.597804 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8775-c20e-4c5a-8efa-ba86838dc737 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:13.598140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc8775-c20e-4c5a-8efa-ba86838dc737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:13.598314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b52fde7c504f3ebb6f346d807e17ae'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.616873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b52fde7c504f3ebb6f346d807e17ae'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.617735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b52fde7c504f3ebb6f346d807e17ae'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.631800 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5edc8775-c20e-4c5a-8efa-ba86838dc737 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:13.633239 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5edc8775-c20e-4c5a-8efa-ba86838dc737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:13.637700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b52fde7c504f3ebb6f346d807e17ae'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:13.650209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 952/1910] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:13 2022] DELETE /identity/v3/users/d8b52fde7c504f3ebb6f346d807e17ae => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:13.772076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 959/1911] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:13.791007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:13.793328 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:13.935246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bbff0-43c8-4d44-b49d-c9f6bdb674f1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:13.939716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62993f7-3be4-4f2e-9279-0a0c0fdd4fec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:13.940573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62993f7-3be4-4f2e-9279-0a0c0fdd4fec service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:13.941319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62993f7-3be4-4f2e-9279-0a0c0fdd4fec service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:13.941319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62993f7-3be4-4f2e-9279-0a0c0fdd4fec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:14.085355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62993f7-3be4-4f2e-9279-0a0c0fdd4fec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:14.086851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62993f7-3be4-4f2e-9279-0a0c0fdd4fec service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:14.108147 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 953/1912] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:14.195307 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc8775-c20e-4c5a-8efa-ba86838dc737 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:14.197360 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5edc8775-c20e-4c5a-8efa-ba86838dc737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:14.215761 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc8775-c20e-4c5a-8efa-ba86838dc737 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:14.231046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bfcac-6ada-40df-9de1-3e326882a42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:14.232644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bfcac-6ada-40df-9de1-3e326882a42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:14.232853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bfcac-6ada-40df-9de1-3e326882a42c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:14.233148 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bfcac-6ada-40df-9de1-3e326882a42c admin admin] PATH_INFO: `/v3/projects/e8db36b27300482c80044dfd353db05b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:14.235258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bfcac-6ada-40df-9de1-3e326882a42c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8db36b27300482c80044dfd353db05b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:14.239012 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bfcac-6ada-40df-9de1-3e326882a42c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:14.312101 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:14.324129 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-873bfcac-6ada-40df-9de1-3e326882a42c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8db36b27300482c80044dfd353db05b', 'request_id': 'req-873bfcac-6ada-40df-9de1-3e326882a42c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:14.334870 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-873bfcac-6ada-40df-9de1-3e326882a42c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8db36b27300482c80044dfd353db05b', 'request_id': 'req-873bfcac-6ada-40df-9de1-3e326882a42c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:14.344485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-873bfcac-6ada-40df-9de1-3e326882a42c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8db36b27300482c80044dfd353db05b', 'request_id': 'req-873bfcac-6ada-40df-9de1-3e326882a42c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:14.364942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-873bfcac-6ada-40df-9de1-3e326882a42c admin admin] The token cache is being invalidate because project e8db36b27300482c80044dfd353db05b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:14.366116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-873bfcac-6ada-40df-9de1-3e326882a42c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:14.367096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-873bfcac-6ada-40df-9de1-3e326882a42c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:14.368956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 960/1913] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:14 2022] DELETE /identity/v3/projects/e8db36b27300482c80044dfd353db05b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:14.375112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4681c5-b9cd-428e-9279-fb9fd496d856 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:14.375393 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4681c5-b9cd-428e-9279-fb9fd496d856 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:14.375753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4681c5-b9cd-428e-9279-fb9fd496d856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:14.408261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-af4681c5-b9cd-428e-9279-fb9fd496d856 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:14.409787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-af4681c5-b9cd-428e-9279-fb9fd496d856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:14.482408 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:14.495986 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 954/1914] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:14.506554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fd2a0-447d-4a4e-ac2e-ab10afc9fc2d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:14.506554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fd2a0-447d-4a4e-ac2e-ab10afc9fc2d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:14.507000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fd2a0-447d-4a4e-ac2e-ab10afc9fc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:14.528983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b86fd2a0-447d-4a4e-ac2e-ab10afc9fc2d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:14.530403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b86fd2a0-447d-4a4e-ac2e-ab10afc9fc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:14.546262 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 961/1915] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:14.549379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4681c5-b9cd-428e-9279-fb9fd496d856 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:14.561616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4681c5-b9cd-428e-9279-fb9fd496d856 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:14.569572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ab1b0-74be-403e-bd4b-d80ad52952e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:14.570493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ab1b0-74be-403e-bd4b-d80ad52952e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:14.571052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ab1b0-74be-403e-bd4b-d80ad52952e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:14.571490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ab1b0-74be-403e-bd4b-d80ad52952e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:14.572398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ab1b0-74be-403e-bd4b-d80ad52952e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:14.572892 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ab1b0-74be-403e-bd4b-d80ad52952e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:14.585600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fd2a0-447d-4a4e-ac2e-ab10afc9fc2d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:14.587439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b86fd2a0-447d-4a4e-ac2e-ab10afc9fc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:14.589912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158ab1b0-74be-403e-bd4b-d80ad52952e2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:14.617445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fd2a0-447d-4a4e-ac2e-ab10afc9fc2d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:14.621858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 955/1916] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:46:14.626264 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ab1b0-74be-403e-bd4b-d80ad52952e2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:14.646049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:14.646734 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:14.647013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:14.647290 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf admin admin] PATH_INFO: `/v3/projects/8fd4983b364a40a496c1ffb5c42a178d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:14.648098 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ab1b0-74be-403e-bd4b-d80ad52952e2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:14.663836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54470142-175f-471f-a703-65d89016109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:14.664589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54470142-175f-471f-a703-65d89016109e admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:14.665836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd4983b364a40a496c1ffb5c42a178d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:14.666089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54470142-175f-471f-a703-65d89016109e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:14.666490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54470142-175f-471f-a703-65d89016109e admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:14.669402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:14.670281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54470142-175f-471f-a703-65d89016109e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:14.675077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54470142-175f-471f-a703-65d89016109e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:14.732663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 956/1917] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:14 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:14.736595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54470142-175f-471f-a703-65d89016109e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:14.741648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd4983b364a40a496c1ffb5c42a178d', 'request_id': 'req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:14.753214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd4983b364a40a496c1ffb5c42a178d', 'request_id': 'req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:14.767299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd4983b364a40a496c1ffb5c42a178d', 'request_id': 'req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:14.783580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf admin admin] The token cache is being invalidate because project 8fd4983b364a40a496c1ffb5c42a178d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:14.783878 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:14.785322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45bfb0ce-bb60-439c-b7c2-eb4a7b667ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:14.787142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 962/1918] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:14 2022] DELETE /identity/v3/projects/8fd4983b364a40a496c1ffb5c42a178d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:14.793318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b04b25-661e-4ea7-98ce-128b3de02dd3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:14.793318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b04b25-661e-4ea7-98ce-128b3de02dd3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:14.793756 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b04b25-661e-4ea7-98ce-128b3de02dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:14.818007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d3b04b25-661e-4ea7-98ce-128b3de02dd3 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:14.819273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d3b04b25-661e-4ea7-98ce-128b3de02dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:14.847191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54470142-175f-471f-a703-65d89016109e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:14.852700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04edf55-1739-41ca-a96b-b5999fc8e59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:14.853114 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04edf55-1739-41ca-a96b-b5999fc8e59a admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:14.853457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04edf55-1739-41ca-a96b-b5999fc8e59a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:14.853735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04edf55-1739-41ca-a96b-b5999fc8e59a admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:14.854491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04edf55-1739-41ca-a96b-b5999fc8e59a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:14.856631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04edf55-1739-41ca-a96b-b5999fc8e59a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:14.882603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 957/1919] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:14 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:14.886432 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04edf55-1739-41ca-a96b-b5999fc8e59a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:14.888670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b04edf55-1739-41ca-a96b-b5999fc8e59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:14.907237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04edf55-1739-41ca-a96b-b5999fc8e59a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:14.913874 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ff519-f059-4da1-971e-3cb1e26898b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:14.914854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ff519-f059-4da1-971e-3cb1e26898b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:14.915151 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ff519-f059-4da1-971e-3cb1e26898b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:14.915582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ff519-f059-4da1-971e-3cb1e26898b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:14.916567 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ff519-f059-4da1-971e-3cb1e26898b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:14.918005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 963/1920] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:14.918393 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ff519-f059-4da1-971e-3cb1e26898b6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:14.925439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642d453-16e0-4ca1-91d7-b2a871067fe0 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:14.926449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642d453-16e0-4ca1-91d7-b2a871067fe0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:14.926806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642d453-16e0-4ca1-91d7-b2a871067fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:14.932994 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 958/1921] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:14.936888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ff519-f059-4da1-971e-3cb1e26898b6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:14.948443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ff519-f059-4da1-971e-3cb1e26898b6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:14.951191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0642d453-16e0-4ca1-91d7-b2a871067fe0 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:14.952751 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0642d453-16e0-4ca1-91d7-b2a871067fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:14.954756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e4337-f9ca-42da-9d6c-551aac6c69bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:14.955708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e4337-f9ca-42da-9d6c-551aac6c69bd admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:14.956157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e4337-f9ca-42da-9d6c-551aac6c69bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:14.956589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e4337-f9ca-42da-9d6c-551aac6c69bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:14.957680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e4337-f9ca-42da-9d6c-551aac6c69bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:14.959804 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e4337-f9ca-42da-9d6c-551aac6c69bd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:14.963322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 964/1922] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:14.972131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642d453-16e0-4ca1-91d7-b2a871067fe0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:14.977320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 959/1923] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:14.980123 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642d453-16e0-4ca1-91d7-b2a871067fe0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:14.981339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e4337-f9ca-42da-9d6c-551aac6c69bd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:14.985114 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bf710-17d3-492d-8c3b-2a4d2e674cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:14.986219 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bf710-17d3-492d-8c3b-2a4d2e674cad admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:14.986507 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bf710-17d3-492d-8c3b-2a4d2e674cad admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:14.986784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bf710-17d3-492d-8c3b-2a4d2e674cad admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:14.987767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bf710-17d3-492d-8c3b-2a4d2e674cad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:14.988128 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bf710-17d3-492d-8c3b-2a4d2e674cad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:14.990493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bf710-17d3-492d-8c3b-2a4d2e674cad admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:14.996018 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e4337-f9ca-42da-9d6c-551aac6c69bd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.001804 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bea557-2c94-44f6-a3bd-b174ec2d04fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.002910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea557-2c94-44f6-a3bd-b174ec2d04fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.003351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea557-2c94-44f6-a3bd-b174ec2d04fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.003807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea557-2c94-44f6-a3bd-b174ec2d04fe admin admin] PATH_INFO: `/v3/projects/adb892d32dc2421e9a1c491aed2729d6/users/6f298ed4c3ae41baa6b4f8accff35ec2/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.009379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 965/1924] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:46:15.010545 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bf710-17d3-492d-8c3b-2a4d2e674cad admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:15.026109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bea557-2c94-44f6-a3bd-b174ec2d04fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb892d32dc2421e9a1c491aed2729d6, user_id=6f298ed4c3ae41baa6b4f8accff35ec2, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:15.029986 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bea557-2c94-44f6-a3bd-b174ec2d04fe admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:15.030718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bf710-17d3-492d-8c3b-2a4d2e674cad admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.037772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9b5d4-86ec-40ee-a490-14e207427e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.038415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9b5d4-86ec-40ee-a490-14e207427e91 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.038700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9b5d4-86ec-40ee-a490-14e207427e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.038991 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9b5d4-86ec-40ee-a490-14e207427e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.039671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9b5d4-86ec-40ee-a490-14e207427e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:15.042232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9b5d4-86ec-40ee-a490-14e207427e91 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:15.049343 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 960/1925] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:14 2022] PUT /identity/v3/projects/adb892d32dc2421e9a1c491aed2729d6/users/6f298ed4c3ae41baa6b4f8accff35ec2/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:15.057604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1e226-af38-42fb-b7d7-afe2fac2a187 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.057990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1e226-af38-42fb-b7d7-afe2fac2a187 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.058341 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1e226-af38-42fb-b7d7-afe2fac2a187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.070603 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:15.080682 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 966/1926] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:15 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:15.084485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9b5d4-86ec-40ee-a490-14e207427e91 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:15.094016 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-83f1e226-af38-42fb-b7d7-afe2fac2a187 None None] MFA Rules not processed for user `6f298ed4c3ae41baa6b4f8accff35ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:15.095268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-83f1e226-af38-42fb-b7d7-afe2fac2a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:15.163052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9b5d4-86ec-40ee-a490-14e207427e91 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.167876 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:15.172458 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67f797-9843-4f89-ac78-aaadc70da874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.173192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67f797-9843-4f89-ac78-aaadc70da874 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.173479 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67f797-9843-4f89-ac78-aaadc70da874 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.173797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67f797-9843-4f89-ac78-aaadc70da874 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.174521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67f797-9843-4f89-ac78-aaadc70da874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:15.176118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 961/1927] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:15.178213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67f797-9843-4f89-ac78-aaadc70da874 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:15.181237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1e226-af38-42fb-b7d7-afe2fac2a187 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:15.195334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1e226-af38-42fb-b7d7-afe2fac2a187 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.201416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb7a5c-0f49-4096-b6de-4855ef3f81a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.202221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb7a5c-0f49-4096-b6de-4855ef3f81a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.202649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb7a5c-0f49-4096-b6de-4855ef3f81a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.203010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb7a5c-0f49-4096-b6de-4855ef3f81a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.204385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb7a5c-0f49-4096-b6de-4855ef3f81a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:15.206369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb7a5c-0f49-4096-b6de-4855ef3f81a8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:15.208904 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 967/1928] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:15 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:46:15.213110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67f797-9843-4f89-ac78-aaadc70da874 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:15.225903 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67f797-9843-4f89-ac78-aaadc70da874 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.251432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4a9f9-9e89-45dd-a2ef-a11209462eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.252150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4a9f9-9e89-45dd-a2ef-a11209462eba admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.252434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4a9f9-9e89-45dd-a2ef-a11209462eba admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.252709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4a9f9-9e89-45dd-a2ef-a11209462eba admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.253462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4a9f9-9e89-45dd-a2ef-a11209462eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:15.255412 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4a9f9-9e89-45dd-a2ef-a11209462eba admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:15.274710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 962/1929] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:15 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:15.274884 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb7a5c-0f49-4096-b6de-4855ef3f81a8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:15.275662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 968/1930] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:15.281460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4a9f9-9e89-45dd-a2ef-a11209462eba admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:15.302119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4a9f9-9e89-45dd-a2ef-a11209462eba admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.386511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb7a5c-0f49-4096-b6de-4855ef3f81a8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.391987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d83c5c-2805-4cca-a45f-bf9bce8aa511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.392630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d83c5c-2805-4cca-a45f-bf9bce8aa511 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.393070 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d83c5c-2805-4cca-a45f-bf9bce8aa511 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.393535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d83c5c-2805-4cca-a45f-bf9bce8aa511 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.396278 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d83c5c-2805-4cca-a45f-bf9bce8aa511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:15.397508 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d83c5c-2805-4cca-a45f-bf9bce8aa511 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:15.422688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992d44a-987a-463d-8acb-5ccd99535eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.423324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992d44a-987a-463d-8acb-5ccd99535eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.423608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992d44a-987a-463d-8acb-5ccd99535eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.423884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992d44a-987a-463d-8acb-5ccd99535eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.424138 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 963/1931] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:15 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:15.424745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992d44a-987a-463d-8acb-5ccd99535eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:15.426499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992d44a-987a-463d-8acb-5ccd99535eb8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:15.427719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d83c5c-2805-4cca-a45f-bf9bce8aa511 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:15.441462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 969/1932] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:15.445128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d83c5c-2805-4cca-a45f-bf9bce8aa511 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.446310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992d44a-987a-463d-8acb-5ccd99535eb8 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:15.451072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62bfd3-f7d5-4ee8-86c4-66ac3805174c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.452017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62bfd3-f7d5-4ee8-86c4-66ac3805174c admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.452303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62bfd3-f7d5-4ee8-86c4-66ac3805174c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.453357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62bfd3-f7d5-4ee8-86c4-66ac3805174c admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.454057 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62bfd3-f7d5-4ee8-86c4-66ac3805174c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:15.455706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62bfd3-f7d5-4ee8-86c4-66ac3805174c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:15.457372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992d44a-987a-463d-8acb-5ccd99535eb8 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.462551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c66500-be21-47f3-878e-a74bdbf59e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.463441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c66500-be21-47f3-878e-a74bdbf59e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.463725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c66500-be21-47f3-878e-a74bdbf59e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.464022 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c66500-be21-47f3-878e-a74bdbf59e44 admin admin] PATH_INFO: `/v3/projects/c7e89979d6824ac98c86cd31d49fd5f9/users/a00c18cce5004a5f8ef408712f59dafe/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.472002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 964/1933] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:15.477861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62bfd3-f7d5-4ee8-86c4-66ac3805174c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:15.484991 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c66500-be21-47f3-878e-a74bdbf59e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e89979d6824ac98c86cd31d49fd5f9, user_id=a00c18cce5004a5f8ef408712f59dafe, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:15.487784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c66500-be21-47f3-878e-a74bdbf59e44 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:15.490754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62bfd3-f7d5-4ee8-86c4-66ac3805174c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.496282 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a400b-a06b-48ce-8245-0d099154df98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.497136 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a400b-a06b-48ce-8245-0d099154df98 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.497460 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a400b-a06b-48ce-8245-0d099154df98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.497732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a400b-a06b-48ce-8245-0d099154df98 admin admin] PATH_INFO: `/v3/projects/137e1fde1c2247d18d35ce80743afd46/users/e9e9bc197c86406cb57c55bba987df2c/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.518837 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 970/1934] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:15 2022] PUT /identity/v3/projects/c7e89979d6824ac98c86cd31d49fd5f9/users/a00c18cce5004a5f8ef408712f59dafe/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:15.532857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff5fb-8253-409e-abe5-a7c97fcce6dc None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.532857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff5fb-8253-409e-abe5-a7c97fcce6dc None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.534140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff5fb-8253-409e-abe5-a7c97fcce6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.540983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a400b-a06b-48ce-8245-0d099154df98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137e1fde1c2247d18d35ce80743afd46, user_id=e9e9bc197c86406cb57c55bba987df2c, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:15.543557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a400b-a06b-48ce-8245-0d099154df98 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:15.569889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 965/1935] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:15 2022] PUT /identity/v3/projects/137e1fde1c2247d18d35ce80743afd46/users/e9e9bc197c86406cb57c55bba987df2c/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:15.571142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a400b-a06b-48ce-8245-0d099154df98 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:15.582749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b6dff5fb-8253-409e-abe5-a7c97fcce6dc None None] MFA Rules not processed for user `a00c18cce5004a5f8ef408712f59dafe`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:15.584739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b6dff5fb-8253-409e-abe5-a7c97fcce6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:15.699497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a400b-a06b-48ce-8245-0d099154df98 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.701883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:15.706757 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bf149-82bb-46e1-addd-2add44606666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.707591 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bf149-82bb-46e1-addd-2add44606666 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.707976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bf149-82bb-46e1-addd-2add44606666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.708350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bf149-82bb-46e1-addd-2add44606666 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.709320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bf149-82bb-46e1-addd-2add44606666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:15.711435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bf149-82bb-46e1-addd-2add44606666 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:15.726699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 966/1936] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:15.731409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bf149-82bb-46e1-addd-2add44606666 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:15.742217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 971/1937] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:15.750463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bf149-82bb-46e1-addd-2add44606666 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.759093 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff5fb-8253-409e-abe5-a7c97fcce6dc None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:15.760359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e06b5-45d2-486e-8250-c847d7432042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.761106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e06b5-45d2-486e-8250-c847d7432042 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.761426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e06b5-45d2-486e-8250-c847d7432042 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.761832 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e06b5-45d2-486e-8250-c847d7432042 admin admin] PATH_INFO: `/v3/projects/137e1fde1c2247d18d35ce80743afd46/users/e9e9bc197c86406cb57c55bba987df2c/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.762736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b6dff5fb-8253-409e-abe5-a7c97fcce6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:15.764192 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e06b5-45d2-486e-8250-c847d7432042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137e1fde1c2247d18d35ce80743afd46, user_id=e9e9bc197c86406cb57c55bba987df2c, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:15.766906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e06b5-45d2-486e-8250-c847d7432042 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:15.782777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 967/1938] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:15 2022] PUT /identity/v3/projects/137e1fde1c2247d18d35ce80743afd46/users/e9e9bc197c86406cb57c55bba987df2c/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:15.793789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdb9a9-f98f-4dbf-8d73-619dc7535787 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.794073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdb9a9-f98f-4dbf-8d73-619dc7535787 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.794354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdb9a9-f98f-4dbf-8d73-619dc7535787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.823908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:15.830354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5ebdb9a9-f98f-4dbf-8d73-619dc7535787 None None] MFA Rules not processed for user `e9e9bc197c86406cb57c55bba987df2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:15.832022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5ebdb9a9-f98f-4dbf-8d73-619dc7535787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:15.853145 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff5fb-8253-409e-abe5-a7c97fcce6dc None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.946279 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 968/1939] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:15.971425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd9395-dea8-414e-bdff-60e8aab9f93f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.972139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd9395-dea8-414e-bdff-60e8aab9f93f service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.972401 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd9395-dea8-414e-bdff-60e8aab9f93f service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.972829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd9395-dea8-414e-bdff-60e8aab9f93f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:15.974295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdb9a9-f98f-4dbf-8d73-619dc7535787 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:15.979266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5ebdb9a9-f98f-4dbf-8d73-619dc7535787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:15.992798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdb9a9-f98f-4dbf-8d73-619dc7535787 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:15.998186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c474c-0f4e-492a-8a8d-366e2295ae58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:15.998826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c474c-0f4e-492a-8a8d-366e2295ae58 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:15.999106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c474c-0f4e-492a-8a8d-366e2295ae58 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:15.999375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c474c-0f4e-492a-8a8d-366e2295ae58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:16.014001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c474c-0f4e-492a-8a8d-366e2295ae58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:16.017025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c474c-0f4e-492a-8a8d-366e2295ae58 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:16.028722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 969/1940] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:16.047880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd9395-dea8-414e-bdff-60e8aab9f93f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:16.049419 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd9395-dea8-414e-bdff-60e8aab9f93f service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:16.059748 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 972/1941] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:16.897882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c474c-0f4e-492a-8a8d-366e2295ae58 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:16.986367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c474c-0f4e-492a-8a8d-366e2295ae58 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:16.993761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:16.994436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:16.994824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:16.995097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] PATH_INFO: `/v3/users/6f298ed4c3ae41baa6b4f8accff35ec2` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:16.996523 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f298ed4c3ae41baa6b4f8accff35ec2)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:16.998478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:17.062525 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f298ed4c3ae41baa6b4f8accff35ec2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:17.071699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f298ed4c3ae41baa6b4f8accff35ec2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:17.081983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f298ed4c3ae41baa6b4f8accff35ec2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:17.082904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f298ed4c3ae41baa6b4f8accff35ec2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:17.097743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f298ed4c3ae41baa6b4f8accff35ec2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:17.105057 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 970/1942] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:16 2022] DELETE /identity/v3/users/6f298ed4c3ae41baa6b4f8accff35ec2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:17.109726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a40ce0-c063-49ac-897e-f35e1cc20cc1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:17.110612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a40ce0-c063-49ac-897e-f35e1cc20cc1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:17.111052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a40ce0-c063-49ac-897e-f35e1cc20cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:17.155638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f2a40ce0-c063-49ac-897e-f35e1cc20cc1 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:17.157328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f2a40ce0-c063-49ac-897e-f35e1cc20cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:17.221048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:17.260644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 973/1943] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:17.271802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:17.273534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:17.289374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:17.375754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcc75c-1d63-48f5-9391-4179e828eecb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:17.379980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f22c72-0ad1-4315-b0eb-15916897eb74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:17.380772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f22c72-0ad1-4315-b0eb-15916897eb74 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:17.381154 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f22c72-0ad1-4315-b0eb-15916897eb74 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:17.382061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f22c72-0ad1-4315-b0eb-15916897eb74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:17.393726 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f22c72-0ad1-4315-b0eb-15916897eb74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:17.395113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f22c72-0ad1-4315-b0eb-15916897eb74 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:17.406621 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 971/1944] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:17.752529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a40ce0-c063-49ac-897e-f35e1cc20cc1 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:17.754359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f2a40ce0-c063-49ac-897e-f35e1cc20cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:17.777350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a40ce0-c063-49ac-897e-f35e1cc20cc1 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:17.787215 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:17.787943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:17.788498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:17.788774 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] PATH_INFO: `/v3/projects/adb892d32dc2421e9a1c491aed2729d6` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:17.793822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb892d32dc2421e9a1c491aed2729d6)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:17.799941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:17.936253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb892d32dc2421e9a1c491aed2729d6', 'request_id': 'req-66d8a059-8042-4fa5-a9ef-c99823713ae5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:17.958600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb892d32dc2421e9a1c491aed2729d6', 'request_id': 'req-66d8a059-8042-4fa5-a9ef-c99823713ae5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:17.990832 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb892d32dc2421e9a1c491aed2729d6', 'request_id': 'req-66d8a059-8042-4fa5-a9ef-c99823713ae5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:18.018443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] The token cache is being invalidate because project adb892d32dc2421e9a1c491aed2729d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:18.019054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:18.020575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:18.026980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f22c72-0ad1-4315-b0eb-15916897eb74 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:18.027568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 974/1945] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:17 2022] DELETE /identity/v3/projects/adb892d32dc2421e9a1c491aed2729d6 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:18.048947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f22c72-0ad1-4315-b0eb-15916897eb74 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:18.127887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4fff84-13f1-4951-8b00-b86d43c1b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:18.128555 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fff84-13f1-4951-8b00-b86d43c1b88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:18.128839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fff84-13f1-4951-8b00-b86d43c1b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:18.129122 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fff84-13f1-4951-8b00-b86d43c1b88f admin admin] PATH_INFO: `/v3/users/e9e9bc197c86406cb57c55bba987df2c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:18.130429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fff84-13f1-4951-8b00-b86d43c1b88f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e9bc197c86406cb57c55bba987df2c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:18.132408 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4fff84-13f1-4951-8b00-b86d43c1b88f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:18.210753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7f4fff84-13f1-4951-8b00-b86d43c1b88f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e9bc197c86406cb57c55bba987df2c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:18.221643 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7f4fff84-13f1-4951-8b00-b86d43c1b88f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e9bc197c86406cb57c55bba987df2c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:18.242318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7f4fff84-13f1-4951-8b00-b86d43c1b88f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e9bc197c86406cb57c55bba987df2c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:18.243305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7f4fff84-13f1-4951-8b00-b86d43c1b88f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e9bc197c86406cb57c55bba987df2c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:18.260587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7f4fff84-13f1-4951-8b00-b86d43c1b88f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e9bc197c86406cb57c55bba987df2c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:18.268115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 972/1946] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:18 2022] DELETE /identity/v3/users/e9e9bc197c86406cb57c55bba987df2c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:18.670423 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:18.672765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:18.727909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8a059-8042-4fa5-a9ef-c99823713ae5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:18.861894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:18.862834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:18.863070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:18.863348 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7 admin admin] PATH_INFO: `/v3/projects/137e1fde1c2247d18d35ce80743afd46` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:18.864745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=137e1fde1c2247d18d35ce80743afd46)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:18.867404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:18.970741 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137e1fde1c2247d18d35ce80743afd46', 'request_id': 'req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:18.981632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137e1fde1c2247d18d35ce80743afd46', 'request_id': 'req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:18.996795 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137e1fde1c2247d18d35ce80743afd46', 'request_id': 'req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:19.017967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7 admin admin] The token cache is being invalidate because project 137e1fde1c2247d18d35ce80743afd46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:19.018337 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:19.019052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9a293c5c-d216-4fe0-857b-bf14c6ce1bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:19.020480 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 975/1947] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:18 2022] DELETE /identity/v3/projects/137e1fde1c2247d18d35ce80743afd46 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:19.025594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b0fb8-ee1c-4a84-ba83-20edac312795 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:19.026101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b0fb8-ee1c-4a84-ba83-20edac312795 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:19.026440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b0fb8-ee1c-4a84-ba83-20edac312795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:19.049817 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-485b0fb8-ee1c-4a84-ba83-20edac312795 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:19.052242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-485b0fb8-ee1c-4a84-ba83-20edac312795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:19.093693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:19.166412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 973/1948] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:19.168979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd91f08-b066-4abc-8357-26162a774ad1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:19.169197 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd91f08-b066-4abc-8357-26162a774ad1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:19.169509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd91f08-b066-4abc-8357-26162a774ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:19.180009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:19.196362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9fd91f08-b066-4abc-8357-26162a774ad1 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:19.198503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9fd91f08-b066-4abc-8357-26162a774ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:19.212568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 976/1949] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:19.216908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b0fb8-ee1c-4a84-ba83-20edac312795 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:19.230951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b0fb8-ee1c-4a84-ba83-20edac312795 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:19.236691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075142da-bebb-4cc8-abe1-26ef6431391a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:19.237644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075142da-bebb-4cc8-abe1-26ef6431391a admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:19.238273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075142da-bebb-4cc8-abe1-26ef6431391a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:19.238745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075142da-bebb-4cc8-abe1-26ef6431391a admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:19.239787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075142da-bebb-4cc8-abe1-26ef6431391a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:19.240293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075142da-bebb-4cc8-abe1-26ef6431391a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:19.242143 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075142da-bebb-4cc8-abe1-26ef6431391a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:19.265364 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 974/1950] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:46:19.266785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd91f08-b066-4abc-8357-26162a774ad1 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:19.280946 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd91f08-b066-4abc-8357-26162a774ad1 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:19.290611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ae80d-d92e-467a-92d3-822cce0fa600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:19.292249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ae80d-d92e-467a-92d3-822cce0fa600 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:19.292249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ae80d-d92e-467a-92d3-822cce0fa600 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:19.292249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ae80d-d92e-467a-92d3-822cce0fa600 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:19.293116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ae80d-d92e-467a-92d3-822cce0fa600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:19.296097 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ae80d-d92e-467a-92d3-822cce0fa600 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:19.363434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 977/1951] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:19 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:19.367921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075142da-bebb-4cc8-abe1-26ef6431391a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:19.379149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075142da-bebb-4cc8-abe1-26ef6431391a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:19.447376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbb96f-254f-4a69-ac42-6b0df20ae3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:19.448123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbb96f-254f-4a69-ac42-6b0df20ae3ae admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:19.448400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbb96f-254f-4a69-ac42-6b0df20ae3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:19.448673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbb96f-254f-4a69-ac42-6b0df20ae3ae admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:19.449448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbb96f-254f-4a69-ac42-6b0df20ae3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:19.451440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbb96f-254f-4a69-ac42-6b0df20ae3ae admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:19.480442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 975/1952] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:19 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:19.482002 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ae80d-d92e-467a-92d3-822cce0fa600 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:19.493588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ae80d-d92e-467a-92d3-822cce0fa600 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:19.499828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d805cd-210e-4501-a85c-3e17d244e83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:19.500628 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d805cd-210e-4501-a85c-3e17d244e83b admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:19.500977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d805cd-210e-4501-a85c-3e17d244e83b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:19.501433 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d805cd-210e-4501-a85c-3e17d244e83b admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:19.502322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d805cd-210e-4501-a85c-3e17d244e83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:19.504160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d805cd-210e-4501-a85c-3e17d244e83b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:19.519345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 978/1953] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:19.521053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbb96f-254f-4a69-ac42-6b0df20ae3ae admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:19.531888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbb96f-254f-4a69-ac42-6b0df20ae3ae admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:19.538830 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ead36-8797-4f1a-a166-676e17a6ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:19.539659 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ead36-8797-4f1a-a166-676e17a6ea28 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:19.540105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ead36-8797-4f1a-a166-676e17a6ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:19.540446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ead36-8797-4f1a-a166-676e17a6ea28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:19.541134 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ead36-8797-4f1a-a166-676e17a6ea28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:19.542788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ead36-8797-4f1a-a166-676e17a6ea28 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:19.555585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 976/1954] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:19.560035 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d805cd-210e-4501-a85c-3e17d244e83b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:19.570243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d805cd-210e-4501-a85c-3e17d244e83b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:19.574898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad30e9-431d-44ff-b082-a0d2a27bd32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:19.575587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad30e9-431d-44ff-b082-a0d2a27bd32d admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:19.575868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad30e9-431d-44ff-b082-a0d2a27bd32d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:19.576136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad30e9-431d-44ff-b082-a0d2a27bd32d admin admin] PATH_INFO: `/v3/projects/ac9b3ae1dbfa4bc59f5c7b7d457930e9/users/070c559949ae423fa36a88ecf6fa0a1e/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:19.593232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad30e9-431d-44ff-b082-a0d2a27bd32d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9b3ae1dbfa4bc59f5c7b7d457930e9, user_id=070c559949ae423fa36a88ecf6fa0a1e, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:19.595995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad30e9-431d-44ff-b082-a0d2a27bd32d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:19.615509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 979/1955] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:19 2022] PUT /identity/v3/projects/ac9b3ae1dbfa4bc59f5c7b7d457930e9/users/070c559949ae423fa36a88ecf6fa0a1e/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:19.626146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e7065-bef3-435c-9f38-e21d764fdd04 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:19.626430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e7065-bef3-435c-9f38-e21d764fdd04 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:19.626999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e7065-bef3-435c-9f38-e21d764fdd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:19.660085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6c5e7065-bef3-435c-9f38-e21d764fdd04 None None] MFA Rules not processed for user `070c559949ae423fa36a88ecf6fa0a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:19.661314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6c5e7065-bef3-435c-9f38-e21d764fdd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:19.736269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 977/1956] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:19.747605 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad30e9-431d-44ff-b082-a0d2a27bd32d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:19.749395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-35ad30e9-431d-44ff-b082-a0d2a27bd32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:19.833941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad30e9-431d-44ff-b082-a0d2a27bd32d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:19.838023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe524683-5d91-4fb8-98be-07361509b03a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2402339784b34d98a4670db912617331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:19.838689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe524683-5d91-4fb8-98be-07361509b03a service glance] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:19.838965 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe524683-5d91-4fb8-98be-07361509b03a service glance] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:19.839589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe524683-5d91-4fb8-98be-07361509b03a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:19.849777 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe524683-5d91-4fb8-98be-07361509b03a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:19.851339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe524683-5d91-4fb8-98be-07361509b03a service glance] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:19.861076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 980/1957] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:29.511199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e7065-bef3-435c-9f38-e21d764fdd04 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:29.512716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6c5e7065-bef3-435c-9f38-e21d764fdd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:29.541577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:29.589384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e7065-bef3-435c-9f38-e21d764fdd04 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:29.595709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:29.596393 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:29.596672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:29.597008 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] PATH_INFO: `/v3/users/a00c18cce5004a5f8ef408712f59dafe` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:29.598573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00c18cce5004a5f8ef408712f59dafe)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:29.600568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:29.652827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00c18cce5004a5f8ef408712f59dafe'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:29.660871 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00c18cce5004a5f8ef408712f59dafe'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:29.670935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00c18cce5004a5f8ef408712f59dafe'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:29.671702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00c18cce5004a5f8ef408712f59dafe'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:29.689394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00c18cce5004a5f8ef408712f59dafe'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:29.696696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 978/1958] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:29 2022] DELETE /identity/v3/users/a00c18cce5004a5f8ef408712f59dafe => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:29.701531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a424fb-9f96-43a1-8683-5e58ba498fce None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:29.702267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a424fb-9f96-43a1-8683-5e58ba498fce None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:29.702267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a424fb-9f96-43a1-8683-5e58ba498fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:29.725046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-08a424fb-9f96-43a1-8683-5e58ba498fce None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:29.726495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-08a424fb-9f96-43a1-8683-5e58ba498fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:29.791030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 981/1959] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:29.801331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:29.802788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:29.865088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba7126-c682-4725-9ae0-ca5ea6e3572f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:29.869504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e63f5e-5ef4-4c8a-9d08-ef92ff10610c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:29.870141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e63f5e-5ef4-4c8a-9d08-ef92ff10610c service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:29.870441 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e63f5e-5ef4-4c8a-9d08-ef92ff10610c service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:29.870709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e63f5e-5ef4-4c8a-9d08-ef92ff10610c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:29.880297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e63f5e-5ef4-4c8a-9d08-ef92ff10610c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:29.881774 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e63f5e-5ef4-4c8a-9d08-ef92ff10610c service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:29.891383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 979/1960] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:30.181444 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a424fb-9f96-43a1-8683-5e58ba498fce None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:30.183957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-08a424fb-9f96-43a1-8683-5e58ba498fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:30.196380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a424fb-9f96-43a1-8683-5e58ba498fce None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:30.204382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:30.204382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:30.204382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:30.204382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6 admin admin] PATH_INFO: `/v3/projects/c7e89979d6824ac98c86cd31d49fd5f9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:30.206674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e89979d6824ac98c86cd31d49fd5f9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:30.208792 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:30.232667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:30.262112 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e89979d6824ac98c86cd31d49fd5f9', 'request_id': 'req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:30.268373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e89979d6824ac98c86cd31d49fd5f9', 'request_id': 'req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:30.278118 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e89979d6824ac98c86cd31d49fd5f9', 'request_id': 'req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:30.295038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6 admin admin] The token cache is being invalidate because project c7e89979d6824ac98c86cd31d49fd5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:30.295332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:30.296074 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-d26f7712-35cb-4af0-95e4-c5a31e2b4fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:30.297854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 982/1961] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:30 2022] DELETE /identity/v3/projects/c7e89979d6824ac98c86cd31d49fd5f9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:30.303034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd9ab2-71f6-4cc0-905b-839746293348 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:30.303320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd9ab2-71f6-4cc0-905b-839746293348 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:30.303591 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd9ab2-71f6-4cc0-905b-839746293348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:30.326423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a3fd9ab2-71f6-4cc0-905b-839746293348 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:30.328231 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a3fd9ab2-71f6-4cc0-905b-839746293348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:30.379746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:30.403019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 980/1962] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:30.411847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407238f-c73b-4340-8422-ec6656df7302 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:30.412270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407238f-c73b-4340-8422-ec6656df7302 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:30.412629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407238f-c73b-4340-8422-ec6656df7302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:30.433077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e407238f-c73b-4340-8422-ec6656df7302 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:30.434789 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e407238f-c73b-4340-8422-ec6656df7302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:30.448915 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 983/1963] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:30.449251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd9ab2-71f6-4cc0-905b-839746293348 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:30.460861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd9ab2-71f6-4cc0-905b-839746293348 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:30.473779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec7b48-2d64-4c7b-b8ae-876c95c14c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:30.475218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec7b48-2d64-4c7b-b8ae-876c95c14c01 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:30.475218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec7b48-2d64-4c7b-b8ae-876c95c14c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:30.475218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec7b48-2d64-4c7b-b8ae-876c95c14c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:30.475701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec7b48-2d64-4c7b-b8ae-876c95c14c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:30.476021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec7b48-2d64-4c7b-b8ae-876c95c14c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:30.477599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec7b48-2d64-4c7b-b8ae-876c95c14c01 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:30.494855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 981/1964] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:46:30.499501 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407238f-c73b-4340-8422-ec6656df7302 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:30.514342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407238f-c73b-4340-8422-ec6656df7302 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:30.519031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6272556-7c9a-47b0-8ed7-ae11d6ee6699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:30.519659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6272556-7c9a-47b0-8ed7-ae11d6ee6699 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:30.519943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6272556-7c9a-47b0-8ed7-ae11d6ee6699 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:30.520217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6272556-7c9a-47b0-8ed7-ae11d6ee6699 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:30.521039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6272556-7c9a-47b0-8ed7-ae11d6ee6699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:30.523149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6272556-7c9a-47b0-8ed7-ae11d6ee6699 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:30.557177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 984/1965] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:30 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:46:30.561728 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec7b48-2d64-4c7b-b8ae-876c95c14c01 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:30.573499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec7b48-2d64-4c7b-b8ae-876c95c14c01 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:30.652861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f6f9d-7dec-4ec7-ab03-8cfef42c9549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:30.653561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f6f9d-7dec-4ec7-ab03-8cfef42c9549 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:30.653847 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f6f9d-7dec-4ec7-ab03-8cfef42c9549 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:30.654123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f6f9d-7dec-4ec7-ab03-8cfef42c9549 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:30.654840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f6f9d-7dec-4ec7-ab03-8cfef42c9549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:30.657129 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f6f9d-7dec-4ec7-ab03-8cfef42c9549 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:30.693323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 982/1966] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:30 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:30.697681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6272556-7c9a-47b0-8ed7-ae11d6ee6699 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:30.709362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6272556-7c9a-47b0-8ed7-ae11d6ee6699 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:30.715553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea784ab-9348-4c8c-84f1-85f2595b342e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:30.716199 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea784ab-9348-4c8c-84f1-85f2595b342e admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:30.716485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea784ab-9348-4c8c-84f1-85f2595b342e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:30.716764 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea784ab-9348-4c8c-84f1-85f2595b342e admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:30.717516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea784ab-9348-4c8c-84f1-85f2595b342e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:30.719162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea784ab-9348-4c8c-84f1-85f2595b342e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:30.730484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 985/1967] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:30.736066 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f6f9d-7dec-4ec7-ab03-8cfef42c9549 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:30.750820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f6f9d-7dec-4ec7-ab03-8cfef42c9549 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:30.755781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac2999-7fa0-443f-a089-e4a97e5a57ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:30.756414 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac2999-7fa0-443f-a089-e4a97e5a57ce admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:30.756693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac2999-7fa0-443f-a089-e4a97e5a57ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:30.757072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac2999-7fa0-443f-a089-e4a97e5a57ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:30.757702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac2999-7fa0-443f-a089-e4a97e5a57ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:30.759333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac2999-7fa0-443f-a089-e4a97e5a57ce admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:30.772510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 983/1968] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:30.776697 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea784ab-9348-4c8c-84f1-85f2595b342e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:30.795404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea784ab-9348-4c8c-84f1-85f2595b342e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:30.801819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285b53a-26a5-446b-aed9-fbc60aa8b317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:30.802794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285b53a-26a5-446b-aed9-fbc60aa8b317 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:30.803267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285b53a-26a5-446b-aed9-fbc60aa8b317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:30.803708 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285b53a-26a5-446b-aed9-fbc60aa8b317 admin admin] PATH_INFO: `/v3/projects/1410afc537fc4d6bb47e6475a2d7d7d7/users/4a27e5b69e724f8f9148973a012a8ce5/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:30.844156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285b53a-26a5-446b-aed9-fbc60aa8b317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1410afc537fc4d6bb47e6475a2d7d7d7, user_id=4a27e5b69e724f8f9148973a012a8ce5, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:30.847096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285b53a-26a5-446b-aed9-fbc60aa8b317 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:30.878530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 986/1969] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:30 2022] PUT /identity/v3/projects/1410afc537fc4d6bb47e6475a2d7d7d7/users/4a27e5b69e724f8f9148973a012a8ce5/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:30.883819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3563c04-ffef-4246-8180-18c6c7dccbb5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:30.884104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3563c04-ffef-4246-8180-18c6c7dccbb5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:30.884376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3563c04-ffef-4246-8180-18c6c7dccbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:30.907720 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c3563c04-ffef-4246-8180-18c6c7dccbb5 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:30.909509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c3563c04-ffef-4246-8180-18c6c7dccbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:30.993591 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 984/1970] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:31.005796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285b53a-26a5-446b-aed9-fbc60aa8b317 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:31.007851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e285b53a-26a5-446b-aed9-fbc60aa8b317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:31.073075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285b53a-26a5-446b-aed9-fbc60aa8b317 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:31.077390 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74c829-c542-4159-95e2-9cfa2a538e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:31.078094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c829-c542-4159-95e2-9cfa2a538e16 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:31.078345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c829-c542-4159-95e2-9cfa2a538e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:31.078633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c829-c542-4159-95e2-9cfa2a538e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:31.089827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74c829-c542-4159-95e2-9cfa2a538e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:31.091258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74c829-c542-4159-95e2-9cfa2a538e16 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:31.101798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 987/1971] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:46:32.347141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3563c04-ffef-4246-8180-18c6c7dccbb5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:32.349459 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c3563c04-ffef-4246-8180-18c6c7dccbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:32.371344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3563c04-ffef-4246-8180-18c6c7dccbb5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:32.383062 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:32.383753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:32.384034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:32.384312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] PATH_INFO: `/v3/users/ecdd0b00995a4490af74ce72bff51cc3` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:32.389886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecdd0b00995a4490af74ce72bff51cc3)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:32.393580 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:32.519421 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:32.522393 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecdd0b00995a4490af74ce72bff51cc3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:32.531975 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecdd0b00995a4490af74ce72bff51cc3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:32.547879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecdd0b00995a4490af74ce72bff51cc3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:32.549557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecdd0b00995a4490af74ce72bff51cc3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:32.573904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecdd0b00995a4490af74ce72bff51cc3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:32.588279 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 985/1972] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:32 2022] DELETE /identity/v3/users/ecdd0b00995a4490af74ce72bff51cc3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:32.593910 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd61ff-cf35-413f-9280-3a16e4c80f56 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:32.594889 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd61ff-cf35-413f-9280-3a16e4c80f56 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:32.595474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd61ff-cf35-413f-9280-3a16e4c80f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:32.618501 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b3bd61ff-cf35-413f-9280-3a16e4c80f56 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:32.620198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b3bd61ff-cf35-413f-9280-3a16e4c80f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:32.674808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:32.706982 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 988/1973] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:32.759019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:32.760733 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:32.910250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6ff97-e649-4271-87a8-deb00ecee203 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:32.923894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d0e7d-6a1c-4336-ad85-e3f57b9e0c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:32.924577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d0e7d-6a1c-4336-ad85-e3f57b9e0c79 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:32.924863 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d0e7d-6a1c-4336-ad85-e3f57b9e0c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:32.925139 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d0e7d-6a1c-4336-ad85-e3f57b9e0c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:32.949930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d0e7d-6a1c-4336-ad85-e3f57b9e0c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:32.951495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d0e7d-6a1c-4336-ad85-e3f57b9e0c79 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:32.973314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 986/1974] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:33.790195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd61ff-cf35-413f-9280-3a16e4c80f56 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:33.791961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b3bd61ff-cf35-413f-9280-3a16e4c80f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:33.805739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd61ff-cf35-413f-9280-3a16e4c80f56 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:33.811178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:33.811845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:33.812127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:33.812402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] PATH_INFO: `/v3/projects/168bb4ac8d0e46ba8b580a869a52cd3a` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:33.813645 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=168bb4ac8d0e46ba8b580a869a52cd3a)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:33.815612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:33.867623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '168bb4ac8d0e46ba8b580a869a52cd3a', 'request_id': 'req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:33.874944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '168bb4ac8d0e46ba8b580a869a52cd3a', 'request_id': 'req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:33.883585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '168bb4ac8d0e46ba8b580a869a52cd3a', 'request_id': 'req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:33.897159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] The token cache is being invalidate because project 168bb4ac8d0e46ba8b580a869a52cd3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:33.897709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:33.898788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:33.905830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 989/1975] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:33 2022] DELETE /identity/v3/projects/168bb4ac8d0e46ba8b580a869a52cd3a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:33.907207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d0e7d-6a1c-4336-ad85-e3f57b9e0c79 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:33.924874 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d0e7d-6a1c-4336-ad85-e3f57b9e0c79 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:34.021579 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:34.021988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:34.022204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:34.022529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] PATH_INFO: `/v3/users/99b09592b60645629b15283d90b0a6cf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:34.023908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=99b09592b60645629b15283d90b0a6cf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:34.029838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:34.092203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99b09592b60645629b15283d90b0a6cf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:34.104701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99b09592b60645629b15283d90b0a6cf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:34.116739 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99b09592b60645629b15283d90b0a6cf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:34.118000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99b09592b60645629b15283d90b0a6cf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:34.132503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:34.154860 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99b09592b60645629b15283d90b0a6cf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:34.169440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 987/1976] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:33 2022] DELETE /identity/v3/users/99b09592b60645629b15283d90b0a6cf => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:35.115114 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:35.117528 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:35.131321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:35.131763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:35.156233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf194f1-af62-4b2e-9cf5-45b4a33bd1e6 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:35.249001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957ddb4-d7cc-414f-b073-c494b7e26c4f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:35.256668 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d217719-cf24-46b7-af1c-b3c0c3612b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:35.257711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d217719-cf24-46b7-af1c-b3c0c3612b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:35.258139 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d217719-cf24-46b7-af1c-b3c0c3612b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:35.258554 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d217719-cf24-46b7-af1c-b3c0c3612b3a admin admin] PATH_INFO: `/v3/users/6b6e9910ded44a2280a74bfefededc7c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:35.258665 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:35.259311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:35.259720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:35.260273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854 admin admin] PATH_INFO: `/v3/projects/a3e084b667e24a7abe0fd0a409e9af00` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:35.260803 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d217719-cf24-46b7-af1c-b3c0c3612b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6e9910ded44a2280a74bfefededc7c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:35.261526 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e084b667e24a7abe0fd0a409e9af00)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:35.264376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:35.264526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d217719-cf24-46b7-af1c-b3c0c3612b3a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:35.336754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e084b667e24a7abe0fd0a409e9af00', 'request_id': 'req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:35.346655 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6d217719-cf24-46b7-af1c-b3c0c3612b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6e9910ded44a2280a74bfefededc7c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:35.346846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e084b667e24a7abe0fd0a409e9af00', 'request_id': 'req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:35.357025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6d217719-cf24-46b7-af1c-b3c0c3612b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6e9910ded44a2280a74bfefededc7c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:35.358741 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e084b667e24a7abe0fd0a409e9af00', 'request_id': 'req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:35.367451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6d217719-cf24-46b7-af1c-b3c0c3612b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6e9910ded44a2280a74bfefededc7c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:35.368354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6d217719-cf24-46b7-af1c-b3c0c3612b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6e9910ded44a2280a74bfefededc7c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:35.372462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:35.387890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6d217719-cf24-46b7-af1c-b3c0c3612b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6e9910ded44a2280a74bfefededc7c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:35.391295 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854 admin admin] The token cache is being invalidate because project a3e084b667e24a7abe0fd0a409e9af00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:35.391472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:35.392172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-57e9fb2d-8c0e-4fdb-b52e-e3e684656854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:35.396172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 990/1977] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:35 2022] DELETE /identity/v3/projects/a3e084b667e24a7abe0fd0a409e9af00 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:35.398879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e106a-5ab0-4b64-8c25-59bf58fa639b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:35.399330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 988/1978] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:35 2022] DELETE /identity/v3/users/6b6e9910ded44a2280a74bfefededc7c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:35.399468 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e106a-5ab0-4b64-8c25-59bf58fa639b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:35.399681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e106a-5ab0-4b64-8c25-59bf58fa639b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:35.442233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-fd6e106a-5ab0-4b64-8c25-59bf58fa639b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:35.444093 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fd6e106a-5ab0-4b64-8c25-59bf58fa639b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:35.546861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 991/1979] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:35.555534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd021c-81e2-4a5c-a57a-44a39876857e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:35.555970 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd021c-81e2-4a5c-a57a-44a39876857e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:35.556822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd021c-81e2-4a5c-a57a-44a39876857e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:35.590907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-90bd021c-81e2-4a5c-a57a-44a39876857e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:35.594319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-90bd021c-81e2-4a5c-a57a-44a39876857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:35.609368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 989/1980] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:35.613727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e106a-5ab0-4b64-8c25-59bf58fa639b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:35.631579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e106a-5ab0-4b64-8c25-59bf58fa639b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:35.650389 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809b2cb-c025-4f6b-aa2d-d54ce6349e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:35.657953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b2cb-c025-4f6b-aa2d-d54ce6349e54 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:35.657953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b2cb-c025-4f6b-aa2d-d54ce6349e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:35.657953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809b2cb-c025-4f6b-aa2d-d54ce6349e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:35.658969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809b2cb-c025-4f6b-aa2d-d54ce6349e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:35.659439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809b2cb-c025-4f6b-aa2d-d54ce6349e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:35.662543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7809b2cb-c025-4f6b-aa2d-d54ce6349e54 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:35.716578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 992/1981] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:46:35.722560 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd021c-81e2-4a5c-a57a-44a39876857e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:35.735415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd021c-81e2-4a5c-a57a-44a39876857e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:35.746471 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba689e-4aa8-4d25-9cf2-d9ce54804a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:35.747128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba689e-4aa8-4d25-9cf2-d9ce54804a16 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:35.747588 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba689e-4aa8-4d25-9cf2-d9ce54804a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:35.747872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba689e-4aa8-4d25-9cf2-d9ce54804a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:35.748560 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba689e-4aa8-4d25-9cf2-d9ce54804a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:35.750526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba689e-4aa8-4d25-9cf2-d9ce54804a16 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:35.835275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 990/1982] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:35 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:35.840286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809b2cb-c025-4f6b-aa2d-d54ce6349e54 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:35.861116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7809b2cb-c025-4f6b-aa2d-d54ce6349e54 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:35.916711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba689e-4aa8-4d25-9cf2-d9ce54804a16 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:35.920175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-77ba689e-4aa8-4d25-9cf2-d9ce54804a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:35.976593 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:35.977373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bead0-7438-43ad-a2d1-d74f6e450bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:35.977881 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bead0-7438-43ad-a2d1-d74f6e450bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:35.978234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bead0-7438-43ad-a2d1-d74f6e450bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:35.978611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bead0-7438-43ad-a2d1-d74f6e450bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:35.979358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bead0-7438-43ad-a2d1-d74f6e450bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:35.982087 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bead0-7438-43ad-a2d1-d74f6e450bc3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.012266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba689e-4aa8-4d25-9cf2-d9ce54804a16 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.017463 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 993/1983] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:35 2022] POST /identity/v3/users => generated 282 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:36.018527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bead0-7438-43ad-a2d1-d74f6e450bc3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.019418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4910efa-e785-46d4-ad36-ab217ada2e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.020194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4910efa-e785-46d4-ad36-ab217ada2e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.020611 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4910efa-e785-46d4-ad36-ab217ada2e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.020982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4910efa-e785-46d4-ad36-ab217ada2e90 admin admin] PATH_INFO: `/v3/projects/3c98e688d8074386aec985d804c02daa` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.022499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4910efa-e785-46d4-ad36-ab217ada2e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c98e688d8074386aec985d804c02daa)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.029363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4910efa-e785-46d4-ad36-ab217ada2e90 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.030939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bead0-7438-43ad-a2d1-d74f6e450bc3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.038617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f26d1-ad51-4ed4-ad22-84c81b76d831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.039403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f26d1-ad51-4ed4-ad22-84c81b76d831 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.039692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f26d1-ad51-4ed4-ad22-84c81b76d831 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.040168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f26d1-ad51-4ed4-ad22-84c81b76d831 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.041427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f26d1-ad51-4ed4-ad22-84c81b76d831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.043685 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f26d1-ad51-4ed4-ad22-84c81b76d831 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.062491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 994/1984] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:36.063796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f26d1-ad51-4ed4-ad22-84c81b76d831 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.078383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f26d1-ad51-4ed4-ad22-84c81b76d831 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.084041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf7585-7a62-4e8f-9aee-ce2f79d6a84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.084722 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7585-7a62-4e8f-9aee-ce2f79d6a84c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.085006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7585-7a62-4e8f-9aee-ce2f79d6a84c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.085464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7585-7a62-4e8f-9aee-ce2f79d6a84c admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.086365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf7585-7a62-4e8f-9aee-ce2f79d6a84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.089308 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf7585-7a62-4e8f-9aee-ce2f79d6a84c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.103133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 995/1985] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:36.106002 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf7585-7a62-4e8f-9aee-ce2f79d6a84c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.117525 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf7585-7a62-4e8f-9aee-ce2f79d6a84c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.124032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4910efa-e785-46d4-ad36-ab217ada2e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c98e688d8074386aec985d804c02daa', 'request_id': 'req-f4910efa-e785-46d4-ad36-ab217ada2e90'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:36.146237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4910efa-e785-46d4-ad36-ab217ada2e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c98e688d8074386aec985d804c02daa', 'request_id': 'req-f4910efa-e785-46d4-ad36-ab217ada2e90'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:36.157636 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4910efa-e785-46d4-ad36-ab217ada2e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c98e688d8074386aec985d804c02daa', 'request_id': 'req-f4910efa-e785-46d4-ad36-ab217ada2e90'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:36.180400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4910efa-e785-46d4-ad36-ab217ada2e90 admin admin] The token cache is being invalidate because project 3c98e688d8074386aec985d804c02daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:36.180977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4910efa-e785-46d4-ad36-ab217ada2e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:36.181935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f4910efa-e785-46d4-ad36-ab217ada2e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:36.184021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 991/1986] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:35 2022] DELETE /identity/v3/projects/3c98e688d8074386aec985d804c02daa => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:36.189705 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358d74b-fe05-407e-9952-e92171d4b510 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.190268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358d74b-fe05-407e-9952-e92171d4b510 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.190701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358d74b-fe05-407e-9952-e92171d4b510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.192531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:36.203317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194cf24-fcc8-4d13-92f7-34933f062f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.206463 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194cf24-fcc8-4d13-92f7-34933f062f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.206790 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194cf24-fcc8-4d13-92f7-34933f062f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.207358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194cf24-fcc8-4d13-92f7-34933f062f54 admin admin] PATH_INFO: `/v3/projects/bcdbc45270224b5ea0be4fbbefa7da13/users/be44b8b4fcc944d080f30fdd1e833e00/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.238288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194cf24-fcc8-4d13-92f7-34933f062f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdbc45270224b5ea0be4fbbefa7da13, user_id=be44b8b4fcc944d080f30fdd1e833e00, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.246206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6358d74b-fe05-407e-9952-e92171d4b510 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:36.247692 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6358d74b-fe05-407e-9952-e92171d4b510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:36.248183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194cf24-fcc8-4d13-92f7-34933f062f54 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.266589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 992/1987] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:36.275058 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 996/1988] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:36 2022] PUT /identity/v3/projects/bcdbc45270224b5ea0be4fbbefa7da13/users/be44b8b4fcc944d080f30fdd1e833e00/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:36.279178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167c9d-da1f-4c4b-beb9-b72e293daddd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.281696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167c9d-da1f-4c4b-beb9-b72e293daddd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.282385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167c9d-da1f-4c4b-beb9-b72e293daddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.285709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628f00c-741b-4276-8813-49b8965e8bcf None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.285998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628f00c-741b-4276-8813-49b8965e8bcf None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.286280 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628f00c-741b-4276-8813-49b8965e8bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.308634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-58167c9d-da1f-4c4b-beb9-b72e293daddd None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:36.310001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-58167c9d-da1f-4c4b-beb9-b72e293daddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:36.376413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9628f00c-741b-4276-8813-49b8965e8bcf None None] MFA Rules not processed for user `be44b8b4fcc944d080f30fdd1e833e00`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:36.377851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9628f00c-741b-4276-8813-49b8965e8bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:36.438469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 993/1989] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:36.443093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167c9d-da1f-4c4b-beb9-b72e293daddd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.456339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167c9d-da1f-4c4b-beb9-b72e293daddd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.461093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9fc5f-6640-477b-9084-a19b30c19c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.461840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9fc5f-6640-477b-9084-a19b30c19c97 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.462195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9fc5f-6640-477b-9084-a19b30c19c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.462538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9fc5f-6640-477b-9084-a19b30c19c97 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.463391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9fc5f-6640-477b-9084-a19b30c19c97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:36.463768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9fc5f-6640-477b-9084-a19b30c19c97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.466050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9fc5f-6640-477b-9084-a19b30c19c97 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.481099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 994/1990] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:46:36.485038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 997/1991] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:36.485903 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9fc5f-6640-477b-9084-a19b30c19c97 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.490364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628f00c-741b-4276-8813-49b8965e8bcf None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.492471 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9628f00c-741b-4276-8813-49b8965e8bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:36.501927 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9fc5f-6640-477b-9084-a19b30c19c97 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.508947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06b710-aac9-4efb-ad65-8a3df2c72c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.509939 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06b710-aac9-4efb-ad65-8a3df2c72c6c admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.510736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06b710-aac9-4efb-ad65-8a3df2c72c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.511115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06b710-aac9-4efb-ad65-8a3df2c72c6c admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.511420 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628f00c-741b-4276-8813-49b8965e8bcf None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.512220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06b710-aac9-4efb-ad65-8a3df2c72c6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.515481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06b710-aac9-4efb-ad65-8a3df2c72c6c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.516552 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac04a2-d569-4f0c-ac25-71772a3f264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.517197 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac04a2-d569-4f0c-ac25-71772a3f264b admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.518037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac04a2-d569-4f0c-ac25-71772a3f264b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.518037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac04a2-d569-4f0c-ac25-71772a3f264b admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.518507 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac04a2-d569-4f0c-ac25-71772a3f264b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.520515 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac04a2-d569-4f0c-ac25-71772a3f264b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.558679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 995/1992] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:36 2022] POST /identity/v3/projects => generated 405 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:36.559580 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06b710-aac9-4efb-ad65-8a3df2c72c6c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.563307 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 998/1993] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:36 2022] POST /identity/v3/projects => generated 363 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:36.568456 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac04a2-d569-4f0c-ac25-71772a3f264b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.609829 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:36.692682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06b710-aac9-4efb-ad65-8a3df2c72c6c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.700074 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac04a2-d569-4f0c-ac25-71772a3f264b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.703257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67004d63-0c97-4063-a25e-96a6f07af7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.707220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25a8b8-9cbf-41c2-a99b-ae72a298fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.708307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67004d63-0c97-4063-a25e-96a6f07af7de admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.708584 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25a8b8-9cbf-41c2-a99b-ae72a298fe1c admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.708731 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67004d63-0c97-4063-a25e-96a6f07af7de admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.708992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67004d63-0c97-4063-a25e-96a6f07af7de admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.709484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25a8b8-9cbf-41c2-a99b-ae72a298fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.709898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25a8b8-9cbf-41c2-a99b-ae72a298fe1c admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.710017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67004d63-0c97-4063-a25e-96a6f07af7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.710989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25a8b8-9cbf-41c2-a99b-ae72a298fe1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.714386 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25a8b8-9cbf-41c2-a99b-ae72a298fe1c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.714536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67004d63-0c97-4063-a25e-96a6f07af7de admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.762371 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 996/1994] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:36 2022] POST /identity/v3/users => generated 303 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:36.763547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67004d63-0c97-4063-a25e-96a6f07af7de admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.768722 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 999/1995] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:36 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:36.772560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25a8b8-9cbf-41c2-a99b-ae72a298fe1c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.774985 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67004d63-0c97-4063-a25e-96a6f07af7de admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.779937 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e096f-465a-4dcd-8d5e-ffcfc4d49f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.781214 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e096f-465a-4dcd-8d5e-ffcfc4d49f2e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.781528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e096f-465a-4dcd-8d5e-ffcfc4d49f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.781797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e096f-465a-4dcd-8d5e-ffcfc4d49f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.782710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e096f-465a-4dcd-8d5e-ffcfc4d49f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.784520 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e096f-465a-4dcd-8d5e-ffcfc4d49f2e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.795544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25a8b8-9cbf-41c2-a99b-ae72a298fe1c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.806319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa4f6-4404-4957-9d9c-7215330b24ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.807223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa4f6-4404-4957-9d9c-7215330b24ff admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.807601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa4f6-4404-4957-9d9c-7215330b24ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.807978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa4f6-4404-4957-9d9c-7215330b24ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.811444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 997/1996] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:46:36.811598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa4f6-4404-4957-9d9c-7215330b24ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.811598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa4f6-4404-4957-9d9c-7215330b24ff admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.812498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e096f-465a-4dcd-8d5e-ffcfc4d49f2e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.828619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1000/1997] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:36.832113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa4f6-4404-4957-9d9c-7215330b24ff admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.834971 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e096f-465a-4dcd-8d5e-ffcfc4d49f2e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.845893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20212b3c-70c2-4ecf-a4ed-90d3527065f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.846522 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20212b3c-70c2-4ecf-a4ed-90d3527065f2 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.846808 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20212b3c-70c2-4ecf-a4ed-90d3527065f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.847082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20212b3c-70c2-4ecf-a4ed-90d3527065f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.847795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20212b3c-70c2-4ecf-a4ed-90d3527065f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.849484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20212b3c-70c2-4ecf-a4ed-90d3527065f2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.854785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa4f6-4404-4957-9d9c-7215330b24ff admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.869362 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 998/1998] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:36.869685 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87223b8a-3fb1-4d69-9815-b4bf3a705b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.869685 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87223b8a-3fb1-4d69-9815-b4bf3a705b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.869685 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87223b8a-3fb1-4d69-9815-b4bf3a705b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.869685 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87223b8a-3fb1-4d69-9815-b4bf3a705b5c admin admin] PATH_INFO: `/v3/projects/e54e392e5fcc4ec1b4b9f5ab7fca6a66/users/06cd5141ba2642f78beb88ee32045715/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.871851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20212b3c-70c2-4ecf-a4ed-90d3527065f2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.888148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20212b3c-70c2-4ecf-a4ed-90d3527065f2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:36.911115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87223b8a-3fb1-4d69-9815-b4bf3a705b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54e392e5fcc4ec1b4b9f5ab7fca6a66, user_id=06cd5141ba2642f78beb88ee32045715, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.915467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87223b8a-3fb1-4d69-9815-b4bf3a705b5c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.919356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bb7f5-a158-4d0e-a362-fe80e66afadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:36.920070 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb7f5-a158-4d0e-a362-fe80e66afadf admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.920351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb7f5-a158-4d0e-a362-fe80e66afadf admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.920622 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bb7f5-a158-4d0e-a362-fe80e66afadf admin admin] PATH_INFO: `/v3/projects/0267e8e5bdf64fbd86ba1875c8a89cf0/users/6af8f78643c04a09843bfdccd0f067d7/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:36.939879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:36.945210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bb7f5-a158-4d0e-a362-fe80e66afadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0267e8e5bdf64fbd86ba1875c8a89cf0, user_id=6af8f78643c04a09843bfdccd0f067d7, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:36.946393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1001/1999] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:36 2022] PUT /identity/v3/projects/e54e392e5fcc4ec1b4b9f5ab7fca6a66/users/06cd5141ba2642f78beb88ee32045715/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:36.949737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bb7f5-a158-4d0e-a362-fe80e66afadf admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:36.954221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87223b8a-3fb1-4d69-9815-b4bf3a705b5c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:36.980797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 999/2000] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:36 2022] PUT /identity/v3/projects/0267e8e5bdf64fbd86ba1875c8a89cf0/users/6af8f78643c04a09843bfdccd0f067d7/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:36.984597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81829755-1c92-4081-9f02-5d98737d7d76 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:36.985009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81829755-1c92-4081-9f02-5d98737d7d76 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:36.985572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81829755-1c92-4081-9f02-5d98737d7d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:37.025744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-81829755-1c92-4081-9f02-5d98737d7d76 None None] MFA Rules not processed for user `6af8f78643c04a09843bfdccd0f067d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:37.027148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-81829755-1c92-4081-9f02-5d98737d7d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:37.054781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87223b8a-3fb1-4d69-9815-b4bf3a705b5c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:37.108669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1000/2001] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:37.113541 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81829755-1c92-4081-9f02-5d98737d7d76 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:37.169998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db384bcd-351d-4ce7-9329-1d892c16d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:37.170939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db384bcd-351d-4ce7-9329-1d892c16d387 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:37.172816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db384bcd-351d-4ce7-9329-1d892c16d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:37.173010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db384bcd-351d-4ce7-9329-1d892c16d387 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:37.174998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db384bcd-351d-4ce7-9329-1d892c16d387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:37.176522 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db384bcd-351d-4ce7-9329-1d892c16d387 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:37.191550 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1002/2002] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:37.196397 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db384bcd-351d-4ce7-9329-1d892c16d387 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:37.215521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db384bcd-351d-4ce7-9329-1d892c16d387 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:37.222492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fabf5-9c02-4b42-9a93-f3b3ce620244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:37.223286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fabf5-9c02-4b42-9a93-f3b3ce620244 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:37.223653 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fabf5-9c02-4b42-9a93-f3b3ce620244 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:37.223994 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fabf5-9c02-4b42-9a93-f3b3ce620244 admin admin] PATH_INFO: `/v3/projects/e54e392e5fcc4ec1b4b9f5ab7fca6a66/users/06cd5141ba2642f78beb88ee32045715/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:37.227501 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:37.228920 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fabf5-9c02-4b42-9a93-f3b3ce620244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e54e392e5fcc4ec1b4b9f5ab7fca6a66, user_id=06cd5141ba2642f78beb88ee32045715, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:37.232738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81829755-1c92-4081-9f02-5d98737d7d76 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:37.234607 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fabf5-9c02-4b42-9a93-f3b3ce620244 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:37.250617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecf752-8aba-4b2c-aad4-47a04fda5855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:37.251357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecf752-8aba-4b2c-aad4-47a04fda5855 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:37.251649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecf752-8aba-4b2c-aad4-47a04fda5855 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:37.251923 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecf752-8aba-4b2c-aad4-47a04fda5855 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:37.252924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecf752-8aba-4b2c-aad4-47a04fda5855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:37.255442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecf752-8aba-4b2c-aad4-47a04fda5855 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:37.256248 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1003/2003] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:37 2022] PUT /identity/v3/projects/e54e392e5fcc4ec1b4b9f5ab7fca6a66/users/06cd5141ba2642f78beb88ee32045715/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:37.267008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeaefe-a3a2-4fe3-b97c-175fc55d1ab0 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:37.267563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeaefe-a3a2-4fe3-b97c-175fc55d1ab0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:37.268756 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeaefe-a3a2-4fe3-b97c-175fc55d1ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:37.297741 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1001/2004] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:37 2022] POST /identity/v3/projects => generated 403 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:46:37.303222 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecf752-8aba-4b2c-aad4-47a04fda5855 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:37.311816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3afeaefe-a3a2-4fe3-b97c-175fc55d1ab0 None None] MFA Rules not processed for user `06cd5141ba2642f78beb88ee32045715`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:37.313407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3afeaefe-a3a2-4fe3-b97c-175fc55d1ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:37.456596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecf752-8aba-4b2c-aad4-47a04fda5855 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:37.472456 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfcdb8-4870-4de2-96cd-3d993e0c008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:37.473109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfcdb8-4870-4de2-96cd-3d993e0c008d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:37.473416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfcdb8-4870-4de2-96cd-3d993e0c008d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:37.473691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfcdb8-4870-4de2-96cd-3d993e0c008d admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:37.474377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfcdb8-4870-4de2-96cd-3d993e0c008d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:37.476440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfcdb8-4870-4de2-96cd-3d993e0c008d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:37.489858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1004/2005] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:37.502696 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeaefe-a3a2-4fe3-b97c-175fc55d1ab0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:37.504204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3afeaefe-a3a2-4fe3-b97c-175fc55d1ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:37.517357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1002/2006] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:37 2022] POST /identity/v3/users => generated 308 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:37.521831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfcdb8-4870-4de2-96cd-3d993e0c008d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:37.539068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfcdb8-4870-4de2-96cd-3d993e0c008d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:37.548735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:37.553901 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bc91d-e712-4a30-8941-c516f0fd9f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:37.554775 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bc91d-e712-4a30-8941-c516f0fd9f61 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:37.555055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bc91d-e712-4a30-8941-c516f0fd9f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:37.555326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856bc91d-e712-4a30-8941-c516f0fd9f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:37.556306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bc91d-e712-4a30-8941-c516f0fd9f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:37.558179 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856bc91d-e712-4a30-8941-c516f0fd9f61 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:37.592136 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1003/2007] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:37.596205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bc91d-e712-4a30-8941-c516f0fd9f61 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:37.626423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856bc91d-e712-4a30-8941-c516f0fd9f61 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:37.641180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f8676-d035-4a6d-8a88-481826d5547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:37.641885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f8676-d035-4a6d-8a88-481826d5547f admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:37.642246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f8676-d035-4a6d-8a88-481826d5547f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:37.642602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f8676-d035-4a6d-8a88-481826d5547f admin admin] PATH_INFO: `/v3/projects/1385305e8e174a32934cc7659d274d5b/users/76d1d2f5d17d4e3ca7114d68143fd91c/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:37.651069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeaefe-a3a2-4fe3-b97c-175fc55d1ab0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:37.662195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214c23-3da5-457a-8834-6f574eed8ba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:37.663271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214c23-3da5-457a-8834-6f574eed8ba6 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:37.663728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214c23-3da5-457a-8834-6f574eed8ba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:37.664156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10214c23-3da5-457a-8834-6f574eed8ba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:37.679254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10214c23-3da5-457a-8834-6f574eed8ba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:37.682124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10214c23-3da5-457a-8834-6f574eed8ba6 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:37.694441 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f8676-d035-4a6d-8a88-481826d5547f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1385305e8e174a32934cc7659d274d5b, user_id=76d1d2f5d17d4e3ca7114d68143fd91c, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:37.696945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1005/2008] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:37 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:46:37.708748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f8676-d035-4a6d-8a88-481826d5547f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:37.736807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1004/2009] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:37 2022] PUT /identity/v3/projects/1385305e8e174a32934cc7659d274d5b/users/76d1d2f5d17d4e3ca7114d68143fd91c/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:37.739827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214c23-3da5-457a-8834-6f574eed8ba6 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:37.753025 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10214c23-3da5-457a-8834-6f574eed8ba6 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:37.816200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87be8d-64bd-4c3b-9d2c-be22285adacb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:37.816576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87be8d-64bd-4c3b-9d2c-be22285adacb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:37.817542 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87be8d-64bd-4c3b-9d2c-be22285adacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:37.870747 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0e87be8d-64bd-4c3b-9d2c-be22285adacb None None] MFA Rules not processed for user `4a27e5b69e724f8f9148973a012a8ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:37.871992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0e87be8d-64bd-4c3b-9d2c-be22285adacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:37.872640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf57065-ee64-4142-8c19-c8a3d123fe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:37.873385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf57065-ee64-4142-8c19-c8a3d123fe3c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:37.873737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf57065-ee64-4142-8c19-c8a3d123fe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:37.874120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf57065-ee64-4142-8c19-c8a3d123fe3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:37.875021 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf57065-ee64-4142-8c19-c8a3d123fe3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:37.876720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf57065-ee64-4142-8c19-c8a3d123fe3c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:37.892050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1006/2010] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:37.896283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf57065-ee64-4142-8c19-c8a3d123fe3c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:37.908014 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf57065-ee64-4142-8c19-c8a3d123fe3c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:37.913227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f4c7c-f8a2-4bc7-b550-246895f6f55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:37.914231 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f4c7c-f8a2-4bc7-b550-246895f6f55b admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:37.914516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f4c7c-f8a2-4bc7-b550-246895f6f55b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:37.914796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f4c7c-f8a2-4bc7-b550-246895f6f55b admin admin] PATH_INFO: `/v3/projects/1385305e8e174a32934cc7659d274d5b/users/76d1d2f5d17d4e3ca7114d68143fd91c/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:37.917126 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f4c7c-f8a2-4bc7-b550-246895f6f55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1385305e8e174a32934cc7659d274d5b, user_id=76d1d2f5d17d4e3ca7114d68143fd91c, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:37.920091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f4c7c-f8a2-4bc7-b550-246895f6f55b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:37.932329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1007/2011] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:37 2022] PUT /identity/v3/projects/1385305e8e174a32934cc7659d274d5b/users/76d1d2f5d17d4e3ca7114d68143fd91c/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:37.944909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5391e34-9db1-489e-a9dc-7f1bd6be9594 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:37.945271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5391e34-9db1-489e-a9dc-7f1bd6be9594 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:37.945663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5391e34-9db1-489e-a9dc-7f1bd6be9594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:37.962368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1005/2012] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:37.967307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87be8d-64bd-4c3b-9d2c-be22285adacb None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:37.968840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0e87be8d-64bd-4c3b-9d2c-be22285adacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:37.988016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d5391e34-9db1-489e-a9dc-7f1bd6be9594 None None] MFA Rules not processed for user `76d1d2f5d17d4e3ca7114d68143fd91c`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:37.989385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d5391e34-9db1-489e-a9dc-7f1bd6be9594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:38.053835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87be8d-64bd-4c3b-9d2c-be22285adacb None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:38.106958 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:38.121371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1008/2013] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:38.134415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5391e34-9db1-489e-a9dc-7f1bd6be9594 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:38.136026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d5391e34-9db1-489e-a9dc-7f1bd6be9594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:38.171117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf38c7-44ab-4880-b327-c28a2b77a977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:38.171117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf38c7-44ab-4880-b327-c28a2b77a977 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:38.171117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf38c7-44ab-4880-b327-c28a2b77a977 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:38.171117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf38c7-44ab-4880-b327-c28a2b77a977 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:38.171583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf38c7-44ab-4880-b327-c28a2b77a977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:38.171583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf38c7-44ab-4880-b327-c28a2b77a977 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:38.172412 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:38.222706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5391e34-9db1-489e-a9dc-7f1bd6be9594 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:38.230540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb367aa-589f-40b0-8906-3fbdd661e968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:38.232499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb367aa-589f-40b0-8906-3fbdd661e968 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:38.233235 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb367aa-589f-40b0-8906-3fbdd661e968 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:38.237399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1006/2014] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:37 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:46:38.238764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf38c7-44ab-4880-b327-c28a2b77a977 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:38.239228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb367aa-589f-40b0-8906-3fbdd661e968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:38.256810 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb367aa-589f-40b0-8906-3fbdd661e968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:38.258428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb367aa-589f-40b0-8906-3fbdd661e968 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:38.275730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1009/2015] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:38 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:38.336941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf38c7-44ab-4880-b327-c28a2b77a977 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:38.350412 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb367aa-589f-40b0-8906-3fbdd661e968 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:38.354068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a23ec-f3d3-4e7f-99a3-17dede9e3202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:38.358406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a23ec-f3d3-4e7f-99a3-17dede9e3202 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:38.358406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a23ec-f3d3-4e7f-99a3-17dede9e3202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:38.358673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a23ec-f3d3-4e7f-99a3-17dede9e3202 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:38.360065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a23ec-f3d3-4e7f-99a3-17dede9e3202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:38.364615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a23ec-f3d3-4e7f-99a3-17dede9e3202 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:38.365255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb367aa-589f-40b0-8906-3fbdd661e968 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:38.370899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61fd8b-641e-478b-8d93-c025cb4f2b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:38.371720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61fd8b-641e-478b-8d93-c025cb4f2b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:38.372066 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61fd8b-641e-478b-8d93-c025cb4f2b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:38.372415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61fd8b-641e-478b-8d93-c025cb4f2b6b admin admin] PATH_INFO: `/v3/users/be44b8b4fcc944d080f30fdd1e833e00` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:38.373808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61fd8b-641e-478b-8d93-c025cb4f2b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=be44b8b4fcc944d080f30fdd1e833e00)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:38.375818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61fd8b-641e-478b-8d93-c025cb4f2b6b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:38.405430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1007/2016] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:38 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:38.410385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a23ec-f3d3-4e7f-99a3-17dede9e3202 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:38.425881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a23ec-f3d3-4e7f-99a3-17dede9e3202 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:38.432307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c73cff-4581-4212-88a6-4a3bbf39bedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:38.433132 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c73cff-4581-4212-88a6-4a3bbf39bedc admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:38.433551 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c73cff-4581-4212-88a6-4a3bbf39bedc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:38.433868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c73cff-4581-4212-88a6-4a3bbf39bedc admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:38.434620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c73cff-4581-4212-88a6-4a3bbf39bedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:38.436437 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c73cff-4581-4212-88a6-4a3bbf39bedc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:38.447687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cf61fd8b-641e-478b-8d93-c025cb4f2b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be44b8b4fcc944d080f30fdd1e833e00'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:38.453083 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1008/2017] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:38.457185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c73cff-4581-4212-88a6-4a3bbf39bedc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:38.460229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cf61fd8b-641e-478b-8d93-c025cb4f2b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be44b8b4fcc944d080f30fdd1e833e00'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:38.460980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cf61fd8b-641e-478b-8d93-c025cb4f2b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be44b8b4fcc944d080f30fdd1e833e00'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:38.469802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c73cff-4581-4212-88a6-4a3bbf39bedc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:38.475698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0f01c-9479-4c89-b70f-d11e146b84c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:38.476539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0f01c-9479-4c89-b70f-d11e146b84c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:38.476821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0f01c-9479-4c89-b70f-d11e146b84c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:38.477093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0f01c-9479-4c89-b70f-d11e146b84c9 admin admin] PATH_INFO: `/v3/projects/ac343425abb84edbb92dc39df7ad7a1b/users/1338eb4a91464527b4431e83a76d296c/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:38.477669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cf61fd8b-641e-478b-8d93-c025cb4f2b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be44b8b4fcc944d080f30fdd1e833e00'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:38.478566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cf61fd8b-641e-478b-8d93-c025cb4f2b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be44b8b4fcc944d080f30fdd1e833e00'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:38.495417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0f01c-9479-4c89-b70f-d11e146b84c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac343425abb84edbb92dc39df7ad7a1b, user_id=1338eb4a91464527b4431e83a76d296c, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:38.497603 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1010/2018] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:38 2022] DELETE /identity/v3/users/be44b8b4fcc944d080f30fdd1e833e00 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:38.499128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0f01c-9479-4c89-b70f-d11e146b84c9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:38.502244 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a3970-bb52-499e-afc2-37336c37049e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:38.502601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a3970-bb52-499e-afc2-37336c37049e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:38.503041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a3970-bb52-499e-afc2-37336c37049e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:38.522726 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1009/2019] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:38 2022] PUT /identity/v3/projects/ac343425abb84edbb92dc39df7ad7a1b/users/1338eb4a91464527b4431e83a76d296c/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:38.523874 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0f01c-9479-4c89-b70f-d11e146b84c9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:38.526082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-60f0f01c-9479-4c89-b70f-d11e146b84c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:38.533256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7c1a3970-bb52-499e-afc2-37336c37049e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:38.534569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7c1a3970-bb52-499e-afc2-37336c37049e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:38.615320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0f01c-9479-4c89-b70f-d11e146b84c9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:38.621087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:38.621905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:38.622287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:38.622655 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] PATH_INFO: `/v3/users/6af8f78643c04a09843bfdccd0f067d7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:38.625163 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af8f78643c04a09843bfdccd0f067d7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:38.631576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:38.635726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1011/2020] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:38.637469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a3970-bb52-499e-afc2-37336c37049e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:38.641886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7c1a3970-bb52-499e-afc2-37336c37049e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:38.648559 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:38.657686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a3970-bb52-499e-afc2-37336c37049e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:38.662557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7633-04fa-4e79-a66c-4679de03d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:38.663200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7633-04fa-4e79-a66c-4679de03d200 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:38.663483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7633-04fa-4e79-a66c-4679de03d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:38.663753 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b7633-04fa-4e79-a66c-4679de03d200 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:38.664472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b7633-04fa-4e79-a66c-4679de03d200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:38.666325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b7633-04fa-4e79-a66c-4679de03d200 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:38.677503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1012/2021] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:38.678518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7633-04fa-4e79-a66c-4679de03d200 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:38.680273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-df9b7633-04fa-4e79-a66c-4679de03d200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:38.711410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af8f78643c04a09843bfdccd0f067d7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:38.720556 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af8f78643c04a09843bfdccd0f067d7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:38.722981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:38.734985 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af8f78643c04a09843bfdccd0f067d7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:38.736005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af8f78643c04a09843bfdccd0f067d7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:38.756696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af8f78643c04a09843bfdccd0f067d7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:38.764250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1010/2022] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:38 2022] DELETE /identity/v3/users/6af8f78643c04a09843bfdccd0f067d7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:38.765100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:38.766508 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:38.767960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b7633-04fa-4e79-a66c-4679de03d200 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:38.835697 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c38775-7300-424d-9045-2171077e8096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:38.836346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c38775-7300-424d-9045-2171077e8096 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:38.836848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c38775-7300-424d-9045-2171077e8096 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:38.837132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c38775-7300-424d-9045-2171077e8096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:38.839540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-43c38775-7300-424d-9045-2171077e8096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:38.856983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c02d8-3b28-4564-97f3-5d2c69165df6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:38.862557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298b5c3-d200-4a5e-9352-5c83e9528e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:38.863344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298b5c3-d200-4a5e-9352-5c83e9528e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:38.863861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298b5c3-d200-4a5e-9352-5c83e9528e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:38.864231 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298b5c3-d200-4a5e-9352-5c83e9528e5b admin admin] PATH_INFO: `/v3/projects/ac343425abb84edbb92dc39df7ad7a1b/users/1338eb4a91464527b4431e83a76d296c/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:38.866375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298b5c3-d200-4a5e-9352-5c83e9528e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac343425abb84edbb92dc39df7ad7a1b, user_id=1338eb4a91464527b4431e83a76d296c, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:38.869509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298b5c3-d200-4a5e-9352-5c83e9528e5b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:38.881616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1011/2023] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:38 2022] PUT /identity/v3/projects/ac343425abb84edbb92dc39df7ad7a1b/users/1338eb4a91464527b4431e83a76d296c/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:38.883014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1273ab-379f-4fdb-976e-c8feb39d7019 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:38.883367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1273ab-379f-4fdb-976e-c8feb39d7019 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:38.883709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1273ab-379f-4fdb-976e-c8feb39d7019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:38.908890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2b1273ab-379f-4fdb-976e-c8feb39d7019 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:38.910276 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2b1273ab-379f-4fdb-976e-c8feb39d7019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:38.916529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c38775-7300-424d-9045-2171077e8096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:38.920214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c38775-7300-424d-9045-2171077e8096 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:38.932990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1013/2024] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:38.986513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1012/2025] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:38.995158 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c38775-7300-424d-9045-2171077e8096 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:38.996799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-43c38775-7300-424d-9045-2171077e8096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:39.009029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c38775-7300-424d-9045-2171077e8096 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:39.075060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba2e40-6321-4497-9161-5f700629d3c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:39.075950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba2e40-6321-4497-9161-5f700629d3c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:39.075950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba2e40-6321-4497-9161-5f700629d3c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:39.076291 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba2e40-6321-4497-9161-5f700629d3c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:39.094608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba2e40-6321-4497-9161-5f700629d3c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:39.096192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba2e40-6321-4497-9161-5f700629d3c0 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:39.109214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1014/2026] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:46:39.506125 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1273ab-379f-4fdb-976e-c8feb39d7019 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:39.509277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2b1273ab-379f-4fdb-976e-c8feb39d7019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:39.525689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1273ab-379f-4fdb-976e-c8feb39d7019 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:39.531740 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:39.532593 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:39.533003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:39.533460 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] PATH_INFO: `/v3/projects/bcdbc45270224b5ea0be4fbbefa7da13` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:39.549916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcdbc45270224b5ea0be4fbbefa7da13)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:39.551850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:39.586901 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:39.631811 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcdbc45270224b5ea0be4fbbefa7da13', 'request_id': 'req-f42322a5-8328-467d-86dd-56e2bc4221a4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:39.642918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcdbc45270224b5ea0be4fbbefa7da13', 'request_id': 'req-f42322a5-8328-467d-86dd-56e2bc4221a4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:39.651466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcdbc45270224b5ea0be4fbbefa7da13', 'request_id': 'req-f42322a5-8328-467d-86dd-56e2bc4221a4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:39.669904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] The token cache is being invalidate because project bcdbc45270224b5ea0be4fbbefa7da13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:39.670197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:39.671180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:39.673067 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1013/2027] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:39 2022] DELETE /identity/v3/projects/bcdbc45270224b5ea0be4fbbefa7da13 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:39.677674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba2e40-6321-4497-9161-5f700629d3c0 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:39.690708 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba2e40-6321-4497-9161-5f700629d3c0 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:39.721347 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:39.723256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:39.762133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:39.789974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:39.790924 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:39.791301 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:39.791988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] PATH_INFO: `/v3/users/06cd5141ba2642f78beb88ee32045715` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:39.794086 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06cd5141ba2642f78beb88ee32045715)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:39.797874 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:39.878767 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42322a5-8328-467d-86dd-56e2bc4221a4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:39.895419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:39.896511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:39.896901 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:39.897646 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] PATH_INFO: `/v3/projects/0267e8e5bdf64fbd86ba1875c8a89cf0` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:39.899415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0267e8e5bdf64fbd86ba1875c8a89cf0)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:39.901623 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:39.937393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06cd5141ba2642f78beb88ee32045715'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:39.958124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06cd5141ba2642f78beb88ee32045715'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:39.962260 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06cd5141ba2642f78beb88ee32045715'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:39.998544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06cd5141ba2642f78beb88ee32045715'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.001786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06cd5141ba2642f78beb88ee32045715'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.005425 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0267e8e5bdf64fbd86ba1875c8a89cf0', 'request_id': 'req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.015553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0267e8e5bdf64fbd86ba1875c8a89cf0', 'request_id': 'req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.023458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0267e8e5bdf64fbd86ba1875c8a89cf0', 'request_id': 'req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.038492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] The token cache is being invalidate because project 0267e8e5bdf64fbd86ba1875c8a89cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:40.038946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.039678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.041761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1014/2028] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:39 2022] DELETE /identity/v3/projects/0267e8e5bdf64fbd86ba1875c8a89cf0 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:40.042490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1015/2029] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:39 2022] DELETE /identity/v3/users/06cd5141ba2642f78beb88ee32045715 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:40.050513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:40.054326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:40.123602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:40.196596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c47b9-1c96-45d4-a49c-ccd42ce219cb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:40.342694 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9e22a-f7d0-4ed8-aa8f-6d8a9cbce476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:40.343413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9e22a-f7d0-4ed8-aa8f-6d8a9cbce476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:40.345213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9e22a-f7d0-4ed8-aa8f-6d8a9cbce476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:40.345761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9e22a-f7d0-4ed8-aa8f-6d8a9cbce476 admin admin] PATH_INFO: `/v3/users/76d1d2f5d17d4e3ca7114d68143fd91c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:40.349396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9e22a-f7d0-4ed8-aa8f-6d8a9cbce476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d1d2f5d17d4e3ca7114d68143fd91c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:40.354014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9e22a-f7d0-4ed8-aa8f-6d8a9cbce476 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:40.493251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-20f9e22a-f7d0-4ed8-aa8f-6d8a9cbce476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d1d2f5d17d4e3ca7114d68143fd91c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.509067 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-20f9e22a-f7d0-4ed8-aa8f-6d8a9cbce476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d1d2f5d17d4e3ca7114d68143fd91c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.521941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-20f9e22a-f7d0-4ed8-aa8f-6d8a9cbce476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d1d2f5d17d4e3ca7114d68143fd91c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.523329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-20f9e22a-f7d0-4ed8-aa8f-6d8a9cbce476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d1d2f5d17d4e3ca7114d68143fd91c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.574919 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:40.577379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:40.598613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-20f9e22a-f7d0-4ed8-aa8f-6d8a9cbce476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d1d2f5d17d4e3ca7114d68143fd91c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.605572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25647560-3bef-4162-b6f9-5e7c4ab9a488 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:40.610912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1015/2030] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:40 2022] DELETE /identity/v3/users/76d1d2f5d17d4e3ca7114d68143fd91c => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:40.616741 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:40.619867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:40.620150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:40.620420 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93 admin admin] PATH_INFO: `/v3/projects/e54e392e5fcc4ec1b4b9f5ab7fca6a66` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:40.623800 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e54e392e5fcc4ec1b4b9f5ab7fca6a66)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:40.628945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:40.749115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e54e392e5fcc4ec1b4b9f5ab7fca6a66', 'request_id': 'req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.761102 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e54e392e5fcc4ec1b4b9f5ab7fca6a66', 'request_id': 'req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.777485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e54e392e5fcc4ec1b4b9f5ab7fca6a66', 'request_id': 'req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.798476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93 admin admin] The token cache is being invalidate because project e54e392e5fcc4ec1b4b9f5ab7fca6a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:40.798857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.799478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cb2bd6dd-bfb0-42f3-b103-031b8c166a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:40.805065 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1016/2031] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:40 2022] DELETE /identity/v3/projects/e54e392e5fcc4ec1b4b9f5ab7fca6a66 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:40.809227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cee073-2f6d-4b9d-8e24-e41fe451a8a1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:40.810008 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cee073-2f6d-4b9d-8e24-e41fe451a8a1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:40.810253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cee073-2f6d-4b9d-8e24-e41fe451a8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:40.856346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b5cee073-2f6d-4b9d-8e24-e41fe451a8a1 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:40.862855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b5cee073-2f6d-4b9d-8e24-e41fe451a8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:40.979581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:40.995846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1016/2032] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:41.008272 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d973be-0749-4b09-b87b-dd0f189ad128 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:41.008657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d973be-0749-4b09-b87b-dd0f189ad128 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:41.008952 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d973be-0749-4b09-b87b-dd0f189ad128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:41.043063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b3d973be-0749-4b09-b87b-dd0f189ad128 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:41.044475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b3d973be-0749-4b09-b87b-dd0f189ad128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:41.053688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1017/2033] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:41.059534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cee073-2f6d-4b9d-8e24-e41fe451a8a1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:41.085773 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cee073-2f6d-4b9d-8e24-e41fe451a8a1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:41.130872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dd46d-ab3d-4dae-80df-43d134ef2bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:41.130872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dd46d-ab3d-4dae-80df-43d134ef2bca admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:41.130872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dd46d-ab3d-4dae-80df-43d134ef2bca admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:41.130872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dd46d-ab3d-4dae-80df-43d134ef2bca admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:41.131354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56dd46d-ab3d-4dae-80df-43d134ef2bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:41.131354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56dd46d-ab3d-4dae-80df-43d134ef2bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:41.132234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56dd46d-ab3d-4dae-80df-43d134ef2bca admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:41.163756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1017/2034] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:46:41.166948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d973be-0749-4b09-b87b-dd0f189ad128 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:41.171194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dd46d-ab3d-4dae-80df-43d134ef2bca admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:41.173512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c56dd46d-ab3d-4dae-80df-43d134ef2bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:41.181129 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d973be-0749-4b09-b87b-dd0f189ad128 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:41.194600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dd46d-ab3d-4dae-80df-43d134ef2bca admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:41.200644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307da586-d5cf-401b-85a3-ff0ac85b7609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:41.202951 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b7782-6fc1-4a06-b98c-0569adffff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:41.203689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7782-6fc1-4a06-b98c-0569adffff36 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:41.204041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7782-6fc1-4a06-b98c-0569adffff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:41.204384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b7782-6fc1-4a06-b98c-0569adffff36 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:41.205136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b7782-6fc1-4a06-b98c-0569adffff36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:41.206547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307da586-d5cf-401b-85a3-ff0ac85b7609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:41.206913 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307da586-d5cf-401b-85a3-ff0ac85b7609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:41.207392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307da586-d5cf-401b-85a3-ff0ac85b7609 admin admin] PATH_INFO: `/v3/projects/1385305e8e174a32934cc7659d274d5b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:41.208841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307da586-d5cf-401b-85a3-ff0ac85b7609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1385305e8e174a32934cc7659d274d5b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:41.219373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b7782-6fc1-4a06-b98c-0569adffff36 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:41.219669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307da586-d5cf-401b-85a3-ff0ac85b7609 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:41.282528 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1018/2035] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:41 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:41.284852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b7782-6fc1-4a06-b98c-0569adffff36 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:41.314310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:41.336689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-307da586-d5cf-401b-85a3-ff0ac85b7609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1385305e8e174a32934cc7659d274d5b', 'request_id': 'req-307da586-d5cf-401b-85a3-ff0ac85b7609'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:41.355260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-307da586-d5cf-401b-85a3-ff0ac85b7609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1385305e8e174a32934cc7659d274d5b', 'request_id': 'req-307da586-d5cf-401b-85a3-ff0ac85b7609'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:41.364927 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-307da586-d5cf-401b-85a3-ff0ac85b7609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1385305e8e174a32934cc7659d274d5b', 'request_id': 'req-307da586-d5cf-401b-85a3-ff0ac85b7609'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:41.394017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-307da586-d5cf-401b-85a3-ff0ac85b7609 admin admin] The token cache is being invalidate because project 1385305e8e174a32934cc7659d274d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:41.395440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-307da586-d5cf-401b-85a3-ff0ac85b7609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:41.397335 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-307da586-d5cf-401b-85a3-ff0ac85b7609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:41.401324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1018/2036] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:41 2022] DELETE /identity/v3/projects/1385305e8e174a32934cc7659d274d5b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:41.406739 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ce12f-818c-4887-96dd-ed9aa301e8c8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:41.407170 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ce12f-818c-4887-96dd-ed9aa301e8c8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:41.407684 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ce12f-818c-4887-96dd-ed9aa301e8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:41.456415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b7782-6fc1-4a06-b98c-0569adffff36 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:41.463686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-cd5ce12f-818c-4887-96dd-ed9aa301e8c8 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:41.470641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cd5ce12f-818c-4887-96dd-ed9aa301e8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:41.618530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db293341-8722-44fb-ac65-3dd669a26009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:41.619276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db293341-8722-44fb-ac65-3dd669a26009 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:41.619558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db293341-8722-44fb-ac65-3dd669a26009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:41.619831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db293341-8722-44fb-ac65-3dd669a26009 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:41.620524 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db293341-8722-44fb-ac65-3dd669a26009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:41.640535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db293341-8722-44fb-ac65-3dd669a26009 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:41.720870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1019/2037] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:41.731011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c08803-24eb-4737-b108-3615f8d92882 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:41.731300 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c08803-24eb-4737-b108-3615f8d92882 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:41.731631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c08803-24eb-4737-b108-3615f8d92882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:41.738663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1019/2038] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:41 2022] POST /identity/v3/users => generated 290 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:41.739826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db293341-8722-44fb-ac65-3dd669a26009 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:41.743410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-db293341-8722-44fb-ac65-3dd669a26009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:41.774684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db293341-8722-44fb-ac65-3dd669a26009 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:41.775472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-43c08803-24eb-4737-b108-3615f8d92882 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:41.776691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-43c08803-24eb-4737-b108-3615f8d92882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:41.783203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2e807-8af0-431f-ae6a-936d36dd7adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:41.785329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2e807-8af0-431f-ae6a-936d36dd7adc admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:41.787108 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2e807-8af0-431f-ae6a-936d36dd7adc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:41.789072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2e807-8af0-431f-ae6a-936d36dd7adc admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:41.792067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2e807-8af0-431f-ae6a-936d36dd7adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:41.794438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1020/2039] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:41.802004 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2e807-8af0-431f-ae6a-936d36dd7adc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:41.802211 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c08803-24eb-4737-b108-3615f8d92882 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:41.832508 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c08803-24eb-4737-b108-3615f8d92882 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:41.837750 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1020/2040] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:41.847487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2e807-8af0-431f-ae6a-936d36dd7adc admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:41.851595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c9fff-1634-4689-ac9a-ec41c2e9a8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:41.852368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c9fff-1634-4689-ac9a-ec41c2e9a8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:41.852834 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c9fff-1634-4689-ac9a-ec41c2e9a8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:41.853389 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c9fff-1634-4689-ac9a-ec41c2e9a8d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:41.854226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c9fff-1634-4689-ac9a-ec41c2e9a8d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:41.854630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c9fff-1634-4689-ac9a-ec41c2e9a8d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:41.856373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c9fff-1634-4689-ac9a-ec41c2e9a8d2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:41.880615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2e807-8af0-431f-ae6a-936d36dd7adc admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:41.888362 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1021/2041] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:46:41.891347 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c9fff-1634-4689-ac9a-ec41c2e9a8d2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:41.892374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc87b5-8b66-4646-8212-bacb8e2a7f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:41.893354 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc87b5-8b66-4646-8212-bacb8e2a7f22 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:41.894872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc87b5-8b66-4646-8212-bacb8e2a7f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:41.895596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc87b5-8b66-4646-8212-bacb8e2a7f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:41.896806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc87b5-8b66-4646-8212-bacb8e2a7f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:41.911458 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc87b5-8b66-4646-8212-bacb8e2a7f22 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:41.930413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c9fff-1634-4689-ac9a-ec41c2e9a8d2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:41.936401 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1021/2042] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:41.941151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc87b5-8b66-4646-8212-bacb8e2a7f22 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:41.945129 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418cbca-a645-4222-aeb0-8b0eb9857f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:41.946036 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418cbca-a645-4222-aeb0-8b0eb9857f57 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:41.947711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418cbca-a645-4222-aeb0-8b0eb9857f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:41.948090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418cbca-a645-4222-aeb0-8b0eb9857f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:41.948926 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418cbca-a645-4222-aeb0-8b0eb9857f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:41.958442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc87b5-8b66-4646-8212-bacb8e2a7f22 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:41.970579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad50c3-e88d-4d42-b086-826a0d599ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:41.972543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad50c3-e88d-4d42-b086-826a0d599ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:41.972974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad50c3-e88d-4d42-b086-826a0d599ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:41.973613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad50c3-e88d-4d42-b086-826a0d599ccb admin admin] PATH_INFO: `/v3/projects/b66cf3d3adf1434296123bdbb6726ea5/users/d427851e5cd7475faf87155a33f5f57b/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:41.975091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418cbca-a645-4222-aeb0-8b0eb9857f57 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:42.010712 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad50c3-e88d-4d42-b086-826a0d599ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b66cf3d3adf1434296123bdbb6726ea5, user_id=d427851e5cd7475faf87155a33f5f57b, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:42.013919 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad50c3-e88d-4d42-b086-826a0d599ccb admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:42.065978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1022/2043] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:41 2022] PUT /identity/v3/projects/b66cf3d3adf1434296123bdbb6726ea5/users/d427851e5cd7475faf87155a33f5f57b/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:42.072075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1022/2044] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:41 2022] POST /identity/v3/projects => generated 369 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:42.077890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad50c3-e88d-4d42-b086-826a0d599ccb admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:42.081745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d4204-22ad-4c57-a83a-ba924d576cba None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:42.082078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d4204-22ad-4c57-a83a-ba924d576cba None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:42.082459 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d4204-22ad-4c57-a83a-ba924d576cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:42.174845 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c21d4204-22ad-4c57-a83a-ba924d576cba None None] MFA Rules not processed for user `d427851e5cd7475faf87155a33f5f57b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:42.176857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c21d4204-22ad-4c57-a83a-ba924d576cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:42.213368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:42.223196 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad50c3-e88d-4d42-b086-826a0d599ccb admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:42.241646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:42.342435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1023/2045] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:42.348298 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d4204-22ad-4c57-a83a-ba924d576cba None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:42.394772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047e8eb-7d80-451e-b5fb-5dd84f576166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:42.396095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047e8eb-7d80-451e-b5fb-5dd84f576166 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:42.396095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047e8eb-7d80-451e-b5fb-5dd84f576166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:42.396095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047e8eb-7d80-451e-b5fb-5dd84f576166 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:42.396836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047e8eb-7d80-451e-b5fb-5dd84f576166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:42.404342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047e8eb-7d80-451e-b5fb-5dd84f576166 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:42.471399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1023/2046] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:42 2022] POST /identity/v3/users => generated 285 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:46:42.473212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047e8eb-7d80-451e-b5fb-5dd84f576166 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:42.507846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047e8eb-7d80-451e-b5fb-5dd84f576166 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:42.514013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d4204-22ad-4c57-a83a-ba924d576cba None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:42.516239 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c4ed5-4a1f-4c94-9a59-73a9fe550593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:42.517530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c4ed5-4a1f-4c94-9a59-73a9fe550593 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:42.518085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c4ed5-4a1f-4c94-9a59-73a9fe550593 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:42.518548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c4ed5-4a1f-4c94-9a59-73a9fe550593 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:42.519564 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c4ed5-4a1f-4c94-9a59-73a9fe550593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:42.521390 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c4ed5-4a1f-4c94-9a59-73a9fe550593 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:42.529326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33c596-5bc9-484f-ba3a-20f5c9f5d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:42.530019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33c596-5bc9-484f-ba3a-20f5c9f5d09c admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:42.530303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33c596-5bc9-484f-ba3a-20f5c9f5d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:42.530578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33c596-5bc9-484f-ba3a-20f5c9f5d09c admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:42.531268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33c596-5bc9-484f-ba3a-20f5c9f5d09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:42.534620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33c596-5bc9-484f-ba3a-20f5c9f5d09c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:42.536623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1024/2047] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:42.542469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c4ed5-4a1f-4c94-9a59-73a9fe550593 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:42.559229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c4ed5-4a1f-4c94-9a59-73a9fe550593 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:42.583339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddcf71-0c2c-4e6e-ace9-5978c36c4e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:42.584645 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddcf71-0c2c-4e6e-ace9-5978c36c4e7c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:42.585575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddcf71-0c2c-4e6e-ace9-5978c36c4e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:42.586240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddcf71-0c2c-4e6e-ace9-5978c36c4e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:42.588229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddcf71-0c2c-4e6e-ace9-5978c36c4e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:42.591626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddcf71-0c2c-4e6e-ace9-5978c36c4e7c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:42.603853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1024/2048] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:42 2022] POST /identity/v3/projects => generated 379 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:46:42.608777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33c596-5bc9-484f-ba3a-20f5c9f5d09c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:42.623267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1025/2049] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:42.625238 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddcf71-0c2c-4e6e-ace9-5978c36c4e7c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:42.652248 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddcf71-0c2c-4e6e-ace9-5978c36c4e7c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:42.772937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b3256-0d8c-428d-b83d-82b4b04792b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:42.773663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b3256-0d8c-428d-b83d-82b4b04792b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:42.773939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b3256-0d8c-428d-b83d-82b4b04792b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:42.774211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b3256-0d8c-428d-b83d-82b4b04792b8 admin admin] PATH_INFO: `/v3/projects/06826f294ef742a98abdbf4e4d53d7ef/users/70bbfbf63985468f8577a850e5df2158/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:42.775691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33c596-5bc9-484f-ba3a-20f5c9f5d09c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:42.781179 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65f54e-d323-4e9f-810a-6db400a99cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:42.782375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65f54e-d323-4e9f-810a-6db400a99cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:42.783133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65f54e-d323-4e9f-810a-6db400a99cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:42.784572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65f54e-d323-4e9f-810a-6db400a99cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:42.785526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65f54e-d323-4e9f-810a-6db400a99cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:42.789077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65f54e-d323-4e9f-810a-6db400a99cb3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:42.817015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b3256-0d8c-428d-b83d-82b4b04792b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06826f294ef742a98abdbf4e4d53d7ef, user_id=70bbfbf63985468f8577a850e5df2158, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:42.823913 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1025/2050] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:42 2022] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:42.826407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b3256-0d8c-428d-b83d-82b4b04792b8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:42.828265 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65f54e-d323-4e9f-810a-6db400a99cb3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:42.845452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65f54e-d323-4e9f-810a-6db400a99cb3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:42.851942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1026/2051] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:42 2022] PUT /identity/v3/projects/06826f294ef742a98abdbf4e4d53d7ef/users/70bbfbf63985468f8577a850e5df2158/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:42.867503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87cd86-490e-4a73-818d-85cbd56c6571 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:42.867975 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87cd86-490e-4a73-818d-85cbd56c6571 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:42.868414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87cd86-490e-4a73-818d-85cbd56c6571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:42.908819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:42.930018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-da87cd86-490e-4a73-818d-85cbd56c6571 None None] MFA Rules not processed for user `70bbfbf63985468f8577a850e5df2158`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:42.931612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-da87cd86-490e-4a73-818d-85cbd56c6571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:42.971683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc462d-d68e-4327-b6ca-f86b67999c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:42.972333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc462d-d68e-4327-b6ca-f86b67999c99 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:42.972615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc462d-d68e-4327-b6ca-f86b67999c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:42.972889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc462d-d68e-4327-b6ca-f86b67999c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:42.973643 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc462d-d68e-4327-b6ca-f86b67999c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:42.975316 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc462d-d68e-4327-b6ca-f86b67999c99 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:42.999001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1026/2052] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:43.005312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc462d-d68e-4327-b6ca-f86b67999c99 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:43.017799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:43.028585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc462d-d68e-4327-b6ca-f86b67999c99 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:43.040366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09a3c5-1da9-4384-91c2-4f998ea39d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:43.041265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1027/2053] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:43.041545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09a3c5-1da9-4384-91c2-4f998ea39d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:43.041626 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09a3c5-1da9-4384-91c2-4f998ea39d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:43.041930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09a3c5-1da9-4384-91c2-4f998ea39d81 admin admin] PATH_INFO: `/v3/projects/6bd61622ca044200b6aabaa8a3c41d98/users/c7a7a5562d414773bcd476b450f139a5/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:43.045532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87cd86-490e-4a73-818d-85cbd56c6571 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:43.060039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87cd86-490e-4a73-818d-85cbd56c6571 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:43.068083 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5f93a-f80e-4dcd-bcd9-12b61960a6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:43.070851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09a3c5-1da9-4384-91c2-4f998ea39d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd61622ca044200b6aabaa8a3c41d98, user_id=c7a7a5562d414773bcd476b450f139a5, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:43.072473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f93a-f80e-4dcd-bcd9-12b61960a6bd admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:43.072826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f93a-f80e-4dcd-bcd9-12b61960a6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:43.073250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f93a-f80e-4dcd-bcd9-12b61960a6bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:43.074341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5f93a-f80e-4dcd-bcd9-12b61960a6bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:43.075958 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09a3c5-1da9-4384-91c2-4f998ea39d81 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:43.076670 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5f93a-f80e-4dcd-bcd9-12b61960a6bd admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:43.107071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1027/2054] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:43 2022] PUT /identity/v3/projects/6bd61622ca044200b6aabaa8a3c41d98/users/c7a7a5562d414773bcd476b450f139a5/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:43.113529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09a3c5-1da9-4384-91c2-4f998ea39d81 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:43.158003 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1028/2055] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:43 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:46:43.162182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5f93a-f80e-4dcd-bcd9-12b61960a6bd admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:43.272034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09a3c5-1da9-4384-91c2-4f998ea39d81 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:43.322038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5f93a-f80e-4dcd-bcd9-12b61960a6bd admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:43.340265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639a992-eaea-4bea-9dd6-ffdceb267a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:43.341532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639a992-eaea-4bea-9dd6-ffdceb267a7b admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:43.341848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639a992-eaea-4bea-9dd6-ffdceb267a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:43.342124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639a992-eaea-4bea-9dd6-ffdceb267a7b admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:43.342824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639a992-eaea-4bea-9dd6-ffdceb267a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:43.344825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639a992-eaea-4bea-9dd6-ffdceb267a7b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:43.384643 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1029/2056] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:43 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:43.384643 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639a992-eaea-4bea-9dd6-ffdceb267a7b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:43.384968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9639a992-eaea-4bea-9dd6-ffdceb267a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:43.401857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639a992-eaea-4bea-9dd6-ffdceb267a7b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:43.408127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:43.408968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:43.409220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:43.409536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] PATH_INFO: `/v3/users/070c559949ae423fa36a88ecf6fa0a1e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:43.415651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=070c559949ae423fa36a88ecf6fa0a1e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:43.418183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:43.444062 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbb09a-e013-4209-9d42-e1409763409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:43.444893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbb09a-e013-4209-9d42-e1409763409c admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:43.445199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbb09a-e013-4209-9d42-e1409763409c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:43.445470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbb09a-e013-4209-9d42-e1409763409c admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:43.446187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbb09a-e013-4209-9d42-e1409763409c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:43.449269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbb09a-e013-4209-9d42-e1409763409c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:43.490566 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1028/2057] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:43.491868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbb09a-e013-4209-9d42-e1409763409c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:43.503517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070c559949ae423fa36a88ecf6fa0a1e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:43.511833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070c559949ae423fa36a88ecf6fa0a1e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:43.512976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070c559949ae423fa36a88ecf6fa0a1e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:43.528815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbb09a-e013-4209-9d42-e1409763409c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:43.530163 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070c559949ae423fa36a88ecf6fa0a1e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:43.531376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070c559949ae423fa36a88ecf6fa0a1e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:43.543534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96069b81-eee6-48f8-a111-8cc6c922bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:43.545914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069b81-eee6-48f8-a111-8cc6c922bdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:43.547271 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069b81-eee6-48f8-a111-8cc6c922bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:43.549230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96069b81-eee6-48f8-a111-8cc6c922bdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:43.552302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96069b81-eee6-48f8-a111-8cc6c922bdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:43.553901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1030/2058] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:43 2022] DELETE /identity/v3/users/070c559949ae423fa36a88ecf6fa0a1e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:43.558838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96069b81-eee6-48f8-a111-8cc6c922bdd4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:43.559165 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:43.568503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:43.600440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1029/2059] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:43.604153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28b9d2-0bd0-408b-904f-e1d0a9452f85 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:43.614442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28b9d2-0bd0-408b-904f-e1d0a9452f85 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:43.615065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28b9d2-0bd0-408b-904f-e1d0a9452f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:43.662603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6c28b9d2-0bd0-408b-904f-e1d0a9452f85 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:43.668237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6c28b9d2-0bd0-408b-904f-e1d0a9452f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:43.687685 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:43.753296 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c26d6-3cee-4de1-abb9-74bd1192e36e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:43.771195 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4de098-b293-4cf2-919c-991d7e9308b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:43.771901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4de098-b293-4cf2-919c-991d7e9308b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:43.772185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4de098-b293-4cf2-919c-991d7e9308b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:43.772460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4de098-b293-4cf2-919c-991d7e9308b4 admin admin] PATH_INFO: `/v3/projects/6bd61622ca044200b6aabaa8a3c41d98/users/c7a7a5562d414773bcd476b450f139a5/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:43.775204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4de098-b293-4cf2-919c-991d7e9308b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd61622ca044200b6aabaa8a3c41d98, user_id=c7a7a5562d414773bcd476b450f139a5, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:43.778489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4de098-b293-4cf2-919c-991d7e9308b4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:43.800836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:43.809671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1031/2060] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:43 2022] PUT /identity/v3/projects/6bd61622ca044200b6aabaa8a3c41d98/users/c7a7a5562d414773bcd476b450f139a5/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:43.821265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4de098-b293-4cf2-919c-991d7e9308b4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:43.822120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4c4de098-b293-4cf2-919c-991d7e9308b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:43.945010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1030/2061] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:43.948557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3c7ea-4360-42ca-8193-39c27060e190 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:43.949207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3c7ea-4360-42ca-8193-39c27060e190 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:43.949642 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3c7ea-4360-42ca-8193-39c27060e190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:44.005495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4de098-b293-4cf2-919c-991d7e9308b4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:44.016265 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1cc3c7ea-4360-42ca-8193-39c27060e190 None None] MFA Rules not processed for user `c7a7a5562d414773bcd476b450f139a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:44.018085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1cc3c7ea-4360-42ca-8193-39c27060e190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:44.028074 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4e60c-6c9f-4128-a068-1769ea6b82f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:44.029338 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4e60c-6c9f-4128-a068-1769ea6b82f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:44.029638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4e60c-6c9f-4128-a068-1769ea6b82f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:44.029914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4e60c-6c9f-4128-a068-1769ea6b82f2 admin admin] PATH_INFO: `/v3/projects/1c00df98bd7c4f0ebde01f5395f42a2c/users/cfd9870c91754fb8a3ffcc0674e3568b/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:44.054675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4e60c-6c9f-4128-a068-1769ea6b82f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c00df98bd7c4f0ebde01f5395f42a2c, user_id=cfd9870c91754fb8a3ffcc0674e3568b, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:44.060010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4e60c-6c9f-4128-a068-1769ea6b82f2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:44.100884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1032/2062] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:43 2022] PUT /identity/v3/projects/1c00df98bd7c4f0ebde01f5395f42a2c/users/cfd9870c91754fb8a3ffcc0674e3568b/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:44.102196 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4e60c-6c9f-4128-a068-1769ea6b82f2 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:44.104771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2ce4e60c-6c9f-4128-a068-1769ea6b82f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:44.127947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1031/2063] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:44.128704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3c7ea-4360-42ca-8193-39c27060e190 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:44.146785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3c7ea-4360-42ca-8193-39c27060e190 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:44.234506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4e60c-6c9f-4128-a068-1769ea6b82f2 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:44.244579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62993175-961e-43fa-bb1e-c6017107b71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:44.246617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62993175-961e-43fa-bb1e-c6017107b71e service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:44.246969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62993175-961e-43fa-bb1e-c6017107b71e service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:44.247661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62993175-961e-43fa-bb1e-c6017107b71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:44.256652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a361c94-5fbc-427d-bcd7-e3937b58268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:44.259387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a361c94-5fbc-427d-bcd7-e3937b58268e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:44.260173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a361c94-5fbc-427d-bcd7-e3937b58268e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:44.261441 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a361c94-5fbc-427d-bcd7-e3937b58268e admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:44.263382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a361c94-5fbc-427d-bcd7-e3937b58268e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:44.267735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a361c94-5fbc-427d-bcd7-e3937b58268e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:44.272918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62993175-961e-43fa-bb1e-c6017107b71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:44.278814 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62993175-961e-43fa-bb1e-c6017107b71e service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:44.296961 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1032/2064] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:44.297861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a361c94-5fbc-427d-bcd7-e3937b58268e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:44.304912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2a361c94-5fbc-427d-bcd7-e3937b58268e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:44.310720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1033/2065] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:44.313816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62993175-961e-43fa-bb1e-c6017107b71e service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:44.333791 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62993175-961e-43fa-bb1e-c6017107b71e service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:44.345526 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ef19f-95d2-4359-87c2-4bde87ba5cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:44.346226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ef19f-95d2-4359-87c2-4bde87ba5cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:44.346502 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ef19f-95d2-4359-87c2-4bde87ba5cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:44.346764 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ef19f-95d2-4359-87c2-4bde87ba5cc8 admin admin] PATH_INFO: `/v3/projects/1c00df98bd7c4f0ebde01f5395f42a2c/users/cfd9870c91754fb8a3ffcc0674e3568b/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:44.350085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ef19f-95d2-4359-87c2-4bde87ba5cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c00df98bd7c4f0ebde01f5395f42a2c, user_id=cfd9870c91754fb8a3ffcc0674e3568b, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:44.357312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ef19f-95d2-4359-87c2-4bde87ba5cc8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:44.394820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1034/2066] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:44 2022] PUT /identity/v3/projects/1c00df98bd7c4f0ebde01f5395f42a2c/users/cfd9870c91754fb8a3ffcc0674e3568b/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:44.412044 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc26e78-bc6c-4d59-8b28-10ffd193cf8c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:44.412907 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc26e78-bc6c-4d59-8b28-10ffd193cf8c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:44.413274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc26e78-bc6c-4d59-8b28-10ffd193cf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:44.438800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a361c94-5fbc-427d-bcd7-e3937b58268e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:44.466776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:44.501200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9fc26e78-bc6c-4d59-8b28-10ffd193cf8c None None] MFA Rules not processed for user `cfd9870c91754fb8a3ffcc0674e3568b`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:44.507318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9fc26e78-bc6c-4d59-8b28-10ffd193cf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:44.545035 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f571d-8745-464f-afa9-24154a1d2150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:44.545923 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f571d-8745-464f-afa9-24154a1d2150 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:44.546427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f571d-8745-464f-afa9-24154a1d2150 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:44.546800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f571d-8745-464f-afa9-24154a1d2150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:44.549512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2f1f571d-8745-464f-afa9-24154a1d2150 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:44.600375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:44.691068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f571d-8745-464f-afa9-24154a1d2150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:44.693208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f571d-8745-464f-afa9-24154a1d2150 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:44.707899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1033/2067] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:44.712615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1035/2068] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:44 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:44.726302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f571d-8745-464f-afa9-24154a1d2150 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:44.728144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2f1f571d-8745-464f-afa9-24154a1d2150 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:44.742936 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f571d-8745-464f-afa9-24154a1d2150 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:44.749516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6746b-e2de-4bff-8278-7f3f4b0cac92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:44.750497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6746b-e2de-4bff-8278-7f3f4b0cac92 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:44.750791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6746b-e2de-4bff-8278-7f3f4b0cac92 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:44.751074 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6746b-e2de-4bff-8278-7f3f4b0cac92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:44.764332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6746b-e2de-4bff-8278-7f3f4b0cac92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:44.765918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6746b-e2de-4bff-8278-7f3f4b0cac92 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:44.791572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1034/2069] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:44 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:44.878566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc26e78-bc6c-4d59-8b28-10ffd193cf8c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:44.890142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc26e78-bc6c-4d59-8b28-10ffd193cf8c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:44.908509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87031bd1-3a08-43a3-9e87-d2580df20d74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:44.909157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87031bd1-3a08-43a3-9e87-d2580df20d74 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:44.909473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87031bd1-3a08-43a3-9e87-d2580df20d74 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:44.910037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87031bd1-3a08-43a3-9e87-d2580df20d74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:44.918183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-87031bd1-3a08-43a3-9e87-d2580df20d74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:45.060003 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87031bd1-3a08-43a3-9e87-d2580df20d74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:45.064120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87031bd1-3a08-43a3-9e87-d2580df20d74 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:45.089376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1036/2070] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:46:45.195841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6746b-e2de-4bff-8278-7f3f4b0cac92 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:45.198202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-78e6746b-e2de-4bff-8278-7f3f4b0cac92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:45.352265 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6746b-e2de-4bff-8278-7f3f4b0cac92 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:45.360792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33056473-1c68-4839-a9d4-9d08da92a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:45.361498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33056473-1c68-4839-a9d4-9d08da92a88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:45.361777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33056473-1c68-4839-a9d4-9d08da92a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:45.362122 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33056473-1c68-4839-a9d4-9d08da92a88d admin admin] PATH_INFO: `/v3/projects/ac9b3ae1dbfa4bc59f5c7b7d457930e9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:45.364118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33056473-1c68-4839-a9d4-9d08da92a88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9b3ae1dbfa4bc59f5c7b7d457930e9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:45.367399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33056473-1c68-4839-a9d4-9d08da92a88d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:45.493773 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-33056473-1c68-4839-a9d4-9d08da92a88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9b3ae1dbfa4bc59f5c7b7d457930e9', 'request_id': 'req-33056473-1c68-4839-a9d4-9d08da92a88d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:45.505074 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-33056473-1c68-4839-a9d4-9d08da92a88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9b3ae1dbfa4bc59f5c7b7d457930e9', 'request_id': 'req-33056473-1c68-4839-a9d4-9d08da92a88d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:45.509825 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:45.527540 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-33056473-1c68-4839-a9d4-9d08da92a88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9b3ae1dbfa4bc59f5c7b7d457930e9', 'request_id': 'req-33056473-1c68-4839-a9d4-9d08da92a88d'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:45.552104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-33056473-1c68-4839-a9d4-9d08da92a88d admin admin] The token cache is being invalidate because project ac9b3ae1dbfa4bc59f5c7b7d457930e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:45.552485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-33056473-1c68-4839-a9d4-9d08da92a88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:45.553246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-33056473-1c68-4839-a9d4-9d08da92a88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:45.556180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1035/2071] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:45 2022] DELETE /identity/v3/projects/ac9b3ae1dbfa4bc59f5c7b7d457930e9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:45.560278 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac581-43cd-4b3e-8c95-483d868b9e4e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:45.560566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac581-43cd-4b3e-8c95-483d868b9e4e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:45.560843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac581-43cd-4b3e-8c95-483d868b9e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:45.593736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-de4ac581-43cd-4b3e-8c95-483d868b9e4e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:45.595411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-de4ac581-43cd-4b3e-8c95-483d868b9e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:45.747223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1037/2072] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:45.755394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f00cba-734c-4f30-882c-232e587ba47a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:45.755731 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f00cba-734c-4f30-882c-232e587ba47a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:45.755981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f00cba-734c-4f30-882c-232e587ba47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:45.779383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-21f00cba-734c-4f30-882c-232e587ba47a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:45.780613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-21f00cba-734c-4f30-882c-232e587ba47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:45.790126 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1036/2073] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:45.794058 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ac581-43cd-4b3e-8c95-483d868b9e4e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:45.806614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ac581-43cd-4b3e-8c95-483d868b9e4e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:45.812972 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b6efd-a53f-4e84-b9e1-2151fb463d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:45.813653 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b6efd-a53f-4e84-b9e1-2151fb463d36 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:45.814598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b6efd-a53f-4e84-b9e1-2151fb463d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:45.818645 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b6efd-a53f-4e84-b9e1-2151fb463d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:45.819690 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b6efd-a53f-4e84-b9e1-2151fb463d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:45.820152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b6efd-a53f-4e84-b9e1-2151fb463d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:45.824206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b6efd-a53f-4e84-b9e1-2151fb463d36 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:45.854224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1038/2074] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:46:45.858449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f00cba-734c-4f30-882c-232e587ba47a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:45.869360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f00cba-734c-4f30-882c-232e587ba47a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:45.875888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54e5a-6405-495d-8e0e-826c4fb15ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:45.876535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54e5a-6405-495d-8e0e-826c4fb15ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:45.876826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54e5a-6405-495d-8e0e-826c4fb15ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:45.877102 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54e5a-6405-495d-8e0e-826c4fb15ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:45.878005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf54e5a-6405-495d-8e0e-826c4fb15ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:45.879966 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf54e5a-6405-495d-8e0e-826c4fb15ee0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:45.946178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1037/2075] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:45 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:45.947466 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b6efd-a53f-4e84-b9e1-2151fb463d36 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:45.970951 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b6efd-a53f-4e84-b9e1-2151fb463d36 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:46.037444 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:46.052287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e691aea-04e4-4825-a9ed-49e0278de36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:46.053482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e691aea-04e4-4825-a9ed-49e0278de36b admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:46.053760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e691aea-04e4-4825-a9ed-49e0278de36b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:46.054027 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e691aea-04e4-4825-a9ed-49e0278de36b admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:46.055178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e691aea-04e4-4825-a9ed-49e0278de36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:46.057152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e691aea-04e4-4825-a9ed-49e0278de36b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:46.085454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1039/2076] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:45 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:46.090504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54e5a-6405-495d-8e0e-826c4fb15ee0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:46.110772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54e5a-6405-495d-8e0e-826c4fb15ee0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:46.116538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c4584-f97e-4b67-8737-0e26ce06ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:46.117584 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4584-f97e-4b67-8737-0e26ce06ea34 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:46.118552 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4584-f97e-4b67-8737-0e26ce06ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:46.118552 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c4584-f97e-4b67-8737-0e26ce06ea34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:46.119944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c4584-f97e-4b67-8737-0e26ce06ea34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:46.124967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c4584-f97e-4b67-8737-0e26ce06ea34 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:46.136501 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f435ac-712e-45b4-91de-8a0956c7a4a3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:46.136966 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f435ac-712e-45b4-91de-8a0956c7a4a3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:46.137211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f435ac-712e-45b4-91de-8a0956c7a4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:46.141790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1038/2077] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:46:46.146034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c4584-f97e-4b67-8737-0e26ce06ea34 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:46.156332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c4584-f97e-4b67-8737-0e26ce06ea34 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:46.161201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e203-d047-427a-afc9-0feae0aca635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:46.161865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e203-d047-427a-afc9-0feae0aca635 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:46.162149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e203-d047-427a-afc9-0feae0aca635 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:46.162432 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e203-d047-427a-afc9-0feae0aca635 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:46.163133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489e203-d047-427a-afc9-0feae0aca635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:46.164959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489e203-d047-427a-afc9-0feae0aca635 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:46.176210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1039/2078] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:46:46.177407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-26f435ac-712e-45b4-91de-8a0956c7a4a3 None None] MFA Rules not processed for user `1338eb4a91464527b4431e83a76d296c`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:46.179379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-26f435ac-712e-45b4-91de-8a0956c7a4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:46.180020 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e203-d047-427a-afc9-0feae0aca635 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:46.190544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e203-d047-427a-afc9-0feae0aca635 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:46.196124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c51b5f-df4a-4aa1-a7df-2a4decdaa96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:46.196917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c51b5f-df4a-4aa1-a7df-2a4decdaa96f admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:46.197419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c51b5f-df4a-4aa1-a7df-2a4decdaa96f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:46.198026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c51b5f-df4a-4aa1-a7df-2a4decdaa96f admin admin] PATH_INFO: `/v3/projects/eb5ff6c78cd3424580f0a6c779fedf23/users/b5161ddf5f464784b4000fe204d198e2/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:46.215611 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c51b5f-df4a-4aa1-a7df-2a4decdaa96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5ff6c78cd3424580f0a6c779fedf23, user_id=b5161ddf5f464784b4000fe204d198e2, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:46.218533 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c51b5f-df4a-4aa1-a7df-2a4decdaa96f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:46.235163 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1040/2079] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:46 2022] PUT /identity/v3/projects/eb5ff6c78cd3424580f0a6c779fedf23/users/b5161ddf5f464784b4000fe204d198e2/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:46.245868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecb034-f7c3-4392-85d8-ad424e4a1131 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:46.246378 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecb034-f7c3-4392-85d8-ad424e4a1131 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:46.246854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ecb034-f7c3-4392-85d8-ad424e4a1131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:46.279954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a5ecb034-f7c3-4392-85d8-ad424e4a1131 None None] MFA Rules not processed for user `b5161ddf5f464784b4000fe204d198e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:46.282442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a5ecb034-f7c3-4392-85d8-ad424e4a1131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:46.297969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1040/2080] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:46.303707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f435ac-712e-45b4-91de-8a0956c7a4a3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:46.305207 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-26f435ac-712e-45b4-91de-8a0956c7a4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:46.376274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f435ac-712e-45b4-91de-8a0956c7a4a3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:46.378162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1041/2081] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:46.378905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecb034-f7c3-4392-85d8-ad424e4a1131 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:46.380372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a5ecb034-f7c3-4392-85d8-ad424e4a1131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:46.448991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ecb034-f7c3-4392-85d8-ad424e4a1131 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:46.450197 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d980a9-8e48-436b-8ec9-81e5c98854df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:46.450836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d980a9-8e48-436b-8ec9-81e5c98854df service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:46.451111 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d980a9-8e48-436b-8ec9-81e5c98854df service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:46.451379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d980a9-8e48-436b-8ec9-81e5c98854df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:46.453556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-95d980a9-8e48-436b-8ec9-81e5c98854df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:46.453974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348339a-2ccf-4027-bb85-f0d8b6845bf5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2402339784b34d98a4670db912617331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:46.454803 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348339a-2ccf-4027-bb85-f0d8b6845bf5 service glance] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:46.455046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348339a-2ccf-4027-bb85-f0d8b6845bf5 service glance] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:46.455315 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348339a-2ccf-4027-bb85-f0d8b6845bf5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:46.457237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3348339a-2ccf-4027-bb85-f0d8b6845bf5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:46.474649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:46.508843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:46.552413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348339a-2ccf-4027-bb85-f0d8b6845bf5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:46.553937 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3348339a-2ccf-4027-bb85-f0d8b6845bf5 service glance] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:46.570462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1042/2082] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:46.571414 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348339a-2ccf-4027-bb85-f0d8b6845bf5 service glance] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:46.571986 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d980a9-8e48-436b-8ec9-81e5c98854df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:46.573068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3348339a-2ccf-4027-bb85-f0d8b6845bf5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:46.573922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d980a9-8e48-436b-8ec9-81e5c98854df service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:46.585510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3348339a-2ccf-4027-bb85-f0d8b6845bf5 service glance] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:46.590899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1a392-e215-4615-9df9-ce94133017d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:46.591782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1041/2083] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:46.592366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1a392-e215-4615-9df9-ce94133017d5 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:46.592648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1a392-e215-4615-9df9-ce94133017d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:46.592922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1a392-e215-4615-9df9-ce94133017d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:46.605072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1a392-e215-4615-9df9-ce94133017d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:46.606568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1a392-e215-4615-9df9-ce94133017d5 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:46.643949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1043/2084] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:46.894621 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d5f54-5145-412b-86f5-222c5f97b3ef None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:46.894985 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d5f54-5145-412b-86f5-222c5f97b3ef None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:46.895695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d5f54-5145-412b-86f5-222c5f97b3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:46.927997 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cb6d5f54-5145-412b-86f5-222c5f97b3ef None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:46.929513 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cb6d5f54-5145-412b-86f5-222c5f97b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:47.019377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1042/2085] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:46:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:47.090738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1a392-e215-4615-9df9-ce94133017d5 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:47.091424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-24a1a392-e215-4615-9df9-ce94133017d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:47.213417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1a392-e215-4615-9df9-ce94133017d5 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:47.219865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91bd422-949e-4fe3-8fd2-36beec7ef6b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:47.220726 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bd422-949e-4fe3-8fd2-36beec7ef6b3 service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:47.220910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bd422-949e-4fe3-8fd2-36beec7ef6b3 service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:47.221158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91bd422-949e-4fe3-8fd2-36beec7ef6b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:47.231067 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bd422-949e-4fe3-8fd2-36beec7ef6b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:47.232941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91bd422-949e-4fe3-8fd2-36beec7ef6b3 service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:47.242372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1044/2086] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:46:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:46:49.767918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d5f54-5145-412b-86f5-222c5f97b3ef None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:49.770422 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cb6d5f54-5145-412b-86f5-222c5f97b3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:49.855705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d5f54-5145-412b-86f5-222c5f97b3ef None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:49.870372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:49.871350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:49.872037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:49.875588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] PATH_INFO: `/v3/users/70bbfbf63985468f8577a850e5df2158` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:49.877889 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70bbfbf63985468f8577a850e5df2158)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:49.880813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:49.990422 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bbfbf63985468f8577a850e5df2158'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:50.000159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bbfbf63985468f8577a850e5df2158'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:50.001759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bbfbf63985468f8577a850e5df2158'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:50.020741 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bbfbf63985468f8577a850e5df2158'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:50.021769 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bbfbf63985468f8577a850e5df2158'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:50.027287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:50.053461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76430ae-4c98-4617-a921-e56a6f4bb36f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:50.054042 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76430ae-4c98-4617-a921-e56a6f4bb36f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:50.054218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76430ae-4c98-4617-a921-e56a6f4bb36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:50.057151 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1043/2087] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:49 2022] DELETE /identity/v3/users/70bbfbf63985468f8577a850e5df2158 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:50.082929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d76430ae-4c98-4617-a921-e56a6f4bb36f None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:50.084333 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d76430ae-4c98-4617-a921-e56a6f4bb36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:50.180663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1045/2088] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:50.192526 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:50.194616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:50.278032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406638e3-d386-41b0-92ca-a32773827d86 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:50.281842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995c90a-a8dc-4099-a508-d51944e13493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:50.282556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995c90a-a8dc-4099-a508-d51944e13493 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:50.282901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995c90a-a8dc-4099-a508-d51944e13493 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:50.283233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995c90a-a8dc-4099-a508-d51944e13493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:50.296733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995c90a-a8dc-4099-a508-d51944e13493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:50.298306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995c90a-a8dc-4099-a508-d51944e13493 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:50.311076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1044/2089] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:50.475528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76430ae-4c98-4617-a921-e56a6f4bb36f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:50.479069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d76430ae-4c98-4617-a921-e56a6f4bb36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:50.501624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76430ae-4c98-4617-a921-e56a6f4bb36f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:50.506535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:50.507214 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:50.507492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:50.507762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] PATH_INFO: `/v3/users/b5161ddf5f464784b4000fe204d198e2` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:50.509723 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5161ddf5f464784b4000fe204d198e2)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:50.511822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:50.553408 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:50.577031 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5161ddf5f464784b4000fe204d198e2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:50.585813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5161ddf5f464784b4000fe204d198e2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:50.596539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5161ddf5f464784b4000fe204d198e2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:50.597431 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5161ddf5f464784b4000fe204d198e2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:50.621256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5161ddf5f464784b4000fe204d198e2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:50.631598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1046/2090] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:50 2022] DELETE /identity/v3/users/b5161ddf5f464784b4000fe204d198e2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:50.633447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09835250-6e47-402e-b774-b6a6eb5450ef None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:50.633920 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09835250-6e47-402e-b774-b6a6eb5450ef None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:50.634417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09835250-6e47-402e-b774-b6a6eb5450ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:50.659331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-09835250-6e47-402e-b774-b6a6eb5450ef None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:50.660827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-09835250-6e47-402e-b774-b6a6eb5450ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:50.795098 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:50.799197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:50.813396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1045/2091] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:50.815423 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09835250-6e47-402e-b774-b6a6eb5450ef None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:50.818189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-09835250-6e47-402e-b774-b6a6eb5450ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:50.849519 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6131a8-91d4-47e6-95f3-58e06b47cc91 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:50.867136 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:50.868159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:50.868612 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:50.869631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] PATH_INFO: `/v3/projects/06826f294ef742a98abdbf4e4d53d7ef` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:50.871201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] RBAC: Authorizing `identity:delete_project(project_id=06826f294ef742a98abdbf4e4d53d7ef)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:50.874062 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:50.929819 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09835250-6e47-402e-b774-b6a6eb5450ef None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:50.968298 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06826f294ef742a98abdbf4e4d53d7ef', 'request_id': 'req-0cae922e-529e-4bb0-a34c-5627e35aa06a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:50.990081 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06826f294ef742a98abdbf4e4d53d7ef', 'request_id': 'req-0cae922e-529e-4bb0-a34c-5627e35aa06a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.011362 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06826f294ef742a98abdbf4e4d53d7ef', 'request_id': 'req-0cae922e-529e-4bb0-a34c-5627e35aa06a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.019700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58dee5-0a61-4d30-8322-173534d891f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:51.021236 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58dee5-0a61-4d30-8322-173534d891f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:51.021653 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58dee5-0a61-4d30-8322-173534d891f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:51.023187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58dee5-0a61-4d30-8322-173534d891f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:51.032366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:51.041116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] The token cache is being invalidate because project 06826f294ef742a98abdbf4e4d53d7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:51.042366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.043374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.045427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1047/2092] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:50 2022] DELETE /identity/v3/projects/06826f294ef742a98abdbf4e4d53d7ef => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:51.046045 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:51.047416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:51.121598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58dee5-0a61-4d30-8322-173534d891f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:51.123041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58dee5-0a61-4d30-8322-173534d891f7 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:51.129799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae922e-529e-4bb0-a34c-5627e35aa06a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:51.137882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:51.138903 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:51.139352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:51.140706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] PATH_INFO: `/v3/users/d427851e5cd7475faf87155a33f5f57b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:51.142864 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1046/2093] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:51.143159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d427851e5cd7475faf87155a33f5f57b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:51.143735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58dee5-0a61-4d30-8322-173534d891f7 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:51.146015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:51.157585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58dee5-0a61-4d30-8322-173534d891f7 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:51.163450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6201e7d-a92f-4c42-844f-8faa87cc0dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:51.164127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201e7d-a92f-4c42-844f-8faa87cc0dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:51.164405 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201e7d-a92f-4c42-844f-8faa87cc0dac admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:51.164678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6201e7d-a92f-4c42-844f-8faa87cc0dac admin admin] PATH_INFO: `/v3/users/cfd9870c91754fb8a3ffcc0674e3568b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:51.166561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6201e7d-a92f-4c42-844f-8faa87cc0dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd9870c91754fb8a3ffcc0674e3568b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:51.171992 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6201e7d-a92f-4c42-844f-8faa87cc0dac admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:51.248736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:51.305938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd427851e5cd7475faf87155a33f5f57b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.315451 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e6201e7d-a92f-4c42-844f-8faa87cc0dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd9870c91754fb8a3ffcc0674e3568b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.324130 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e6201e7d-a92f-4c42-844f-8faa87cc0dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd9870c91754fb8a3ffcc0674e3568b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.325730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e6201e7d-a92f-4c42-844f-8faa87cc0dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd9870c91754fb8a3ffcc0674e3568b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.335372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd427851e5cd7475faf87155a33f5f57b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.343898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e6201e7d-a92f-4c42-844f-8faa87cc0dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd9870c91754fb8a3ffcc0674e3568b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.345165 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e6201e7d-a92f-4c42-844f-8faa87cc0dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd9870c91754fb8a3ffcc0674e3568b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.355193 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd427851e5cd7475faf87155a33f5f57b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.355982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd427851e5cd7475faf87155a33f5f57b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.373148 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1047/2094] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:51 2022] DELETE /identity/v3/users/cfd9870c91754fb8a3ffcc0674e3568b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:51.375480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd427851e5cd7475faf87155a33f5f57b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.384932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1048/2095] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:51 2022] DELETE /identity/v3/users/d427851e5cd7475faf87155a33f5f57b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:51.396500 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b7002-3b05-4e8d-8edd-b845bc323582 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:51.398922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b7002-3b05-4e8d-8edd-b845bc323582 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:51.399339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b7002-3b05-4e8d-8edd-b845bc323582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:51.472486 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-849b7002-3b05-4e8d-8edd-b845bc323582 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:51.480032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-849b7002-3b05-4e8d-8edd-b845bc323582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:51.759322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1048/2096] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:51.770353 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:51.772455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:51.795546 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b7002-3b05-4e8d-8edd-b845bc323582 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:51.797027 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-849b7002-3b05-4e8d-8edd-b845bc323582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:51.831330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b7002-3b05-4e8d-8edd-b845bc323582 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:51.855733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:51.859378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:51.859670 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:51.859944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] PATH_INFO: `/v3/projects/eb5ff6c78cd3424580f0a6c779fedf23` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:51.867497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb5ff6c78cd3424580f0a6c779fedf23)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:51.878557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:51.927028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:51.946534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e2f48-7129-4e2f-9353-015422428959 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:51.957724 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a5896-dad3-42cb-92ba-eb9251c375f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:51.958532 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a5896-dad3-42cb-92ba-eb9251c375f5 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:51.962112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a5896-dad3-42cb-92ba-eb9251c375f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:51.962442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a5896-dad3-42cb-92ba-eb9251c375f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:51.987797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb5ff6c78cd3424580f0a6c779fedf23', 'request_id': 'req-be9b25d7-bae6-4e29-a9b4-9776be221f9d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:51.990022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a5896-dad3-42cb-92ba-eb9251c375f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:51.996538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a5896-dad3-42cb-92ba-eb9251c375f5 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:52.000461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb5ff6c78cd3424580f0a6c779fedf23', 'request_id': 'req-be9b25d7-bae6-4e29-a9b4-9776be221f9d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:52.027481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb5ff6c78cd3424580f0a6c779fedf23', 'request_id': 'req-be9b25d7-bae6-4e29-a9b4-9776be221f9d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:52.027731 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1049/2097] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:52.045064 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] The token cache is being invalidate because project eb5ff6c78cd3424580f0a6c779fedf23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:52.045396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:52.046084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:52.051523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1049/2098] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:51 2022] DELETE /identity/v3/projects/eb5ff6c78cd3424580f0a6c779fedf23 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:52.052919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d11cbe-7dee-40ff-aff8-c8019cef01bc None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:52.053208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d11cbe-7dee-40ff-aff8-c8019cef01bc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:52.053539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d11cbe-7dee-40ff-aff8-c8019cef01bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:52.099589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-02d11cbe-7dee-40ff-aff8-c8019cef01bc None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:52.109503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-02d11cbe-7dee-40ff-aff8-c8019cef01bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:52.269440 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:52.271332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:52.287204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1050/2099] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:46:52.297236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc0d34-5e23-425e-8715-1250b7636117 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:52.298019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc0d34-5e23-425e-8715-1250b7636117 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:52.298318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc0d34-5e23-425e-8715-1250b7636117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:52.313179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b25d7-bae6-4e29-a9b4-9776be221f9d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:52.326900 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaa7df-b56a-4933-aceb-bc87b2058108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:52.327536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaa7df-b56a-4933-aceb-bc87b2058108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:52.327823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaa7df-b56a-4933-aceb-bc87b2058108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:52.328105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaa7df-b56a-4933-aceb-bc87b2058108 admin admin] PATH_INFO: `/v3/projects/1c00df98bd7c4f0ebde01f5395f42a2c` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:52.338394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaa7df-b56a-4933-aceb-bc87b2058108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c00df98bd7c4f0ebde01f5395f42a2c)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:52.341494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaa7df-b56a-4933-aceb-bc87b2058108 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:52.351639 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e6dc0d34-5e23-425e-8715-1250b7636117 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:52.354314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e6dc0d34-5e23-425e-8715-1250b7636117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:52.407605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1051/2100] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:52.412278 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc0d34-5e23-425e-8715-1250b7636117 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:52.469624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc0d34-5e23-425e-8715-1250b7636117 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:52.497735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a5aaa7df-b56a-4933-aceb-bc87b2058108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c00df98bd7c4f0ebde01f5395f42a2c', 'request_id': 'req-a5aaa7df-b56a-4933-aceb-bc87b2058108'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:52.531644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a5aaa7df-b56a-4933-aceb-bc87b2058108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c00df98bd7c4f0ebde01f5395f42a2c', 'request_id': 'req-a5aaa7df-b56a-4933-aceb-bc87b2058108'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:52.568735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a5aaa7df-b56a-4933-aceb-bc87b2058108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c00df98bd7c4f0ebde01f5395f42a2c', 'request_id': 'req-a5aaa7df-b56a-4933-aceb-bc87b2058108'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:52.598506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a5aaa7df-b56a-4933-aceb-bc87b2058108 admin admin] The token cache is being invalidate because project 1c00df98bd7c4f0ebde01f5395f42a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:52.599444 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a5aaa7df-b56a-4933-aceb-bc87b2058108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:52.600385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a5aaa7df-b56a-4933-aceb-bc87b2058108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:52.610190 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1050/2101] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:52 2022] DELETE /identity/v3/projects/1c00df98bd7c4f0ebde01f5395f42a2c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:52.619704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f2e2f-38c0-4171-a12f-f9cdd7fecda8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:52.620254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f2e2f-38c0-4171-a12f-f9cdd7fecda8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:52.620697 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f2e2f-38c0-4171-a12f-f9cdd7fecda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:52.652509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f31f2e2f-38c0-4171-a12f-f9cdd7fecda8 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:52.654199 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f31f2e2f-38c0-4171-a12f-f9cdd7fecda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:52.684861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:52.735025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c36c2-cf54-45c0-ab93-920424754ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:52.738569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c36c2-cf54-45c0-ab93-920424754ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:52.739102 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c36c2-cf54-45c0-ab93-920424754ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:52.741440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c36c2-cf54-45c0-ab93-920424754ad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:52.744519 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c36c2-cf54-45c0-ab93-920424754ad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:52.746962 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c36c2-cf54-45c0-ab93-920424754ad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:52.751626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1051/2102] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:52.762705 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c36c2-cf54-45c0-ab93-920424754ad3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:52.768141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f637b2-860a-48d6-95a8-7aaa71756338 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:52.768383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f637b2-860a-48d6-95a8-7aaa71756338 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:52.768580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f637b2-860a-48d6-95a8-7aaa71756338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:52.796838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1052/2103] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:46:52.804011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c36c2-cf54-45c0-ab93-920424754ad3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:52.806229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-27f637b2-860a-48d6-95a8-7aaa71756338 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:52.807494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-27f637b2-860a-48d6-95a8-7aaa71756338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:52.818288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1052/2104] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:52.822557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b09c36c2-cf54-45c0-ab93-920424754ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:52.824765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f637b2-860a-48d6-95a8-7aaa71756338 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:52.847695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f637b2-860a-48d6-95a8-7aaa71756338 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:52.855024 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c36c2-cf54-45c0-ab93-920424754ad3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:52.855235 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee486c-b9d8-4fea-ab5c-dc1591ede7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:52.855924 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee486c-b9d8-4fea-ab5c-dc1591ede7ea admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:52.856208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee486c-b9d8-4fea-ab5c-dc1591ede7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:52.858727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee486c-b9d8-4fea-ab5c-dc1591ede7ea admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:52.858727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee486c-b9d8-4fea-ab5c-dc1591ede7ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:52.858727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee486c-b9d8-4fea-ab5c-dc1591ede7ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:52.859883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee486c-b9d8-4fea-ab5c-dc1591ede7ea admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:52.864992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcf0c0-0930-4c68-b88a-0aed116e8680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:52.865921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcf0c0-0930-4c68-b88a-0aed116e8680 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:52.866531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcf0c0-0930-4c68-b88a-0aed116e8680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:52.866826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcf0c0-0930-4c68-b88a-0aed116e8680 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:52.867888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcf0c0-0930-4c68-b88a-0aed116e8680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:52.870105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebcf0c0-0930-4c68-b88a-0aed116e8680 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:52.886771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1053/2105] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:46:52.886771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee486c-b9d8-4fea-ab5c-dc1591ede7ea admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:52.889391 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-58ee486c-b9d8-4fea-ab5c-dc1591ede7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:52.913187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:52.924259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee486c-b9d8-4fea-ab5c-dc1591ede7ea admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:52.935671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1053/2106] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:52 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:52.935671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcf0c0-0930-4c68-b88a-0aed116e8680 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:52.944521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:52.946014 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:52.946294 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:52.946566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] PATH_INFO: `/v3/projects/b66cf3d3adf1434296123bdbb6726ea5` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:52.948630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b66cf3d3adf1434296123bdbb6726ea5)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:52.951695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:53.048699 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b66cf3d3adf1434296123bdbb6726ea5', 'request_id': 'req-043f960d-e633-4851-b4c5-16f9b07304b0'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:53.060780 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b66cf3d3adf1434296123bdbb6726ea5', 'request_id': 'req-043f960d-e633-4851-b4c5-16f9b07304b0'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:53.070899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcf0c0-0930-4c68-b88a-0aed116e8680 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:53.078479 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b66cf3d3adf1434296123bdbb6726ea5', 'request_id': 'req-043f960d-e633-4851-b4c5-16f9b07304b0'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:53.111983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] The token cache is being invalidate because project b66cf3d3adf1434296123bdbb6726ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:53.112277 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:53.113106 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:53.114964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1054/2107] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:52 2022] DELETE /identity/v3/projects/b66cf3d3adf1434296123bdbb6726ea5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:53.115763 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:53.121270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:53.201472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756693-0510-453f-9602-418ab0ca92ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:53.202596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756693-0510-453f-9602-418ab0ca92ae admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:53.203147 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756693-0510-453f-9602-418ab0ca92ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:53.203753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756693-0510-453f-9602-418ab0ca92ae admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:53.205587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60756693-0510-453f-9602-418ab0ca92ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:53.209997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60756693-0510-453f-9602-418ab0ca92ae admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:53.233070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f960d-e633-4851-b4c5-16f9b07304b0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:53.255627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1054/2108] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:52 2022] POST /identity/v3/projects => generated 397 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:53.256709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756693-0510-453f-9602-418ab0ca92ae admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:53.258540 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-60756693-0510-453f-9602-418ab0ca92ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:53.260702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12967f-525e-4530-9445-2b63cf0003ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:53.261983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12967f-525e-4530-9445-2b63cf0003ea admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:53.262608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12967f-525e-4530-9445-2b63cf0003ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:53.263182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12967f-525e-4530-9445-2b63cf0003ea admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:53.264501 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12967f-525e-4530-9445-2b63cf0003ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:53.268027 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f12967f-525e-4530-9445-2b63cf0003ea admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:53.310384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1055/2109] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:53 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:53.312614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12967f-525e-4530-9445-2b63cf0003ea admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:53.318014 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7f12967f-525e-4530-9445-2b63cf0003ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:53.328500 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:53.336979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f12967f-525e-4530-9445-2b63cf0003ea admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:53.344755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad67c58-a3ba-4275-a83b-c0e0c228e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:53.345907 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad67c58-a3ba-4275-a83b-c0e0c228e5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:53.346418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad67c58-a3ba-4275-a83b-c0e0c228e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:53.346899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad67c58-a3ba-4275-a83b-c0e0c228e5f7 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:53.347886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad67c58-a3ba-4275-a83b-c0e0c228e5f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:53.350230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad67c58-a3ba-4275-a83b-c0e0c228e5f7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:53.351383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756693-0510-453f-9602-418ab0ca92ae admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:53.356585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:53.357258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:53.357567 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:53.357842 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] PATH_INFO: `/v3/users/c7a7a5562d414773bcd476b450f139a5` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:53.359063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7a7a5562d414773bcd476b450f139a5)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:53.361315 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:53.391028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1056/2110] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:53 2022] POST /identity/v3/users => generated 299 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:53.391028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad67c58-a3ba-4275-a83b-c0e0c228e5f7 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:53.399955 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad67c58-a3ba-4275-a83b-c0e0c228e5f7 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:53.406961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac11a55-f8af-4d34-ace7-9cb0a558c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:53.407901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac11a55-f8af-4d34-ace7-9cb0a558c083 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:53.408259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac11a55-f8af-4d34-ace7-9cb0a558c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:53.408573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac11a55-f8af-4d34-ace7-9cb0a558c083 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:53.409667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac11a55-f8af-4d34-ace7-9cb0a558c083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:53.411640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac11a55-f8af-4d34-ace7-9cb0a558c083 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:53.425562 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1057/2111] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:53.426523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac11a55-f8af-4d34-ace7-9cb0a558c083 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:53.438823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac11a55-f8af-4d34-ace7-9cb0a558c083 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:53.443893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7a7a5562d414773bcd476b450f139a5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:53.444185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8e5e1-1116-4bd8-a46c-1a9cf1eb60a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:53.445330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8e5e1-1116-4bd8-a46c-1a9cf1eb60a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:53.445915 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8e5e1-1116-4bd8-a46c-1a9cf1eb60a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:53.446075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8e5e1-1116-4bd8-a46c-1a9cf1eb60a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:53.446816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8e5e1-1116-4bd8-a46c-1a9cf1eb60a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:53.448846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8e5e1-1116-4bd8-a46c-1a9cf1eb60a2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:53.455361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7a7a5562d414773bcd476b450f139a5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:53.463910 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1058/2112] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:53.463910 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8e5e1-1116-4bd8-a46c-1a9cf1eb60a2 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:53.472417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7a7a5562d414773bcd476b450f139a5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:53.473087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7a7a5562d414773bcd476b450f139a5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:53.476164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8e5e1-1116-4bd8-a46c-1a9cf1eb60a2 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:53.481758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dcfff-f86d-4246-a743-1c0aea6df5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:53.482376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dcfff-f86d-4246-a743-1c0aea6df5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:53.482655 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dcfff-f86d-4246-a743-1c0aea6df5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:53.482923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dcfff-f86d-4246-a743-1c0aea6df5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:53.483629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dcfff-f86d-4246-a743-1c0aea6df5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:53.486788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dcfff-f86d-4246-a743-1c0aea6df5d9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:53.491590 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7a7a5562d414773bcd476b450f139a5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:53.498314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1059/2113] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:53.499304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dcfff-f86d-4246-a743-1c0aea6df5d9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:53.504222 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ef7dcfff-f86d-4246-a743-1c0aea6df5d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:53.507839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1055/2114] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:46:53 2022] DELETE /identity/v3/users/c7a7a5562d414773bcd476b450f139a5 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:53.507839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:53.511600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:53.540182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dcfff-f86d-4246-a743-1c0aea6df5d9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:53.596214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=7 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:53.709466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30b470-80ae-4b49-86f6-739ef9fe8955 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:53.724802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b084c8-17ac-4065-912c-c3cb417e73d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:53.725970 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b084c8-17ac-4065-912c-c3cb417e73d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:53.726492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b084c8-17ac-4065-912c-c3cb417e73d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:53.726947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b084c8-17ac-4065-912c-c3cb417e73d3 admin admin] PATH_INFO: `/v3/projects/64074001a79343ac88dd9b42ca6df695/users/93e7a81522e34cd29e7f2f97960c6896/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:53.732536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa66c80-2b64-4fb3-9cc6-02675000760a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:53.733320 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa66c80-2b64-4fb3-9cc6-02675000760a admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:53.733854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa66c80-2b64-4fb3-9cc6-02675000760a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:53.734371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa66c80-2b64-4fb3-9cc6-02675000760a admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:53.735600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa66c80-2b64-4fb3-9cc6-02675000760a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:53.740803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa66c80-2b64-4fb3-9cc6-02675000760a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:53.762227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b084c8-17ac-4065-912c-c3cb417e73d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64074001a79343ac88dd9b42ca6df695, user_id=93e7a81522e34cd29e7f2f97960c6896, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:53.765453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b084c8-17ac-4065-912c-c3cb417e73d3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:53.781127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1060/2115] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:53.785120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa66c80-2b64-4fb3-9cc6-02675000760a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:53.809042 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1056/2116] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:53 2022] PUT /identity/v3/projects/64074001a79343ac88dd9b42ca6df695/users/93e7a81522e34cd29e7f2f97960c6896/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:53.813189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8ad2-edc1-443a-8ea7-4b28f3ab18e4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:53.813577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8ad2-edc1-443a-8ea7-4b28f3ab18e4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:53.814007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8ad2-edc1-443a-8ea7-4b28f3ab18e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:53.826262 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa66c80-2b64-4fb3-9cc6-02675000760a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:53.871173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d76b8ad2-edc1-443a-8ea7-4b28f3ab18e4 None None] MFA Rules not processed for user `93e7a81522e34cd29e7f2f97960c6896`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:53.872679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d76b8ad2-edc1-443a-8ea7-4b28f3ab18e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:53.949776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:53.993967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1057/2117] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:53.995941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67ee96-7926-42bc-a659-bdd7c0abb588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:53.998641 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67ee96-7926-42bc-a659-bdd7c0abb588 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:53.999025 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67ee96-7926-42bc-a659-bdd7c0abb588 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:53.999399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b8ad2-edc1-443a-8ea7-4b28f3ab18e4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:53.999770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67ee96-7926-42bc-a659-bdd7c0abb588 admin admin] PATH_INFO: `/v3/projects/34bc30dd28ec46e6a54f30c6dcdb04b9/users/8bbdaaf5adaf4dfabfbeb570cdc84ff8/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.022314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b8ad2-edc1-443a-8ea7-4b28f3ab18e4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:54.038488 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c93408-e9f9-4895-a817-59fc03a51020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:54.038823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c93408-e9f9-4895-a817-59fc03a51020 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.038987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c93408-e9f9-4895-a817-59fc03a51020 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.039320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c93408-e9f9-4895-a817-59fc03a51020 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.040098 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c93408-e9f9-4895-a817-59fc03a51020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:54.041933 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67ee96-7926-42bc-a659-bdd7c0abb588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34bc30dd28ec46e6a54f30c6dcdb04b9, user_id=8bbdaaf5adaf4dfabfbeb570cdc84ff8, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:54.045748 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67ee96-7926-42bc-a659-bdd7c0abb588 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:54.049255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c93408-e9f9-4895-a817-59fc03a51020 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:54.085043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1061/2118] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:53 2022] PUT /identity/v3/projects/34bc30dd28ec46e6a54f30c6dcdb04b9/users/8bbdaaf5adaf4dfabfbeb570cdc84ff8/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:54.087669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85be06-f279-42b3-907d-99c0f0040bde None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.088059 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85be06-f279-42b3-907d-99c0f0040bde None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.089161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85be06-f279-42b3-907d-99c0f0040bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.114627 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1058/2119] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:53 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:46:54.118291 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c93408-e9f9-4895-a817-59fc03a51020 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:54.156311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7d85be06-f279-42b3-907d-99c0f0040bde None None] MFA Rules not processed for user `8bbdaaf5adaf4dfabfbeb570cdc84ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:54.157615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7d85be06-f279-42b3-907d-99c0f0040bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:54.241837 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c93408-e9f9-4895-a817-59fc03a51020 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:54.252895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcc00a-e9ec-4280-95f5-b7aa18ea259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:54.254014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc00a-e9ec-4280-95f5-b7aa18ea259f admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.255095 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc00a-e9ec-4280-95f5-b7aa18ea259f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.255738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc00a-e9ec-4280-95f5-b7aa18ea259f admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.256769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcc00a-e9ec-4280-95f5-b7aa18ea259f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:54.261011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcc00a-e9ec-4280-95f5-b7aa18ea259f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:54.286233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1062/2120] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:54.287238 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85be06-f279-42b3-907d-99c0f0040bde None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:54.292413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7d85be06-f279-42b3-907d-99c0f0040bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:54.306266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1059/2121] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:54 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:54.308194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcc00a-e9ec-4280-95f5-b7aa18ea259f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:54.312446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85be06-f279-42b3-907d-99c0f0040bde None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:54.317969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:54.318784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.319273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.319617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] PATH_INFO: `/v3/projects/6bd61622ca044200b6aabaa8a3c41d98` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.320893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcc00a-e9ec-4280-95f5-b7aa18ea259f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:54.321016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd61622ca044200b6aabaa8a3c41d98)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:54.323582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:54.327403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c8a56-a194-4e87-bc8c-74c249f52a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:54.328238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8a56-a194-4e87-bc8c-74c249f52a6b admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.328676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8a56-a194-4e87-bc8c-74c249f52a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.329594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c8a56-a194-4e87-bc8c-74c249f52a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.330423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c8a56-a194-4e87-bc8c-74c249f52a6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:54.333414 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c8a56-a194-4e87-bc8c-74c249f52a6b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:54.367988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:54.386997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1060/2122] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:54 2022] POST /identity/v3/projects => generated 399 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:54.388073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c8a56-a194-4e87-bc8c-74c249f52a6b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:54.393814 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd61622ca044200b6aabaa8a3c41d98', 'request_id': 'req-72233e7a-ab34-4263-924f-a1fe065a9823'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:54.403666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd61622ca044200b6aabaa8a3c41d98', 'request_id': 'req-72233e7a-ab34-4263-924f-a1fe065a9823'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:54.417442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd61622ca044200b6aabaa8a3c41d98', 'request_id': 'req-72233e7a-ab34-4263-924f-a1fe065a9823'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:54.434183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] The token cache is being invalidate because project 6bd61622ca044200b6aabaa8a3c41d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:46:54.434734 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:54.435588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:46:54.438596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1063/2123] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:46:54 2022] DELETE /identity/v3/projects/6bd61622ca044200b6aabaa8a3c41d98 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:54.439759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:54.442305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:54.477339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c8a56-a194-4e87-bc8c-74c249f52a6b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:54.484283 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661bf77-9170-44d5-a5e1-0ad43a5d9b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:54.484918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661bf77-9170-44d5-a5e1-0ad43a5d9b39 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.485196 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661bf77-9170-44d5-a5e1-0ad43a5d9b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.485492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661bf77-9170-44d5-a5e1-0ad43a5d9b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.486201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661bf77-9170-44d5-a5e1-0ad43a5d9b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:54.487850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661bf77-9170-44d5-a5e1-0ad43a5d9b39 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:54.502181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1061/2124] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:54.502181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ffd81-aa5f-4588-80d2-5e31ef8d65ea None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.502181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ffd81-aa5f-4588-80d2-5e31ef8d65ea None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.502181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ffd81-aa5f-4588-80d2-5e31ef8d65ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.523116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-028ffd81-aa5f-4588-80d2-5e31ef8d65ea None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:54.524630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-028ffd81-aa5f-4588-80d2-5e31ef8d65ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:54.535919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1062/2125] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:54.536779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ffd81-aa5f-4588-80d2-5e31ef8d65ea None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:54.538108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-028ffd81-aa5f-4588-80d2-5e31ef8d65ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:54.555264 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ffd81-aa5f-4588-80d2-5e31ef8d65ea None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:54.564540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72233e7a-ab34-4263-924f-a1fe065a9823 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:54.565610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9d5c0-505c-4512-8bd3-6354cac5ea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:54.566692 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9d5c0-505c-4512-8bd3-6354cac5ea56 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.567285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9d5c0-505c-4512-8bd3-6354cac5ea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.567818 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9d5c0-505c-4512-8bd3-6354cac5ea56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.569132 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9d5c0-505c-4512-8bd3-6354cac5ea56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:54.570365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8876b-3c30-4a99-9315-82dbbd016cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:54.571061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8876b-3c30-4a99-9315-82dbbd016cbf admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.571413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8876b-3c30-4a99-9315-82dbbd016cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.571953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8876b-3c30-4a99-9315-82dbbd016cbf admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.572716 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8876b-3c30-4a99-9315-82dbbd016cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:54.574396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9d5c0-505c-4512-8bd3-6354cac5ea56 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:54.574827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8876b-3c30-4a99-9315-82dbbd016cbf admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:54.600682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1063/2126] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:54.602981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc93b06-9416-4a73-9a9e-cdf5a9286aa4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.603570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc93b06-9416-4a73-9a9e-cdf5a9286aa4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.604227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc93b06-9416-4a73-9a9e-cdf5a9286aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.620559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1064/2127] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:54 2022] POST /identity/v3/users => generated 306 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:54.621444 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8876b-3c30-4a99-9315-82dbbd016cbf admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:54.624113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:54.639623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8876b-3c30-4a99-9315-82dbbd016cbf admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:54.645544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c0f79-3491-4d43-89fa-9d6ffc8f6848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:54.646318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c0f79-3491-4d43-89fa-9d6ffc8f6848 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.646685 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c0f79-3491-4d43-89fa-9d6ffc8f6848 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.647026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c0f79-3491-4d43-89fa-9d6ffc8f6848 admin admin] PATH_INFO: `/v3/projects/4d0dff0b9395440994998f9317ce052f/users/be4d8fdc42734d7e80fb02af18b4b2bf/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.648493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ebc93b06-9416-4a73-9a9e-cdf5a9286aa4 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:54.650668 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ebc93b06-9416-4a73-9a9e-cdf5a9286aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:54.667045 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1064/2128] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:54.667045 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc93b06-9416-4a73-9a9e-cdf5a9286aa4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:54.672074 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c0f79-3491-4d43-89fa-9d6ffc8f6848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d0dff0b9395440994998f9317ce052f, user_id=be4d8fdc42734d7e80fb02af18b4b2bf, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:54.674942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c0f79-3491-4d43-89fa-9d6ffc8f6848 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:54.688195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc93b06-9416-4a73-9a9e-cdf5a9286aa4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:54.701109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1065/2129] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:54 2022] PUT /identity/v3/projects/4d0dff0b9395440994998f9317ce052f/users/be4d8fdc42734d7e80fb02af18b4b2bf/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:54.713330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c0f79-3491-4d43-89fa-9d6ffc8f6848 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:54.787736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da66cbb-c622-49aa-a630-cc077ddada89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:54.788378 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66cbb-c622-49aa-a630-cc077ddada89 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.788655 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66cbb-c622-49aa-a630-cc077ddada89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.788938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66cbb-c622-49aa-a630-cc077ddada89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.789715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da66cbb-c622-49aa-a630-cc077ddada89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:54.791494 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da66cbb-c622-49aa-a630-cc077ddada89 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:54.807237 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c0f79-3491-4d43-89fa-9d6ffc8f6848 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:54.808612 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1065/2130] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:54.810876 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb4437-fbfc-4ad3-a2e9-d40b5274ad4e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.810876 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb4437-fbfc-4ad3-a2e9-d40b5274ad4e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.811105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb4437-fbfc-4ad3-a2e9-d40b5274ad4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.812350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c294a02-d600-4cc3-9f50-a061e5e558d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:54.812984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c294a02-d600-4cc3-9f50-a061e5e558d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.813261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c294a02-d600-4cc3-9f50-a061e5e558d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.813799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c294a02-d600-4cc3-9f50-a061e5e558d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.814514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c294a02-d600-4cc3-9f50-a061e5e558d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:46:54.814816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c294a02-d600-4cc3-9f50-a061e5e558d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:54.816414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c294a02-d600-4cc3-9f50-a061e5e558d5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:54.835552 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1066/2131] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:46:54.836501 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c294a02-d600-4cc3-9f50-a061e5e558d5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:54.847734 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c294a02-d600-4cc3-9f50-a061e5e558d5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:54.849016 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7ceb4437-fbfc-4ad3-a2e9-d40b5274ad4e None None] MFA Rules not processed for user `be4d8fdc42734d7e80fb02af18b4b2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:54.850608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7ceb4437-fbfc-4ad3-a2e9-d40b5274ad4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:54.853395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeef766-84c0-464e-a303-20540e48ce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:54.854158 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeef766-84c0-464e-a303-20540e48ce7d admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:54.854446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeef766-84c0-464e-a303-20540e48ce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:54.854710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeef766-84c0-464e-a303-20540e48ce7d admin admin] PATH_INFO: `/v3/projects/63c1cb4b822e4b1db8e659dbbd88b3c8/users/5c93d42e29064452b069131849b0809b/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:54.872760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:54.884720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeef766-84c0-464e-a303-20540e48ce7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c1cb4b822e4b1db8e659dbbd88b3c8, user_id=5c93d42e29064452b069131849b0809b, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:54.887910 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeef766-84c0-464e-a303-20540e48ce7d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:54.913403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1067/2132] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:54 2022] PUT /identity/v3/projects/63c1cb4b822e4b1db8e659dbbd88b3c8/users/5c93d42e29064452b069131849b0809b/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:54.914560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeef766-84c0-464e-a303-20540e48ce7d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:54.947291 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1066/2133] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:54.947291 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb4437-fbfc-4ad3-a2e9-d40b5274ad4e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:54.956763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb4437-fbfc-4ad3-a2e9-d40b5274ad4e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.008927 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeef766-84c0-464e-a303-20540e48ce7d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.015881 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d98ce-9ab3-4de2-b84c-29ee7f92904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.016522 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d98ce-9ab3-4de2-b84c-29ee7f92904b admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.016805 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d98ce-9ab3-4de2-b84c-29ee7f92904b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.017078 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d98ce-9ab3-4de2-b84c-29ee7f92904b admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.017959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d98ce-9ab3-4de2-b84c-29ee7f92904b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.020365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d98ce-9ab3-4de2-b84c-29ee7f92904b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.054721 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1068/2134] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:54 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:55.055533 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77172d-5486-41df-a361-bf2f5efe9a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.056258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77172d-5486-41df-a361-bf2f5efe9a2d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.056541 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77172d-5486-41df-a361-bf2f5efe9a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.056811 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77172d-5486-41df-a361-bf2f5efe9a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.058663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77172d-5486-41df-a361-bf2f5efe9a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.059417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d98ce-9ab3-4de2-b84c-29ee7f92904b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:55.060900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77172d-5486-41df-a361-bf2f5efe9a2d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.075504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1067/2135] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:55.076174 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77172d-5486-41df-a361-bf2f5efe9a2d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:55.094565 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77172d-5486-41df-a361-bf2f5efe9a2d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.117015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:55.160425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d98ce-9ab3-4de2-b84c-29ee7f92904b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.167879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891c252-0a3a-4f54-a83e-036ff7d928f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.168517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891c252-0a3a-4f54-a83e-036ff7d928f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.168794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891c252-0a3a-4f54-a83e-036ff7d928f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.169249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891c252-0a3a-4f54-a83e-036ff7d928f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.170081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891c252-0a3a-4f54-a83e-036ff7d928f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.172265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891c252-0a3a-4f54-a83e-036ff7d928f5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.199367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dfd69-e750-468f-b4e5-f4ffad813912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.200189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dfd69-e750-468f-b4e5-f4ffad813912 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.202616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dfd69-e750-468f-b4e5-f4ffad813912 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.202616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37dfd69-e750-468f-b4e5-f4ffad813912 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.202616 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dfd69-e750-468f-b4e5-f4ffad813912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.203947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37dfd69-e750-468f-b4e5-f4ffad813912 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.211518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1069/2136] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:55 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:55.212560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891c252-0a3a-4f54-a83e-036ff7d928f5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:55.256740 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1068/2137] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:55 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:55.261683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dfd69-e750-468f-b4e5-f4ffad813912 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:55.274444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37dfd69-e750-468f-b4e5-f4ffad813912 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.308288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891c252-0a3a-4f54-a83e-036ff7d928f5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.323259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a56df5-ed2e-4d9f-bf1d-8d02ab8039bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.324100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56df5-ed2e-4d9f-bf1d-8d02ab8039bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.324364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56df5-ed2e-4d9f-bf1d-8d02ab8039bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.324632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56df5-ed2e-4d9f-bf1d-8d02ab8039bb admin admin] PATH_INFO: `/v3/projects/63c1cb4b822e4b1db8e659dbbd88b3c8/users/5c93d42e29064452b069131849b0809b/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.330132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a56df5-ed2e-4d9f-bf1d-8d02ab8039bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c1cb4b822e4b1db8e659dbbd88b3c8, user_id=5c93d42e29064452b069131849b0809b, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.335059 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a56df5-ed2e-4d9f-bf1d-8d02ab8039bb admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.341344 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:55.372091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1070/2138] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:55 2022] PUT /identity/v3/projects/63c1cb4b822e4b1db8e659dbbd88b3c8/users/5c93d42e29064452b069131849b0809b/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:55.373266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a56df5-ed2e-4d9f-bf1d-8d02ab8039bb admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:55.384819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b7534-0033-4589-ab5e-3bc368baa331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.385840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b7534-0033-4589-ab5e-3bc368baa331 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.386205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b7534-0033-4589-ab5e-3bc368baa331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.386579 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b7534-0033-4589-ab5e-3bc368baa331 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.387693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b7534-0033-4589-ab5e-3bc368baa331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.390143 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b7534-0033-4589-ab5e-3bc368baa331 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.420493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1069/2139] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:55 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:55.422007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82cb80-48f9-493a-932d-c9a36ab5970d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.422307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82cb80-48f9-493a-932d-c9a36ab5970d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.422587 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82cb80-48f9-493a-932d-c9a36ab5970d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.458284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ae82cb80-48f9-493a-932d-c9a36ab5970d None None] MFA Rules not processed for user `5c93d42e29064452b069131849b0809b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:55.459722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ae82cb80-48f9-493a-932d-c9a36ab5970d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:55.465616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a56df5-ed2e-4d9f-bf1d-8d02ab8039bb admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.474332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2396c-72b4-45e5-82e3-7fb4f5953bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.474965 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2396c-72b4-45e5-82e3-7fb4f5953bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.475355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2396c-72b4-45e5-82e3-7fb4f5953bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.475625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2396c-72b4-45e5-82e3-7fb4f5953bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.476450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2396c-72b4-45e5-82e3-7fb4f5953bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.478191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2396c-72b4-45e5-82e3-7fb4f5953bc3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.492298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1071/2140] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:55.495369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2396c-72b4-45e5-82e3-7fb4f5953bc3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:55.513225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2396c-72b4-45e5-82e3-7fb4f5953bc3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.521629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6cd7-0343-4794-b5fd-193c7f70d0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.522592 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6cd7-0343-4794-b5fd-193c7f70d0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.522986 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6cd7-0343-4794-b5fd-193c7f70d0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.523364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabe6cd7-0343-4794-b5fd-193c7f70d0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.524171 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe6cd7-0343-4794-b5fd-193c7f70d0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.526024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabe6cd7-0343-4794-b5fd-193c7f70d0e0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.537536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1072/2141] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:55.538622 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6cd7-0343-4794-b5fd-193c7f70d0e0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:55.550214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabe6cd7-0343-4794-b5fd-193c7f70d0e0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.554224 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1070/2142] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:55.554224 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82cb80-48f9-493a-932d-c9a36ab5970d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:55.558899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab4e09-f907-47c7-b0a0-1156cad47230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.559667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab4e09-f907-47c7-b0a0-1156cad47230 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.560023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab4e09-f907-47c7-b0a0-1156cad47230 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.560367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab4e09-f907-47c7-b0a0-1156cad47230 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.561451 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab4e09-f907-47c7-b0a0-1156cad47230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.563299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab4e09-f907-47c7-b0a0-1156cad47230 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.567260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82cb80-48f9-493a-932d-c9a36ab5970d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.572680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7e91-f87a-47a8-b206-24baf5962932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.573484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7e91-f87a-47a8-b206-24baf5962932 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.573833 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7e91-f87a-47a8-b206-24baf5962932 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.574173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7e91-f87a-47a8-b206-24baf5962932 admin admin] PATH_INFO: `/v3/projects/02abb62428a44f00a474f96bcba24493/users/9ba65c427adf45d9a81811941abc8e30/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.578739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1073/2143] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:55.578739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab4e09-f907-47c7-b0a0-1156cad47230 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:55.579585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ecab4e09-f907-47c7-b0a0-1156cad47230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:55.593476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf7e91-f87a-47a8-b206-24baf5962932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02abb62428a44f00a474f96bcba24493, user_id=9ba65c427adf45d9a81811941abc8e30, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.596503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf7e91-f87a-47a8-b206-24baf5962932 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.608260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:55.614192 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1071/2144] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:55 2022] PUT /identity/v3/projects/02abb62428a44f00a474f96bcba24493/users/9ba65c427adf45d9a81811941abc8e30/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:55.616946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7e91-f87a-47a8-b206-24baf5962932 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:55.685274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab4e09-f907-47c7-b0a0-1156cad47230 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.732722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7e91-f87a-47a8-b206-24baf5962932 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.738262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f100b-af62-4d8e-a523-d2b3ba60125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.739185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f100b-af62-4d8e-a523-d2b3ba60125c admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.740157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f100b-af62-4d8e-a523-d2b3ba60125c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.740157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f100b-af62-4d8e-a523-d2b3ba60125c admin admin] PATH_INFO: `/v3/projects/68651faddded41db9e94abeabe298afa/users/5c3035c34c5d46408fee13ef8c42be3c/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.760814 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8aab6-4a2e-411f-8fea-5e45830cd70e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.761686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8aab6-4a2e-411f-8fea-5e45830cd70e service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.761973 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8aab6-4a2e-411f-8fea-5e45830cd70e service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.762200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f100b-af62-4d8e-a523-d2b3ba60125c admin admin] RBAC: Authorizing `identity:create_grant(project_id=68651faddded41db9e94abeabe298afa, user_id=5c3035c34c5d46408fee13ef8c42be3c, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.762300 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8aab6-4a2e-411f-8fea-5e45830cd70e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.766235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f100b-af62-4d8e-a523-d2b3ba60125c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.799358 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1072/2145] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:55 2022] PUT /identity/v3/projects/68651faddded41db9e94abeabe298afa/users/5c3035c34c5d46408fee13ef8c42be3c/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:55.799358 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f100b-af62-4d8e-a523-d2b3ba60125c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:55.831597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:55.862796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8aab6-4a2e-411f-8fea-5e45830cd70e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.864393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff8aab6-4a2e-411f-8fea-5e45830cd70e service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.879142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1074/2146] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:55.880910 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca6354-9089-41d3-9377-3cdaef5a0471 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.881331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca6354-9089-41d3-9377-3cdaef5a0471 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.881949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca6354-9089-41d3-9377-3cdaef5a0471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.896372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f100b-af62-4d8e-a523-d2b3ba60125c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.901830 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5d41f-471f-40dc-a20c-08597a1ccbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.904881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5d41f-471f-40dc-a20c-08597a1ccbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.905226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5d41f-471f-40dc-a20c-08597a1ccbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.905535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5d41f-471f-40dc-a20c-08597a1ccbc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.907027 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5d41f-471f-40dc-a20c-08597a1ccbc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.908306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5d41f-471f-40dc-a20c-08597a1ccbc8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.918087 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6bca6354-9089-41d3-9377-3cdaef5a0471 None None] MFA Rules not processed for user `5c3035c34c5d46408fee13ef8c42be3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:55.919682 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6bca6354-9089-41d3-9377-3cdaef5a0471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:55.926581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1073/2147] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:55.928353 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5d41f-471f-40dc-a20c-08597a1ccbc8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:55.944128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5d41f-471f-40dc-a20c-08597a1ccbc8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:55.951121 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8fb36-9600-4928-8c1d-cd59d84cc12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:55.951886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8fb36-9600-4928-8c1d-cd59d84cc12e admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.952196 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8fb36-9600-4928-8c1d-cd59d84cc12e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.952453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8fb36-9600-4928-8c1d-cd59d84cc12e admin admin] PATH_INFO: `/v3/projects/02abb62428a44f00a474f96bcba24493/users/9ba65c427adf45d9a81811941abc8e30/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:55.954737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8fb36-9600-4928-8c1d-cd59d84cc12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02abb62428a44f00a474f96bcba24493, user_id=9ba65c427adf45d9a81811941abc8e30, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:55.957976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8fb36-9600-4928-8c1d-cd59d84cc12e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:55.973111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1074/2148] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:55 2022] PUT /identity/v3/projects/02abb62428a44f00a474f96bcba24493/users/9ba65c427adf45d9a81811941abc8e30/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:55.990861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7b7b-1c38-47d1-b186-b07ea47c899e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:55.991404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7b7b-1c38-47d1-b186-b07ea47c899e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:55.992754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7b7b-1c38-47d1-b186-b07ea47c899e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:56.015584 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1075/2149] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:56.017694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca6354-9089-41d3-9377-3cdaef5a0471 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:56.043167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6e6c7b7b-1c38-47d1-b186-b07ea47c899e None None] MFA Rules not processed for user `9ba65c427adf45d9a81811941abc8e30`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:56.044430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6e6c7b7b-1c38-47d1-b186-b07ea47c899e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:56.093612 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca6354-9089-41d3-9377-3cdaef5a0471 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:56.109527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:56.135402 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1075/2150] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:56.138086 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7b7b-1c38-47d1-b186-b07ea47c899e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:56.167258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd125dc1-7c16-484f-8ad1-915ad782faf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:56.168025 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd125dc1-7c16-484f-8ad1-915ad782faf2 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:56.168310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd125dc1-7c16-484f-8ad1-915ad782faf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:56.168586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd125dc1-7c16-484f-8ad1-915ad782faf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:56.170652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cd125dc1-7c16-484f-8ad1-915ad782faf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:56.214401 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:56.216720 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7b7b-1c38-47d1-b186-b07ea47c899e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:56.221611 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff560cb4-55e4-4c14-838d-26b18fde9083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:56.222356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff560cb4-55e4-4c14-838d-26b18fde9083 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:56.222704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff560cb4-55e4-4c14-838d-26b18fde9083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:56.223042 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff560cb4-55e4-4c14-838d-26b18fde9083 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:56.223807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff560cb4-55e4-4c14-838d-26b18fde9083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:56.225979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff560cb4-55e4-4c14-838d-26b18fde9083 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:56.279491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd125dc1-7c16-484f-8ad1-915ad782faf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:56.285350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd125dc1-7c16-484f-8ad1-915ad782faf2 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:56.290971 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1076/2151] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:56 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:56.290971 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff560cb4-55e4-4c14-838d-26b18fde9083 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:56.292826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ff560cb4-55e4-4c14-838d-26b18fde9083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:56.304927 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1076/2152] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:56.306003 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd125dc1-7c16-484f-8ad1-915ad782faf2 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:56.317652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd125dc1-7c16-484f-8ad1-915ad782faf2 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:56.431540 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff560cb4-55e4-4c14-838d-26b18fde9083 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:56.452677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac46814-403e-4f73-a25e-b8fd890a9d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:56.456528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac46814-403e-4f73-a25e-b8fd890a9d07 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:56.458334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac46814-403e-4f73-a25e-b8fd890a9d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:56.459307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac46814-403e-4f73-a25e-b8fd890a9d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:56.469238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-aac46814-403e-4f73-a25e-b8fd890a9d07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:56.485813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6995261-4341-41ce-a18c-ca850ef4b17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:56.486473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6995261-4341-41ce-a18c-ca850ef4b17a admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:56.486880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6995261-4341-41ce-a18c-ca850ef4b17a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:56.487267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6995261-4341-41ce-a18c-ca850ef4b17a admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:56.488109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6995261-4341-41ce-a18c-ca850ef4b17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:56.490126 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6995261-4341-41ce-a18c-ca850ef4b17a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:56.526789 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1077/2153] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:56 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:56.533422 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6995261-4341-41ce-a18c-ca850ef4b17a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:56.550478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6995261-4341-41ce-a18c-ca850ef4b17a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:56.559071 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88416c-1aa4-4467-9f28-721d31503996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:56.560660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88416c-1aa4-4467-9f28-721d31503996 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:56.560660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88416c-1aa4-4467-9f28-721d31503996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:56.560660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88416c-1aa4-4467-9f28-721d31503996 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:56.561567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88416c-1aa4-4467-9f28-721d31503996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:56.563378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88416c-1aa4-4467-9f28-721d31503996 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:56.580739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1078/2154] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:56.581973 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88416c-1aa4-4467-9f28-721d31503996 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:56.599979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88416c-1aa4-4467-9f28-721d31503996 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:56.618745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0b75a-4413-41b4-8369-792eda4c8fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:56.620322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0b75a-4413-41b4-8369-792eda4c8fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:56.620322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0b75a-4413-41b4-8369-792eda4c8fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:56.620541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0b75a-4413-41b4-8369-792eda4c8fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:56.621368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0b75a-4413-41b4-8369-792eda4c8fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:56.623556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0b75a-4413-41b4-8369-792eda4c8fd0 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:56.633044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac46814-403e-4f73-a25e-b8fd890a9d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:56.634806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac46814-403e-4f73-a25e-b8fd890a9d07 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:56.648892 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1079/2155] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:46:56.649143 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1077/2156] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:56.660628 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0b75a-4413-41b4-8369-792eda4c8fd0 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:56.680240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0b75a-4413-41b4-8369-792eda4c8fd0 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:56.693609 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5de427-d9e1-4baa-9e5c-fdd3abcd20d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:56.694503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5de427-d9e1-4baa-9e5c-fdd3abcd20d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:56.695015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5de427-d9e1-4baa-9e5c-fdd3abcd20d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:56.695313 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5de427-d9e1-4baa-9e5c-fdd3abcd20d9 admin admin] PATH_INFO: `/v3/projects/79b0e3770dd440a880dd6925b9d6f67b/users/17227f7eb29f4cb48ab0b7d9f94a091a/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:56.723259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5de427-d9e1-4baa-9e5c-fdd3abcd20d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b0e3770dd440a880dd6925b9d6f67b, user_id=17227f7eb29f4cb48ab0b7d9f94a091a, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:56.737629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5de427-d9e1-4baa-9e5c-fdd3abcd20d9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:56.780653 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1080/2157] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:56 2022] PUT /identity/v3/projects/79b0e3770dd440a880dd6925b9d6f67b/users/17227f7eb29f4cb48ab0b7d9f94a091a/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:56.792270 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336108b-8211-4735-8e2f-58438f979699 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:56.792639 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336108b-8211-4735-8e2f-58438f979699 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:56.792986 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336108b-8211-4735-8e2f-58438f979699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:56.850242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8336108b-8211-4735-8e2f-58438f979699 None None] MFA Rules not processed for user `17227f7eb29f4cb48ab0b7d9f94a091a`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:56.851472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8336108b-8211-4735-8e2f-58438f979699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:56.887155 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:56.962485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1078/2158] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:56.967413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5de427-d9e1-4baa-9e5c-fdd3abcd20d9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:57.047752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5de427-d9e1-4baa-9e5c-fdd3abcd20d9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:57.053649 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95ead9-e19b-4b6f-b02c-4bf97df94dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:57.054286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95ead9-e19b-4b6f-b02c-4bf97df94dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:57.054615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95ead9-e19b-4b6f-b02c-4bf97df94dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:57.054889 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95ead9-e19b-4b6f-b02c-4bf97df94dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:57.055572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95ead9-e19b-4b6f-b02c-4bf97df94dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:57.057893 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95ead9-e19b-4b6f-b02c-4bf97df94dd1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:57.177680 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1081/2159] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:46:56 2022] POST /identity/v3/projects => generated 375 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:57.181879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336108b-8211-4735-8e2f-58438f979699 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:57.203376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336108b-8211-4735-8e2f-58438f979699 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:57.310144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c087d-3cb6-49b6-ab87-0d37d4f26a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:57.310888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c087d-3cb6-49b6-ab87-0d37d4f26a8d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:57.311236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c087d-3cb6-49b6-ab87-0d37d4f26a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:57.311573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c087d-3cb6-49b6-ab87-0d37d4f26a8d admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:57.312349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c087d-3cb6-49b6-ab87-0d37d4f26a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:57.314475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c087d-3cb6-49b6-ab87-0d37d4f26a8d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:57.338881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1079/2160] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:46:57 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:46:57.342573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95ead9-e19b-4b6f-b02c-4bf97df94dd1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:57.349849 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:57.354426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95ead9-e19b-4b6f-b02c-4bf97df94dd1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:57.361540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f8cca-f689-4013-84c4-0b2b2655c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:57.362276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f8cca-f689-4013-84c4-0b2b2655c094 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:57.362641 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f8cca-f689-4013-84c4-0b2b2655c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:57.362979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f8cca-f689-4013-84c4-0b2b2655c094 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:57.365326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f8cca-f689-4013-84c4-0b2b2655c094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:57.367357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f8cca-f689-4013-84c4-0b2b2655c094 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:57.379661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1082/2161] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:46:57.384015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c087d-3cb6-49b6-ab87-0d37d4f26a8d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:57.394669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c087d-3cb6-49b6-ab87-0d37d4f26a8d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:57.399932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b65ac8-87ce-491d-b695-2aadd24dc7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:57.400537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b65ac8-87ce-491d-b695-2aadd24dc7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:57.401930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b65ac8-87ce-491d-b695-2aadd24dc7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:57.401930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b65ac8-87ce-491d-b695-2aadd24dc7d5 admin admin] PATH_INFO: `/v3/projects/f41ce50b6c0b4575ba91e33fcaa61778/users/5f7dc31dea2044898421f6172910ce23/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:57.422172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b65ac8-87ce-491d-b695-2aadd24dc7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41ce50b6c0b4575ba91e33fcaa61778, user_id=5f7dc31dea2044898421f6172910ce23, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:57.425166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b65ac8-87ce-491d-b695-2aadd24dc7d5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:57.443135 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1080/2162] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:57 2022] PUT /identity/v3/projects/f41ce50b6c0b4575ba91e33fcaa61778/users/5f7dc31dea2044898421f6172910ce23/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:46:57.447445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f8cca-f689-4013-84c4-0b2b2655c094 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:57.464948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f8cca-f689-4013-84c4-0b2b2655c094 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:57.548841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd950389-3358-4eff-8c71-a1861ecc7b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:57.549932 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd950389-3358-4eff-8c71-a1861ecc7b8b admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:57.550324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd950389-3358-4eff-8c71-a1861ecc7b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:57.550651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd950389-3358-4eff-8c71-a1861ecc7b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:57.551404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd950389-3358-4eff-8c71-a1861ecc7b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:57.553563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd950389-3358-4eff-8c71-a1861ecc7b8b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:57.568695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1083/2163] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:46:57.571460 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b65ac8-87ce-491d-b695-2aadd24dc7d5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:57.582977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b65ac8-87ce-491d-b695-2aadd24dc7d5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:57.587921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49d6d2-0922-4e7a-8822-ea6bc82c79e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:57.588990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49d6d2-0922-4e7a-8822-ea6bc82c79e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:57.589273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49d6d2-0922-4e7a-8822-ea6bc82c79e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:57.589554 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49d6d2-0922-4e7a-8822-ea6bc82c79e3 admin admin] PATH_INFO: `/v3/projects/f41ce50b6c0b4575ba91e33fcaa61778/users/5f7dc31dea2044898421f6172910ce23/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:57.591499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49d6d2-0922-4e7a-8822-ea6bc82c79e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41ce50b6c0b4575ba91e33fcaa61778, user_id=5f7dc31dea2044898421f6172910ce23, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:57.594240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49d6d2-0922-4e7a-8822-ea6bc82c79e3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:57.616276 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1081/2164] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:46:57 2022] PUT /identity/v3/projects/f41ce50b6c0b4575ba91e33fcaa61778/users/5f7dc31dea2044898421f6172910ce23/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:46:57.626561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd3f8e-f2cc-425f-a371-ffe5158824c0 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:57.631494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd3f8e-f2cc-425f-a371-ffe5158824c0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:57.631494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd3f8e-f2cc-425f-a371-ffe5158824c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:57.676556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-81fd3f8e-f2cc-425f-a371-ffe5158824c0 None None] MFA Rules not processed for user `5f7dc31dea2044898421f6172910ce23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:46:57.677978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-81fd3f8e-f2cc-425f-a371-ffe5158824c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:46:57.776434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1084/2165] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:46:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:46:57.789512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49d6d2-0922-4e7a-8822-ea6bc82c79e3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:57.881567 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49d6d2-0922-4e7a-8822-ea6bc82c79e3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:57.897326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1962a-15dc-4cff-ae49-544bec834465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:57.897326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1962a-15dc-4cff-ae49-544bec834465 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:57.897326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1962a-15dc-4cff-ae49-544bec834465 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:57.897326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1962a-15dc-4cff-ae49-544bec834465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:57.940837 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:46:57.998164 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1962a-15dc-4cff-ae49-544bec834465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:57.999781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1962a-15dc-4cff-ae49-544bec834465 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:58.013486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1082/2166] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:58.532925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd3f8e-f2cc-425f-a371-ffe5158824c0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:58.547788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd3f8e-f2cc-425f-a371-ffe5158824c0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:58.551863 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2c847-b70d-43ea-a74d-332bafbafcb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:58.552574 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2c847-b70d-43ea-a74d-332bafbafcb7 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:58.552925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2c847-b70d-43ea-a74d-332bafbafcb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:58.553270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2c847-b70d-43ea-a74d-332bafbafcb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:58.627218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2c847-b70d-43ea-a74d-332bafbafcb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:58.629412 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2c847-b70d-43ea-a74d-332bafbafcb7 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:58.645638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1085/2167] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:59.322197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1962a-15dc-4cff-ae49-544bec834465 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:59.334655 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1962a-15dc-4cff-ae49-544bec834465 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:59.339787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b05a9-b40a-44d0-bb69-c6b797b06155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:59.340268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b05a9-b40a-44d0-bb69-c6b797b06155 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:59.340543 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b05a9-b40a-44d0-bb69-c6b797b06155 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:59.340812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b05a9-b40a-44d0-bb69-c6b797b06155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:59.448629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b05a9-b40a-44d0-bb69-c6b797b06155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:46:59.450478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b05a9-b40a-44d0-bb69-c6b797b06155 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:46:59.462628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1083/2168] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:46:59.923817 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2c847-b70d-43ea-a74d-332bafbafcb7 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:46:59.935474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2c847-b70d-43ea-a74d-332bafbafcb7 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:46:59.940281 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b27ae4-5c6d-4e10-8abf-69cf0651a7d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:46:59.941319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b27ae4-5c6d-4e10-8abf-69cf0651a7d1 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:46:59.941930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b27ae4-5c6d-4e10-8abf-69cf0651a7d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:46:59.942281 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b27ae4-5c6d-4e10-8abf-69cf0651a7d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:46:59.961037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:00.039031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b27ae4-5c6d-4e10-8abf-69cf0651a7d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:00.040529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b27ae4-5c6d-4e10-8abf-69cf0651a7d1 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:00.051817 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1086/2169] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:46:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:00.602261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ee25-dde2-440d-bb46-4febc149416a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:00.603165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ee25-dde2-440d-bb46-4febc149416a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:00.603447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ee25-dde2-440d-bb46-4febc149416a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:00.624377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0067ee25-dde2-440d-bb46-4febc149416a None None] MFA Rules not processed for user `4a27e5b69e724f8f9148973a012a8ce5`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:00.625752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0067ee25-dde2-440d-bb46-4febc149416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:00.674750 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b27ae4-5c6d-4e10-8abf-69cf0651a7d1 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:00.682154 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1084/2170] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:00.683646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b27ae4-5c6d-4e10-8abf-69cf0651a7d1 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:00.704426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc870f-d9e6-4e87-9520-db01d2bf25eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:00.705082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc870f-d9e6-4e87-9520-db01d2bf25eb service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:00.705393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc870f-d9e6-4e87-9520-db01d2bf25eb service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:00.705668 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc870f-d9e6-4e87-9520-db01d2bf25eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:00.720688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc870f-d9e6-4e87-9520-db01d2bf25eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:00.722666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc870f-d9e6-4e87-9520-db01d2bf25eb service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:00.734543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1087/2171] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:01.030520 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067ee25-dde2-440d-bb46-4febc149416a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:01.129897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067ee25-dde2-440d-bb46-4febc149416a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:01.134797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:01.136357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:01.136664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:01.136999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] PATH_INFO: `/v3/users/8bbdaaf5adaf4dfabfbeb570cdc84ff8` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:01.138396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bbdaaf5adaf4dfabfbeb570cdc84ff8)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:01.140451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:01.148447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:01.195901 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bbdaaf5adaf4dfabfbeb570cdc84ff8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:01.203205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bbdaaf5adaf4dfabfbeb570cdc84ff8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:01.211548 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bbdaaf5adaf4dfabfbeb570cdc84ff8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:01.212293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bbdaaf5adaf4dfabfbeb570cdc84ff8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:01.226286 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bbdaaf5adaf4dfabfbeb570cdc84ff8'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:01.232621 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1085/2172] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:47:01 2022] DELETE /identity/v3/users/8bbdaaf5adaf4dfabfbeb570cdc84ff8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:01.237363 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956757b-4f04-4e60-b6c0-8d9a0d80df65 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:01.237861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956757b-4f04-4e60-b6c0-8d9a0d80df65 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:01.237974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956757b-4f04-4e60-b6c0-8d9a0d80df65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:01.257252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-5956757b-4f04-4e60-b6c0-8d9a0d80df65 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:01.258497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5956757b-4f04-4e60-b6c0-8d9a0d80df65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:01.343477 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1088/2173] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:01.356682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:01.358295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:01.426096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0fc0b-5bc2-4647-8384-81943df1a3a4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:01.430175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04193a8-194d-4669-8bbd-4d2b0cc382ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:01.430830 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04193a8-194d-4669-8bbd-4d2b0cc382ff service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:01.431144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04193a8-194d-4669-8bbd-4d2b0cc382ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:01.431443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04193a8-194d-4669-8bbd-4d2b0cc382ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:01.449166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04193a8-194d-4669-8bbd-4d2b0cc382ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:01.451592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04193a8-194d-4669-8bbd-4d2b0cc382ff service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:01.483353 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1086/2174] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:01.791707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956757b-4f04-4e60-b6c0-8d9a0d80df65 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:01.794359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5956757b-4f04-4e60-b6c0-8d9a0d80df65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:01.812909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956757b-4f04-4e60-b6c0-8d9a0d80df65 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:01.818127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:01.818771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:01.819136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:01.819312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] PATH_INFO: `/v3/projects/34bc30dd28ec46e6a54f30c6dcdb04b9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:01.820561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=34bc30dd28ec46e6a54f30c6dcdb04b9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:01.822771 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:01.873967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34bc30dd28ec46e6a54f30c6dcdb04b9', 'request_id': 'req-08b3f2a3-4866-4925-9249-f82e4aa28cca'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:01.881100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34bc30dd28ec46e6a54f30c6dcdb04b9', 'request_id': 'req-08b3f2a3-4866-4925-9249-f82e4aa28cca'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:01.890218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34bc30dd28ec46e6a54f30c6dcdb04b9', 'request_id': 'req-08b3f2a3-4866-4925-9249-f82e4aa28cca'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:01.903190 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] The token cache is being invalidate because project 34bc30dd28ec46e6a54f30c6dcdb04b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:47:01.903691 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:01.904428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:01.909876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1089/2175] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:47:01 2022] DELETE /identity/v3/projects/34bc30dd28ec46e6a54f30c6dcdb04b9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:01.911073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04193a8-194d-4669-8bbd-4d2b0cc382ff service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:01.921870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04193a8-194d-4669-8bbd-4d2b0cc382ff service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:01.993817 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0dd95-e431-4e90-828a-599a36961ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:01.994533 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0dd95-e431-4e90-828a-599a36961ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:01.994815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0dd95-e431-4e90-828a-599a36961ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:01.995233 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0dd95-e431-4e90-828a-599a36961ef3 admin admin] PATH_INFO: `/v3/users/5c93d42e29064452b069131849b0809b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:01.996513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0dd95-e431-4e90-828a-599a36961ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c93d42e29064452b069131849b0809b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:01.998536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0dd95-e431-4e90-828a-599a36961ef3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:02.039561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:02.059866 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b0c0dd95-e431-4e90-828a-599a36961ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c93d42e29064452b069131849b0809b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:02.067678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b0c0dd95-e431-4e90-828a-599a36961ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c93d42e29064452b069131849b0809b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:02.074902 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b0c0dd95-e431-4e90-828a-599a36961ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c93d42e29064452b069131849b0809b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:02.075653 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b0c0dd95-e431-4e90-828a-599a36961ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c93d42e29064452b069131849b0809b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:02.097935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-b0c0dd95-e431-4e90-828a-599a36961ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c93d42e29064452b069131849b0809b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:02.104510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1087/2176] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:47:01 2022] DELETE /identity/v3/users/5c93d42e29064452b069131849b0809b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:47:02.422244 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:02.423827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:02.454238 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3f2a3-4866-4925-9249-f82e4aa28cca admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:02.495162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:02.558618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87195261-2ed9-4b4b-8180-24d3ac247aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:02.560315 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87195261-2ed9-4b4b-8180-24d3ac247aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:02.561031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87195261-2ed9-4b4b-8180-24d3ac247aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:02.561806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87195261-2ed9-4b4b-8180-24d3ac247aa5 admin admin] PATH_INFO: `/v3/projects/63c1cb4b822e4b1db8e659dbbd88b3c8` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:02.563927 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87195261-2ed9-4b4b-8180-24d3ac247aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63c1cb4b822e4b1db8e659dbbd88b3c8)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:02.566897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87195261-2ed9-4b4b-8180-24d3ac247aa5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:02.659452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-87195261-2ed9-4b4b-8180-24d3ac247aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c1cb4b822e4b1db8e659dbbd88b3c8', 'request_id': 'req-87195261-2ed9-4b4b-8180-24d3ac247aa5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:02.666345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-87195261-2ed9-4b4b-8180-24d3ac247aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c1cb4b822e4b1db8e659dbbd88b3c8', 'request_id': 'req-87195261-2ed9-4b4b-8180-24d3ac247aa5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:02.675598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-87195261-2ed9-4b4b-8180-24d3ac247aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c1cb4b822e4b1db8e659dbbd88b3c8', 'request_id': 'req-87195261-2ed9-4b4b-8180-24d3ac247aa5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:02.689247 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-87195261-2ed9-4b4b-8180-24d3ac247aa5 admin admin] The token cache is being invalidate because project 63c1cb4b822e4b1db8e659dbbd88b3c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:47:02.689602 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-87195261-2ed9-4b4b-8180-24d3ac247aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:02.690742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-87195261-2ed9-4b4b-8180-24d3ac247aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:02.692537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1090/2177] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:47:02 2022] DELETE /identity/v3/projects/63c1cb4b822e4b1db8e659dbbd88b3c8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:02.697768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140f992-7aec-494f-933e-15986cb3cf83 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:02.698049 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140f992-7aec-494f-933e-15986cb3cf83 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:02.698317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6140f992-7aec-494f-933e-15986cb3cf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:02.727038 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6140f992-7aec-494f-933e-15986cb3cf83 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:02.728736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6140f992-7aec-494f-933e-15986cb3cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:02.804662 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1088/2178] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:02.806743 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2f1b8-6063-4e4b-b866-68bb720b751c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:02.807249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2f1b8-6063-4e4b-b866-68bb720b751c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:02.807657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2f1b8-6063-4e4b-b866-68bb720b751c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:02.830813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0fc2f1b8-6063-4e4b-b866-68bb720b751c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:02.832187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0fc2f1b8-6063-4e4b-b866-68bb720b751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:02.840965 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1091/2179] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:02.845682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140f992-7aec-494f-933e-15986cb3cf83 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:02.862187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6140f992-7aec-494f-933e-15986cb3cf83 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:02.881381 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4318f1a-8c3b-4c89-9b19-aa778484b708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:02.882454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4318f1a-8c3b-4c89-9b19-aa778484b708 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:02.883112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4318f1a-8c3b-4c89-9b19-aa778484b708 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:02.883617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4318f1a-8c3b-4c89-9b19-aa778484b708 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:02.885005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4318f1a-8c3b-4c89-9b19-aa778484b708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:47:02.885490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4318f1a-8c3b-4c89-9b19-aa778484b708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:02.889650 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4318f1a-8c3b-4c89-9b19-aa778484b708 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:02.911912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1089/2180] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:47:02.917277 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2f1b8-6063-4e4b-b866-68bb720b751c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:02.920826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91380e0-6789-4c43-9389-36079aefc6dd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:02.921339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91380e0-6789-4c43-9389-36079aefc6dd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:02.921975 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91380e0-6789-4c43-9389-36079aefc6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:02.934721 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2f1b8-6063-4e4b-b866-68bb720b751c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:02.942309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509b97c-c495-46eb-a2d7-d18839d4f3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:02.943311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509b97c-c495-46eb-a2d7-d18839d4f3da admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:02.943704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509b97c-c495-46eb-a2d7-d18839d4f3da admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:02.944076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509b97c-c495-46eb-a2d7-d18839d4f3da admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:02.945174 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509b97c-c495-46eb-a2d7-d18839d4f3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:02.948001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509b97c-c495-46eb-a2d7-d18839d4f3da admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:02.950990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a91380e0-6789-4c43-9389-36079aefc6dd None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:02.952292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a91380e0-6789-4c43-9389-36079aefc6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:03.000739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1092/2181] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:47:02 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:47:03.005945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509b97c-c495-46eb-a2d7-d18839d4f3da admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:03.020823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1090/2182] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:47:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:03.035556 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91380e0-6789-4c43-9389-36079aefc6dd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:03.037961 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a91380e0-6789-4c43-9389-36079aefc6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:03.081569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509b97c-c495-46eb-a2d7-d18839d4f3da admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:03.086621 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd98f1d-9c70-4f29-88a8-caf7894e9b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:03.087414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd98f1d-9c70-4f29-88a8-caf7894e9b21 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:03.087695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd98f1d-9c70-4f29-88a8-caf7894e9b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:03.087967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd98f1d-9c70-4f29-88a8-caf7894e9b21 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:03.089006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd98f1d-9c70-4f29-88a8-caf7894e9b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:03.090555 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:03.090977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd98f1d-9c70-4f29-88a8-caf7894e9b21 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:03.117559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1093/2183] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:47:03 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:47:03.118627 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd98f1d-9c70-4f29-88a8-caf7894e9b21 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:03.124381 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91380e0-6789-4c43-9389-36079aefc6dd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:03.132603 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd98f1d-9c70-4f29-88a8-caf7894e9b21 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:03.138907 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7863f8-446a-4eb0-9262-939fcc6a91dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:03.139119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7863f8-446a-4eb0-9262-939fcc6a91dc admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:03.139217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7863f8-446a-4eb0-9262-939fcc6a91dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:03.139477 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7863f8-446a-4eb0-9262-939fcc6a91dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:03.140189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7863f8-446a-4eb0-9262-939fcc6a91dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:03.142286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7863f8-446a-4eb0-9262-939fcc6a91dc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:03.156330 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1094/2184] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:47:03.157185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7863f8-446a-4eb0-9262-939fcc6a91dc admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:03.162669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:03.178028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7863f8-446a-4eb0-9262-939fcc6a91dc admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:03.178028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9b65f-bb30-4c8b-89df-7c52e865be0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:03.178028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b65f-bb30-4c8b-89df-7c52e865be0e admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:03.178734 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b65f-bb30-4c8b-89df-7c52e865be0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:03.179197 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9b65f-bb30-4c8b-89df-7c52e865be0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:03.180176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9b65f-bb30-4c8b-89df-7c52e865be0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:03.183445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9b65f-bb30-4c8b-89df-7c52e865be0e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:03.200903 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1095/2185] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:47:03.204769 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9b65f-bb30-4c8b-89df-7c52e865be0e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:03.216075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0de7c2-9dfb-4746-9751-18fd310a312e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:03.216413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9b65f-bb30-4c8b-89df-7c52e865be0e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:03.217219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0de7c2-9dfb-4746-9751-18fd310a312e service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:03.217689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0de7c2-9dfb-4746-9751-18fd310a312e service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:03.218221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0de7c2-9dfb-4746-9751-18fd310a312e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:03.222769 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f7c51-bbb3-4cb0-8506-86588a611602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:03.223447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f7c51-bbb3-4cb0-8506-86588a611602 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:03.223828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f7c51-bbb3-4cb0-8506-86588a611602 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:03.224016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f7c51-bbb3-4cb0-8506-86588a611602 admin admin] PATH_INFO: `/v3/projects/ce3b5b4ab3c848bfb1b9ee40b6cf83f1/users/72785755a63c432e9946bc67c674181b/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:03.241509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f7c51-bbb3-4cb0-8506-86588a611602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3b5b4ab3c848bfb1b9ee40b6cf83f1, user_id=72785755a63c432e9946bc67c674181b, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:03.245168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f7c51-bbb3-4cb0-8506-86588a611602 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:03.266799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1096/2186] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:47:03 2022] PUT /identity/v3/projects/ce3b5b4ab3c848bfb1b9ee40b6cf83f1/users/72785755a63c432e9946bc67c674181b/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:03.280613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a666a52-a290-4719-b319-f4110aa108c0 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:03.281124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a666a52-a290-4719-b319-f4110aa108c0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:03.283380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a666a52-a290-4719-b319-f4110aa108c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:03.332076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1a666a52-a290-4719-b319-f4110aa108c0 None None] MFA Rules not processed for user `72785755a63c432e9946bc67c674181b`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:03.333479 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1a666a52-a290-4719-b319-f4110aa108c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:03.358483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0de7c2-9dfb-4746-9751-18fd310a312e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:03.360615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0de7c2-9dfb-4746-9751-18fd310a312e service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:03.382529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1091/2187] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:47:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 02:47:03.456592 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1097/2188] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:03.458100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0de7c2-9dfb-4746-9751-18fd310a312e service swift] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:03.480480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0de7c2-9dfb-4746-9751-18fd310a312e service swift] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:03.693817 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bcbb2-bb31-465f-8b6b-cd12d53c600e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:03.695228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bcbb2-bb31-465f-8b6b-cd12d53c600e admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:03.695510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bcbb2-bb31-465f-8b6b-cd12d53c600e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:03.695777 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74bcbb2-bb31-465f-8b6b-cd12d53c600e admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:03.696527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bcbb2-bb31-465f-8b6b-cd12d53c600e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:03.698441 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74bcbb2-bb31-465f-8b6b-cd12d53c600e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:03.745695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a666a52-a290-4719-b319-f4110aa108c0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:03.747396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1a666a52-a290-4719-b319-f4110aa108c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:03.776729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a666a52-a290-4719-b319-f4110aa108c0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:03.784682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1092/2189] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:47:03 2022] POST /identity/v3/projects => generated 381 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:47:03.787682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bcbb2-bb31-465f-8b6b-cd12d53c600e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:03.793617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168435cb-725a-47a2-9c13-5bd4acca0712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:03.796162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168435cb-725a-47a2-9c13-5bd4acca0712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:03.797139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168435cb-725a-47a2-9c13-5bd4acca0712 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:03.797451 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168435cb-725a-47a2-9c13-5bd4acca0712 admin admin] PATH_INFO: `/v3/users/93e7a81522e34cd29e7f2f97960c6896` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:03.800340 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168435cb-725a-47a2-9c13-5bd4acca0712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e7a81522e34cd29e7f2f97960c6896)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:03.814735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168435cb-725a-47a2-9c13-5bd4acca0712 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:03.818547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:03.945408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-168435cb-725a-47a2-9c13-5bd4acca0712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e7a81522e34cd29e7f2f97960c6896'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:03.960638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74bcbb2-bb31-465f-8b6b-cd12d53c600e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:03.965800 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-168435cb-725a-47a2-9c13-5bd4acca0712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e7a81522e34cd29e7f2f97960c6896'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:03.967442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-168435cb-725a-47a2-9c13-5bd4acca0712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e7a81522e34cd29e7f2f97960c6896'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:03.968450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308767c3-f17c-47c4-8f9a-cef5a2deb782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:03.969851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308767c3-f17c-47c4-8f9a-cef5a2deb782 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:03.970317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308767c3-f17c-47c4-8f9a-cef5a2deb782 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:03.970769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308767c3-f17c-47c4-8f9a-cef5a2deb782 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:03.971776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308767c3-f17c-47c4-8f9a-cef5a2deb782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:03.974115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308767c3-f17c-47c4-8f9a-cef5a2deb782 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:03.996998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-168435cb-725a-47a2-9c13-5bd4acca0712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e7a81522e34cd29e7f2f97960c6896'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:03.998013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-168435cb-725a-47a2-9c13-5bd4acca0712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e7a81522e34cd29e7f2f97960c6896'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:04.041005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1098/2190] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:47:03 2022] DELETE /identity/v3/users/93e7a81522e34cd29e7f2f97960c6896 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:04.045713 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ae446-e6fe-459d-9d22-10e956d09dfc None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:04.046826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ae446-e6fe-459d-9d22-10e956d09dfc None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:04.047522 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ae446-e6fe-459d-9d22-10e956d09dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:04.056350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1093/2191] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:47:03 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:47:04.059952 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308767c3-f17c-47c4-8f9a-cef5a2deb782 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:04.066757 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-308767c3-f17c-47c4-8f9a-cef5a2deb782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:04.105372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f05ae446-e6fe-459d-9d22-10e956d09dfc None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:04.111204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f05ae446-e6fe-459d-9d22-10e956d09dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:04.115382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308767c3-f17c-47c4-8f9a-cef5a2deb782 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:04.167527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:04.272645 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1099/2192] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:04.286324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ae446-e6fe-459d-9d22-10e956d09dfc None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:04.287794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f05ae446-e6fe-459d-9d22-10e956d09dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:04.295474 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59690933-e3b6-4d02-94c8-4214b7a3f300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:04.297252 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59690933-e3b6-4d02-94c8-4214b7a3f300 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:04.298369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59690933-e3b6-4d02-94c8-4214b7a3f300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:04.299208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59690933-e3b6-4d02-94c8-4214b7a3f300 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:04.301191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59690933-e3b6-4d02-94c8-4214b7a3f300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:04.303430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59690933-e3b6-4d02-94c8-4214b7a3f300 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:04.323177 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1094/2193] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:47:04.325573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59690933-e3b6-4d02-94c8-4214b7a3f300 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:04.340383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59690933-e3b6-4d02-94c8-4214b7a3f300 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:04.346715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b6ac9-56a3-445a-b09f-9507be0c2328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:04.348252 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b6ac9-56a3-445a-b09f-9507be0c2328 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:04.349186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b6ac9-56a3-445a-b09f-9507be0c2328 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:04.349712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b6ac9-56a3-445a-b09f-9507be0c2328 admin admin] PATH_INFO: `/v3/projects/c657c8f9d7fe4571bda3b371cd2bd3c0/users/0540aa33182e477db21446ad65bc8be9/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:04.372976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b6ac9-56a3-445a-b09f-9507be0c2328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c657c8f9d7fe4571bda3b371cd2bd3c0, user_id=0540aa33182e477db21446ad65bc8be9, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:04.376578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b6ac9-56a3-445a-b09f-9507be0c2328 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:04.399487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1095/2194] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:47:04 2022] PUT /identity/v3/projects/c657c8f9d7fe4571bda3b371cd2bd3c0/users/0540aa33182e477db21446ad65bc8be9/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:04.404969 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b6ac9-56a3-445a-b09f-9507be0c2328 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:04.435049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ae446-e6fe-459d-9d22-10e956d09dfc None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:04.507954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b6ac9-56a3-445a-b09f-9507be0c2328 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:04.520745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f222a-2c56-4f20-aba1-835f801e9f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:04.521407 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f222a-2c56-4f20-aba1-835f801e9f2b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:04.521690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f222a-2c56-4f20-aba1-835f801e9f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:04.521960 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f222a-2c56-4f20-aba1-835f801e9f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:04.527157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f222a-2c56-4f20-aba1-835f801e9f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:04.530449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f222a-2c56-4f20-aba1-835f801e9f2b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:04.547758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331dcc28-fc6b-43f2-b89f-56258752b544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:04.548409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dcc28-fc6b-43f2-b89f-56258752b544 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:04.548723 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dcc28-fc6b-43f2-b89f-56258752b544 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:04.548992 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331dcc28-fc6b-43f2-b89f-56258752b544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:04.559764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1096/2195] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:47:04.574848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331dcc28-fc6b-43f2-b89f-56258752b544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:04.576063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f222a-2c56-4f20-aba1-835f801e9f2b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:04.577150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331dcc28-fc6b-43f2-b89f-56258752b544 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:04.611599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f222a-2c56-4f20-aba1-835f801e9f2b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:04.614678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1100/2196] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:47:04.621252 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c23e1-cbe4-4165-947d-e8e4108d47bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:04.622131 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c23e1-cbe4-4165-947d-e8e4108d47bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:04.622415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c23e1-cbe4-4165-947d-e8e4108d47bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:04.623221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524c23e1-cbe4-4165-947d-e8e4108d47bd admin admin] PATH_INFO: `/v3/projects/c657c8f9d7fe4571bda3b371cd2bd3c0/users/0540aa33182e477db21446ad65bc8be9/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:04.637680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c23e1-cbe4-4165-947d-e8e4108d47bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c657c8f9d7fe4571bda3b371cd2bd3c0, user_id=0540aa33182e477db21446ad65bc8be9, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:04.641253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524c23e1-cbe4-4165-947d-e8e4108d47bd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:04.644261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:04.666537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1097/2197] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:47:04 2022] PUT /identity/v3/projects/c657c8f9d7fe4571bda3b371cd2bd3c0/users/0540aa33182e477db21446ad65bc8be9/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:04.677784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbac28-1d05-4d4e-8448-5e45f148fbf8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:04.678255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbac28-1d05-4d4e-8448-5e45f148fbf8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:04.678550 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbac28-1d05-4d4e-8448-5e45f148fbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:04.795152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f9bbac28-1d05-4d4e-8448-5e45f148fbf8 None None] MFA Rules not processed for user `0540aa33182e477db21446ad65bc8be9`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:04.804845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f9bbac28-1d05-4d4e-8448-5e45f148fbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:05.015212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1101/2198] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:05.077351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c23e1-cbe4-4165-947d-e8e4108d47bd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:05.081089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-524c23e1-cbe4-4165-947d-e8e4108d47bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:05.270448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524c23e1-cbe4-4165-947d-e8e4108d47bd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:05.292140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bc179-2c07-4cb8-82d9-d48b661cd311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:05.292804 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bc179-2c07-4cb8-82d9-d48b661cd311 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:05.293084 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bc179-2c07-4cb8-82d9-d48b661cd311 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:05.293380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bc179-2c07-4cb8-82d9-d48b661cd311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:05.350717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bc179-2c07-4cb8-82d9-d48b661cd311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:05.351862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bc179-2c07-4cb8-82d9-d48b661cd311 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:05.384957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1098/2199] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:05.426606 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbac28-1d05-4d4e-8448-5e45f148fbf8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:05.436596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f9bbac28-1d05-4d4e-8448-5e45f148fbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:05.489926 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bc179-2c07-4cb8-82d9-d48b661cd311 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:05.491850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-be8bc179-2c07-4cb8-82d9-d48b661cd311 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:05.509114 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:05.715063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbac28-1d05-4d4e-8448-5e45f148fbf8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:05.737904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bc179-2c07-4cb8-82d9-d48b661cd311 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:05.739749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:05.740550 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:05.740838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:05.741172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] PATH_INFO: `/v3/projects/64074001a79343ac88dd9b42ca6df695` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:05.743190 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64074001a79343ac88dd9b42ca6df695)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:05.746337 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:05.753026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:05.753750 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:05.754029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:05.754304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] PATH_INFO: `/v3/users/5c3035c34c5d46408fee13ef8c42be3c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:05.759734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3035c34c5d46408fee13ef8c42be3c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:05.761824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:05.865627 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64074001a79343ac88dd9b42ca6df695', 'request_id': 'req-f751b9cd-7166-4fba-b067-0fd2263df11e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:05.877403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64074001a79343ac88dd9b42ca6df695', 'request_id': 'req-f751b9cd-7166-4fba-b067-0fd2263df11e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:05.879156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3035c34c5d46408fee13ef8c42be3c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:05.888904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3035c34c5d46408fee13ef8c42be3c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:05.890577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64074001a79343ac88dd9b42ca6df695', 'request_id': 'req-f751b9cd-7166-4fba-b067-0fd2263df11e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:05.902375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3035c34c5d46408fee13ef8c42be3c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:05.903221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3035c34c5d46408fee13ef8c42be3c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:05.910674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] The token cache is being invalidate because project 64074001a79343ac88dd9b42ca6df695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:47:05.911584 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:05.912684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:05.915636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1102/2200] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:47:05 2022] DELETE /identity/v3/projects/64074001a79343ac88dd9b42ca6df695 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:05.916806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:05.918584 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:05.928928 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3035c34c5d46408fee13ef8c42be3c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:05.941223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1099/2201] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:47:05 2022] DELETE /identity/v3/users/5c3035c34c5d46408fee13ef8c42be3c => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:05.942329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:05.943900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:05.987826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:06.028854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751b9cd-7166-4fba-b067-0fd2263df11e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:06.064185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aff3be-c20a-4c47-abf5-8d9d07de8cb3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:06.070464 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c23ac-3880-4f14-b733-07afee475d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:06.071152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c23ac-3880-4f14-b733-07afee475d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:06.071519 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c23ac-3880-4f14-b733-07afee475d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:06.071799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c23ac-3880-4f14-b733-07afee475d6d admin admin] PATH_INFO: `/v3/users/be4d8fdc42734d7e80fb02af18b4b2bf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:06.073334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c23ac-3880-4f14-b733-07afee475d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=be4d8fdc42734d7e80fb02af18b4b2bf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:06.075339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c23ac-3880-4f14-b733-07afee475d6d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:06.155262 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff66c34-3083-4051-82de-6107752d0576 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:06.156498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ea7c23ac-3880-4f14-b733-07afee475d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be4d8fdc42734d7e80fb02af18b4b2bf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:06.158395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff66c34-3083-4051-82de-6107752d0576 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:06.159829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff66c34-3083-4051-82de-6107752d0576 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:06.160056 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff66c34-3083-4051-82de-6107752d0576 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:06.164958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6ff66c34-3083-4051-82de-6107752d0576 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:06.170188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ea7c23ac-3880-4f14-b733-07afee475d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be4d8fdc42734d7e80fb02af18b4b2bf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:06.191371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:06.198584 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ea7c23ac-3880-4f14-b733-07afee475d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be4d8fdc42734d7e80fb02af18b4b2bf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:06.199228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ea7c23ac-3880-4f14-b733-07afee475d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be4d8fdc42734d7e80fb02af18b4b2bf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:06.217001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ea7c23ac-3880-4f14-b733-07afee475d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be4d8fdc42734d7e80fb02af18b4b2bf'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:06.234705 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1100/2202] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:47:05 2022] DELETE /identity/v3/users/be4d8fdc42734d7e80fb02af18b4b2bf => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:06.236916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279157fe-3cb7-447f-8d0c-6b558b02a291 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:06.237210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279157fe-3cb7-447f-8d0c-6b558b02a291 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:06.254125 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279157fe-3cb7-447f-8d0c-6b558b02a291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:06.263954 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff66c34-3083-4051-82de-6107752d0576 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:06.265577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff66c34-3083-4051-82de-6107752d0576 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:06.290852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1103/2203] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:06.301326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-279157fe-3cb7-447f-8d0c-6b558b02a291 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:06.302708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-279157fe-3cb7-447f-8d0c-6b558b02a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:06.501338 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1101/2204] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:06.508254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff66c34-3083-4051-82de-6107752d0576 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:06.511149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6ff66c34-3083-4051-82de-6107752d0576 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:06.672971 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff66c34-3083-4051-82de-6107752d0576 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:06.796248 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ce147-c036-424c-8e64-433b84927977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:06.796947 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce147-c036-424c-8e64-433b84927977 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:06.797212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce147-c036-424c-8e64-433b84927977 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:06.797553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ce147-c036-424c-8e64-433b84927977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:06.815253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ce147-c036-424c-8e64-433b84927977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:06.818038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ce147-c036-424c-8e64-433b84927977 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:06.837909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1104/2205] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:07.066076 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279157fe-3cb7-447f-8d0c-6b558b02a291 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:07.067742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-279157fe-3cb7-447f-8d0c-6b558b02a291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:07.090854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279157fe-3cb7-447f-8d0c-6b558b02a291 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:07.108944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:07.109941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:07.110218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:07.111098 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] PATH_INFO: `/v3/projects/4d0dff0b9395440994998f9317ce052f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:07.114034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d0dff0b9395440994998f9317ce052f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:07.116357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:07.178297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:07.197862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0dff0b9395440994998f9317ce052f', 'request_id': 'req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.208106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0dff0b9395440994998f9317ce052f', 'request_id': 'req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.218317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0dff0b9395440994998f9317ce052f', 'request_id': 'req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.241972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] The token cache is being invalidate because project 4d0dff0b9395440994998f9317ce052f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:47:07.242261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.243009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.245314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1102/2206] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:47:07 2022] DELETE /identity/v3/projects/4d0dff0b9395440994998f9317ce052f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:47:07.249066 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ce147-c036-424c-8e64-433b84927977 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:07.260841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ce147-c036-424c-8e64-433b84927977 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:07.359762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:07.359762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:07.373406 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:07.374078 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:07.374359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:07.374632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] PATH_INFO: `/v3/users/9ba65c427adf45d9a81811941abc8e30` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:07.375858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba65c427adf45d9a81811941abc8e30)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:07.378102 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:07.414896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:07.475307 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba65c427adf45d9a81811941abc8e30'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.491071 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba65c427adf45d9a81811941abc8e30'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.491956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba65c427adf45d9a81811941abc8e30'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.509367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba65c427adf45d9a81811941abc8e30'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.509367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba65c427adf45d9a81811941abc8e30'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.517307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08e74c-05e0-4c7e-b42f-09bbc28f64c1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:07.527769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:07.528523 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:07.528850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:07.529192 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] PATH_INFO: `/v3/projects/68651faddded41db9e94abeabe298afa` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:07.530467 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68651faddded41db9e94abeabe298afa)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:07.532462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:07.534717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1105/2207] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:47:07 2022] DELETE /identity/v3/users/9ba65c427adf45d9a81811941abc8e30 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:07.635635 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68651faddded41db9e94abeabe298afa', 'request_id': 'req-14ebea30-4420-4dc4-91e5-ff5559b6f644'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.652217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68651faddded41db9e94abeabe298afa', 'request_id': 'req-14ebea30-4420-4dc4-91e5-ff5559b6f644'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.661810 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68651faddded41db9e94abeabe298afa', 'request_id': 'req-14ebea30-4420-4dc4-91e5-ff5559b6f644'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.679406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] The token cache is being invalidate because project 68651faddded41db9e94abeabe298afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:47:07.680991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.680991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:07.683799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1103/2208] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:47:07 2022] DELETE /identity/v3/projects/68651faddded41db9e94abeabe298afa => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:47:07.688589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:07.691997 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:07.814900 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24942c-a005-4f20-a425-39675f426234 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:07.903113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ed214-65ee-4da8-b8de-a5db7e418b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:07.903786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ed214-65ee-4da8-b8de-a5db7e418b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:07.904069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ed214-65ee-4da8-b8de-a5db7e418b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:07.904347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ed214-65ee-4da8-b8de-a5db7e418b4d admin admin] PATH_INFO: `/v3/users/17227f7eb29f4cb48ab0b7d9f94a091a` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:07.905736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ed214-65ee-4da8-b8de-a5db7e418b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=17227f7eb29f4cb48ab0b7d9f94a091a)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:07.914922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ed214-65ee-4da8-b8de-a5db7e418b4d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:08.012000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:08.013592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:08.040167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:08.081822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebea30-4420-4dc4-91e5-ff5559b6f644 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:08.086214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c14ed214-65ee-4da8-b8de-a5db7e418b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17227f7eb29f4cb48ab0b7d9f94a091a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:08.096101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091320a-15e6-41f9-abc0-ea8cf89c51aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:08.097176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091320a-15e6-41f9-abc0-ea8cf89c51aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:08.097703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091320a-15e6-41f9-abc0-ea8cf89c51aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:08.097993 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091320a-15e6-41f9-abc0-ea8cf89c51aa admin admin] PATH_INFO: `/v3/projects/02abb62428a44f00a474f96bcba24493` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:08.100095 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091320a-15e6-41f9-abc0-ea8cf89c51aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=02abb62428a44f00a474f96bcba24493)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:08.103163 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091320a-15e6-41f9-abc0-ea8cf89c51aa admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:08.115509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c14ed214-65ee-4da8-b8de-a5db7e418b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17227f7eb29f4cb48ab0b7d9f94a091a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:08.116868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c14ed214-65ee-4da8-b8de-a5db7e418b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17227f7eb29f4cb48ab0b7d9f94a091a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:08.148188 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c14ed214-65ee-4da8-b8de-a5db7e418b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17227f7eb29f4cb48ab0b7d9f94a091a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:08.149176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-c14ed214-65ee-4da8-b8de-a5db7e418b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17227f7eb29f4cb48ab0b7d9f94a091a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:08.174209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1106/2209] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:47:07 2022] DELETE /identity/v3/users/17227f7eb29f4cb48ab0b7d9f94a091a => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:08.207405 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:08.218456 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4091320a-15e6-41f9-abc0-ea8cf89c51aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02abb62428a44f00a474f96bcba24493', 'request_id': 'req-4091320a-15e6-41f9-abc0-ea8cf89c51aa'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:08.233815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4091320a-15e6-41f9-abc0-ea8cf89c51aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02abb62428a44f00a474f96bcba24493', 'request_id': 'req-4091320a-15e6-41f9-abc0-ea8cf89c51aa'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:08.257468 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4091320a-15e6-41f9-abc0-ea8cf89c51aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02abb62428a44f00a474f96bcba24493', 'request_id': 'req-4091320a-15e6-41f9-abc0-ea8cf89c51aa'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:08.292413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4091320a-15e6-41f9-abc0-ea8cf89c51aa admin admin] The token cache is being invalidate because project 02abb62428a44f00a474f96bcba24493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:47:08.292856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4091320a-15e6-41f9-abc0-ea8cf89c51aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:08.294953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-4091320a-15e6-41f9-abc0-ea8cf89c51aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:08.302061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1104/2210] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:47:08 2022] DELETE /identity/v3/projects/02abb62428a44f00a474f96bcba24493 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:08.304680 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f1f0c-27f9-497a-8d27-338c5322af87 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:08.304961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f1f0c-27f9-497a-8d27-338c5322af87 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:08.305314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f1f0c-27f9-497a-8d27-338c5322af87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:08.346085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e52f1f0c-27f9-497a-8d27-338c5322af87 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:08.347328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e52f1f0c-27f9-497a-8d27-338c5322af87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:08.547204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1107/2211] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:08.552377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32b8d5-8da5-4941-92d1-9b2494ca85ef None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:08.552677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32b8d5-8da5-4941-92d1-9b2494ca85ef None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:08.552943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32b8d5-8da5-4941-92d1-9b2494ca85ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:08.588912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-fd32b8d5-8da5-4941-92d1-9b2494ca85ef None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:08.592424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fd32b8d5-8da5-4941-92d1-9b2494ca85ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:08.634652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1105/2212] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:08.636055 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f1f0c-27f9-497a-8d27-338c5322af87 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:08.650650 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f1f0c-27f9-497a-8d27-338c5322af87 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:08.662245 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324dd62-08d0-4726-98fc-1de25f82527c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:08.663677 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324dd62-08d0-4726-98fc-1de25f82527c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:08.667572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324dd62-08d0-4726-98fc-1de25f82527c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:08.667572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324dd62-08d0-4726-98fc-1de25f82527c admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:08.667572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324dd62-08d0-4726-98fc-1de25f82527c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:47:08.667885 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324dd62-08d0-4726-98fc-1de25f82527c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:08.672036 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324dd62-08d0-4726-98fc-1de25f82527c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:08.707540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1108/2213] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:47:08.710567 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32b8d5-8da5-4941-92d1-9b2494ca85ef None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:08.724081 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd32b8d5-8da5-4941-92d1-9b2494ca85ef None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:08.740794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324dd62-08d0-4726-98fc-1de25f82527c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:08.742772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-5324dd62-08d0-4726-98fc-1de25f82527c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:08.747512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c7075-1bc1-4d6d-8d08-2d37174c99d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:08.749990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c7075-1bc1-4d6d-8d08-2d37174c99d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:08.760292 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c7075-1bc1-4d6d-8d08-2d37174c99d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:08.760775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324dd62-08d0-4726-98fc-1de25f82527c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:08.761444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c7075-1bc1-4d6d-8d08-2d37174c99d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:08.764180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c7075-1bc1-4d6d-8d08-2d37174c99d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:08.769069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c7075-1bc1-4d6d-8d08-2d37174c99d3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:08.800554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:08.805006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:08.805529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:08.806861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] PATH_INFO: `/v3/projects/79b0e3770dd440a880dd6925b9d6f67b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:08.821489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79b0e3770dd440a880dd6925b9d6f67b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:08.821489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:08.862428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1106/2214] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:47:08 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:47:08.869583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c7075-1bc1-4d6d-8d08-2d37174c99d3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:08.957021 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79b0e3770dd440a880dd6925b9d6f67b', 'request_id': 'req-e5c8d99c-38f2-426d-b931-34410963d249'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:08.975118 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79b0e3770dd440a880dd6925b9d6f67b', 'request_id': 'req-e5c8d99c-38f2-426d-b931-34410963d249'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:08.991246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c7075-1bc1-4d6d-8d08-2d37174c99d3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:08.995574 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79b0e3770dd440a880dd6925b9d6f67b', 'request_id': 'req-e5c8d99c-38f2-426d-b931-34410963d249'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.024421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] The token cache is being invalidate because project 79b0e3770dd440a880dd6925b9d6f67b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:47:09.024903 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.027341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.029244 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1109/2215] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:47:08 2022] DELETE /identity/v3/projects/79b0e3770dd440a880dd6925b9d6f67b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:09.033237 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:09.036253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:09.089594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4bf02-3bcc-4b27-bdac-c6a60b17bfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:09.090270 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4bf02-3bcc-4b27-bdac-c6a60b17bfbb admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:09.090553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4bf02-3bcc-4b27-bdac-c6a60b17bfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:09.090820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4bf02-3bcc-4b27-bdac-c6a60b17bfbb admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:09.091798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4bf02-3bcc-4b27-bdac-c6a60b17bfbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:09.093227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:09.095102 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4bf02-3bcc-4b27-bdac-c6a60b17bfbb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:09.146600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8d99c-38f2-426d-b931-34410963d249 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:09.153028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1107/2216] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:47:08 2022] POST /identity/v3/users => generated 287 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:47:09.156574 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d8224-4f02-4a48-8f0b-43aae1f83a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:09.157311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8224-4f02-4a48-8f0b-43aae1f83a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:09.157587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8224-4f02-4a48-8f0b-43aae1f83a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:09.157867 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8224-4f02-4a48-8f0b-43aae1f83a12 admin admin] PATH_INFO: `/v3/users/5f7dc31dea2044898421f6172910ce23` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:09.159209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d8224-4f02-4a48-8f0b-43aae1f83a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7dc31dea2044898421f6172910ce23)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:09.161369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d8224-4f02-4a48-8f0b-43aae1f83a12 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:09.168373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4bf02-3bcc-4b27-bdac-c6a60b17bfbb admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:09.174960 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d5c4bf02-3bcc-4b27-bdac-c6a60b17bfbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:09.196552 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4bf02-3bcc-4b27-bdac-c6a60b17bfbb admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:09.204952 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a556f7-d818-4c10-a8b2-4f6d584bebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:09.205876 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a556f7-d818-4c10-a8b2-4f6d584bebd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:09.206235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a556f7-d818-4c10-a8b2-4f6d584bebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:09.206645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a556f7-d818-4c10-a8b2-4f6d584bebd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:09.207792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a556f7-d818-4c10-a8b2-4f6d584bebd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:09.209513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a556f7-d818-4c10-a8b2-4f6d584bebd2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:09.237324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1108/2217] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:47:09.239602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a556f7-d818-4c10-a8b2-4f6d584bebd2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:09.241901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6c6d8224-4f02-4a48-8f0b-43aae1f83a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7dc31dea2044898421f6172910ce23'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.250369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a556f7-d818-4c10-a8b2-4f6d584bebd2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:09.255037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6c6d8224-4f02-4a48-8f0b-43aae1f83a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7dc31dea2044898421f6172910ce23'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.255218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ebef0-3f16-40dc-9b63-ad3807569028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:09.255828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ebef0-3f16-40dc-9b63-ad3807569028 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:09.256036 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6c6d8224-4f02-4a48-8f0b-43aae1f83a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7dc31dea2044898421f6172910ce23'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.256157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ebef0-3f16-40dc-9b63-ad3807569028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:09.256470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ebef0-3f16-40dc-9b63-ad3807569028 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:09.257205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ebef0-3f16-40dc-9b63-ad3807569028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:09.258983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ebef0-3f16-40dc-9b63-ad3807569028 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:09.273832 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1109/2218] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:47:09.275915 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ebef0-3f16-40dc-9b63-ad3807569028 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:09.279130 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6c6d8224-4f02-4a48-8f0b-43aae1f83a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7dc31dea2044898421f6172910ce23'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.279881 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6c6d8224-4f02-4a48-8f0b-43aae1f83a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7dc31dea2044898421f6172910ce23'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.288352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ebef0-3f16-40dc-9b63-ad3807569028 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:09.295791 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1110/2219] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:47:09 2022] DELETE /identity/v3/users/5f7dc31dea2044898421f6172910ce23 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:09.306160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d71b92-41a5-438a-91d0-b16401e6df6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:09.307190 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d71b92-41a5-438a-91d0-b16401e6df6f admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:09.307671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d71b92-41a5-438a-91d0-b16401e6df6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:09.308008 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d71b92-41a5-438a-91d0-b16401e6df6f admin admin] PATH_INFO: `/v3/projects/dd8a69b910f04ef1b4e3f59d96d03dbb/users/f1952dc4422c40e285652c5a3f38a986/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:09.332218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d71b92-41a5-438a-91d0-b16401e6df6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8a69b910f04ef1b4e3f59d96d03dbb, user_id=f1952dc4422c40e285652c5a3f38a986, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:09.335241 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d71b92-41a5-438a-91d0-b16401e6df6f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:09.338814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:09.355593 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1110/2220] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:47:09 2022] PUT /identity/v3/projects/dd8a69b910f04ef1b4e3f59d96d03dbb/users/f1952dc4422c40e285652c5a3f38a986/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:09.366803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328f46-98c5-46b1-b82c-91ee0c540ee4 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:09.367087 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328f46-98c5-46b1-b82c-91ee0c540ee4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:09.367363 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82328f46-98c5-46b1-b82c-91ee0c540ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:09.410820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-82328f46-98c5-46b1-b82c-91ee0c540ee4 None None] MFA Rules not processed for user `f1952dc4422c40e285652c5a3f38a986`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:09.411821 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-82328f46-98c5-46b1-b82c-91ee0c540ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:09.471310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d71b92-41a5-438a-91d0-b16401e6df6f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:09.475709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-39d71b92-41a5-438a-91d0-b16401e6df6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:09.520840 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1111/2221] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:09.534366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82328f46-98c5-46b1-b82c-91ee0c540ee4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:09.535950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-82328f46-98c5-46b1-b82c-91ee0c540ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:09.596611 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d71b92-41a5-438a-91d0-b16401e6df6f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:09.603339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4f481-4b7c-4205-9c61-164dcc04abd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:09.604018 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4f481-4b7c-4205-9c61-164dcc04abd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:09.604307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4f481-4b7c-4205-9c61-164dcc04abd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:09.604586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4f481-4b7c-4205-9c61-164dcc04abd5 admin admin] PATH_INFO: `/v3/users/72785755a63c432e9946bc67c674181b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:09.611721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4f481-4b7c-4205-9c61-164dcc04abd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72785755a63c432e9946bc67c674181b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:09.620647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4f481-4b7c-4205-9c61-164dcc04abd5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:09.637852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:09.669671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82328f46-98c5-46b1-b82c-91ee0c540ee4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:09.682871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4576b-d0ac-4163-b220-286213590648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:09.683856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4576b-d0ac-4163-b220-286213590648 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:09.684299 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4576b-d0ac-4163-b220-286213590648 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:09.684800 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4576b-d0ac-4163-b220-286213590648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:09.697911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4576b-d0ac-4163-b220-286213590648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:09.708793 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4576b-d0ac-4163-b220-286213590648 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:09.750458 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1112/2222] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:09.751849 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4576b-d0ac-4163-b220-286213590648 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:09.754463 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ace4576b-d0ac-4163-b220-286213590648 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:09.755930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-56b4f481-4b7c-4205-9c61-164dcc04abd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72785755a63c432e9946bc67c674181b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.768737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-56b4f481-4b7c-4205-9c61-164dcc04abd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72785755a63c432e9946bc67c674181b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.787370 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4576b-d0ac-4163-b220-286213590648 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:09.790256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-56b4f481-4b7c-4205-9c61-164dcc04abd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72785755a63c432e9946bc67c674181b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.790942 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-56b4f481-4b7c-4205-9c61-164dcc04abd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72785755a63c432e9946bc67c674181b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.801199 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:09.803251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:09.803761 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:09.804040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] PATH_INFO: `/v3/projects/f41ce50b6c0b4575ba91e33fcaa61778` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:09.808525 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41ce50b6c0b4575ba91e33fcaa61778)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:09.810641 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:09.821475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-56b4f481-4b7c-4205-9c61-164dcc04abd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72785755a63c432e9946bc67c674181b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.832262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1111/2223] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:47:09 2022] DELETE /identity/v3/users/72785755a63c432e9946bc67c674181b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:47:09.837214 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90829e66-fca9-47c2-992d-72671856b346 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:09.837600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90829e66-fca9-47c2-992d-72671856b346 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:09.837880 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90829e66-fca9-47c2-992d-72671856b346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:09.873878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-90829e66-fca9-47c2-992d-72671856b346 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:09.875231 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-90829e66-fca9-47c2-992d-72671856b346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:09.912501 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41ce50b6c0b4575ba91e33fcaa61778', 'request_id': 'req-45b8ff49-ea30-4842-83a9-621343a6149e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.922735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41ce50b6c0b4575ba91e33fcaa61778', 'request_id': 'req-45b8ff49-ea30-4842-83a9-621343a6149e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.939613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41ce50b6c0b4575ba91e33fcaa61778', 'request_id': 'req-45b8ff49-ea30-4842-83a9-621343a6149e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.966361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1112/2224] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:09.969619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] The token cache is being invalidate because project f41ce50b6c0b4575ba91e33fcaa61778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:47:09.970004 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.970774 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:09.978680 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1113/2225] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:47:09 2022] DELETE /identity/v3/projects/f41ce50b6c0b4575ba91e33fcaa61778 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:09.980951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eaa62-1094-4d51-8abc-2fd8a4a74950 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:09.983093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eaa62-1094-4d51-8abc-2fd8a4a74950 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:09.983547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eaa62-1094-4d51-8abc-2fd8a4a74950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:09.983775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:09.986051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:10.083631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a30eaa62-1094-4d51-8abc-2fd8a4a74950 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:10.085662 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a30eaa62-1094-4d51-8abc-2fd8a4a74950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:10.105492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8ff49-ea30-4842-83a9-621343a6149e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:10.107801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:10.114518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66173a3c-6449-411d-87ca-37ad281887c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:10.115510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66173a3c-6449-411d-87ca-37ad281887c2 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:10.115785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66173a3c-6449-411d-87ca-37ad281887c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:10.116181 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66173a3c-6449-411d-87ca-37ad281887c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:10.120524 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-66173a3c-6449-411d-87ca-37ad281887c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:10.253806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1113/2226] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:10.270953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48620a5-0db8-435a-8bb0-f8bc4a02de89 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:10.270953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48620a5-0db8-435a-8bb0-f8bc4a02de89 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:10.270953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48620a5-0db8-435a-8bb0-f8bc4a02de89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:10.309944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c48620a5-0db8-435a-8bb0-f8bc4a02de89 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:10.311512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c48620a5-0db8-435a-8bb0-f8bc4a02de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:10.317595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66173a3c-6449-411d-87ca-37ad281887c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:10.319076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66173a3c-6449-411d-87ca-37ad281887c2 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:10.332138 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1114/2227] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:10.336401 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48620a5-0db8-435a-8bb0-f8bc4a02de89 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:10.347866 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1114/2228] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:10.355176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48620a5-0db8-435a-8bb0-f8bc4a02de89 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:10.386368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dfc1f-12dd-45c9-b701-9caace4a27b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:10.387773 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dfc1f-12dd-45c9-b701-9caace4a27b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:10.388229 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dfc1f-12dd-45c9-b701-9caace4a27b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:10.389050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dfc1f-12dd-45c9-b701-9caace4a27b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:10.389991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dfc1f-12dd-45c9-b701-9caace4a27b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:47:10.390463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dfc1f-12dd-45c9-b701-9caace4a27b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:10.392315 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dfc1f-12dd-45c9-b701-9caace4a27b7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:10.412594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1115/2229] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:47:10.417489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66173a3c-6449-411d-87ca-37ad281887c2 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:10.429917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66173a3c-6449-411d-87ca-37ad281887c2 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:10.439131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2377ac2-62f2-46c4-abfa-192c0719925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:10.439921 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2377ac2-62f2-46c4-abfa-192c0719925c admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:10.440270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2377ac2-62f2-46c4-abfa-192c0719925c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:10.440738 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2377ac2-62f2-46c4-abfa-192c0719925c admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:10.441978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2377ac2-62f2-46c4-abfa-192c0719925c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:10.448721 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2377ac2-62f2-46c4-abfa-192c0719925c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:10.485922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:10.520637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1115/2230] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:47:10 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:47:10.525736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dfc1f-12dd-45c9-b701-9caace4a27b7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:10.549887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dfc1f-12dd-45c9-b701-9caace4a27b7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:10.746257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e9795-4814-4875-9e7f-0a7d489ecbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:10.747330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e9795-4814-4875-9e7f-0a7d489ecbea admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:10.747330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e9795-4814-4875-9e7f-0a7d489ecbea admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:10.748066 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e9795-4814-4875-9e7f-0a7d489ecbea admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:10.748410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e9795-4814-4875-9e7f-0a7d489ecbea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:10.751323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e9795-4814-4875-9e7f-0a7d489ecbea admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:10.793871 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1116/2231] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:47:10 2022] POST /identity/v3/users => generated 288 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:47:10.795516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2377ac2-62f2-46c4-abfa-192c0719925c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:10.810058 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2377ac2-62f2-46c4-abfa-192c0719925c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:10.817376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e497ad7-3ba4-46a3-aa21-2340f6bf989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:10.818288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497ad7-3ba4-46a3-aa21-2340f6bf989d admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:10.818869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497ad7-3ba4-46a3-aa21-2340f6bf989d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:10.819292 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e497ad7-3ba4-46a3-aa21-2340f6bf989d admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:10.820359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e497ad7-3ba4-46a3-aa21-2340f6bf989d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:10.822309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e497ad7-3ba4-46a3-aa21-2340f6bf989d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:10.843085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1116/2232] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:47:10.843567 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e9795-4814-4875-9e7f-0a7d489ecbea admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:10.862313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e9795-4814-4875-9e7f-0a7d489ecbea admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:10.874788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbed38-6bc2-448e-b88a-b413b46fc6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:10.875646 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbed38-6bc2-448e-b88a-b413b46fc6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:10.876051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbed38-6bc2-448e-b88a-b413b46fc6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:10.876452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbed38-6bc2-448e-b88a-b413b46fc6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:10.877310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbed38-6bc2-448e-b88a-b413b46fc6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:10.879072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbed38-6bc2-448e-b88a-b413b46fc6e0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:10.907196 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1117/2233] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:47:10.908271 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbed38-6bc2-448e-b88a-b413b46fc6e0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:10.909091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e497ad7-3ba4-46a3-aa21-2340f6bf989d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:10.911346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8e497ad7-3ba4-46a3-aa21-2340f6bf989d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:10.924528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbed38-6bc2-448e-b88a-b413b46fc6e0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:10.929790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a3960-b983-4dc0-a2f9-273173b53dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:10.930606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a3960-b983-4dc0-a2f9-273173b53dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:10.931050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a3960-b983-4dc0-a2f9-273173b53dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:10.931430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a3960-b983-4dc0-a2f9-273173b53dc6 admin admin] PATH_INFO: `/v3/projects/3481a903def14ab581a9a3ed47aa4c62/users/5154eceb04c94d29861ce9dd1391f616/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:10.961628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a3960-b983-4dc0-a2f9-273173b53dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3481a903def14ab581a9a3ed47aa4c62, user_id=5154eceb04c94d29861ce9dd1391f616, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:10.965107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a3960-b983-4dc0-a2f9-273173b53dc6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:10.965518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e497ad7-3ba4-46a3-aa21-2340f6bf989d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:10.970980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:10.971822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:10.972656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:10.972656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] PATH_INFO: `/v3/projects/ce3b5b4ab3c848bfb1b9ee40b6cf83f1` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:10.974019 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3b5b4ab3c848bfb1b9ee40b6cf83f1)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:10.976668 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:10.988969 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1118/2234] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:47:10 2022] PUT /identity/v3/projects/3481a903def14ab581a9a3ed47aa4c62/users/5154eceb04c94d29861ce9dd1391f616/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:11.074167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac6d5e-24e9-4fa4-90cb-6e63245a4a91 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:11.074450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac6d5e-24e9-4fa4-90cb-6e63245a4a91 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:11.074719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac6d5e-24e9-4fa4-90cb-6e63245a4a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:11.110433 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3b5b4ab3c848bfb1b9ee40b6cf83f1', 'request_id': 'req-fadba52a-f5cd-4455-a2f2-5a49adbc1348'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:11.112503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e8ac6d5e-24e9-4fa4-90cb-6e63245a4a91 None None] MFA Rules not processed for user `5154eceb04c94d29861ce9dd1391f616`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:11.113982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e8ac6d5e-24e9-4fa4-90cb-6e63245a4a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:11.125380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3b5b4ab3c848bfb1b9ee40b6cf83f1', 'request_id': 'req-fadba52a-f5cd-4455-a2f2-5a49adbc1348'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:11.142310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3b5b4ab3c848bfb1b9ee40b6cf83f1', 'request_id': 'req-fadba52a-f5cd-4455-a2f2-5a49adbc1348'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:11.172336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] The token cache is being invalidate because project ce3b5b4ab3c848bfb1b9ee40b6cf83f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:47:11.172336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:11.173919 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:11.175089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1117/2235] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:47:10 2022] DELETE /identity/v3/projects/ce3b5b4ab3c848bfb1b9ee40b6cf83f1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:11.179177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:11.180967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:11.193912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:11.260042 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1119/2236] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:47:11.271613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac6d5e-24e9-4fa4-90cb-6e63245a4a91 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:11.273033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e8ac6d5e-24e9-4fa4-90cb-6e63245a4a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:11.342473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadba52a-f5cd-4455-a2f2-5a49adbc1348 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:11.354896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:11.354896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:11.354896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:11.354896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] PATH_INFO: `/v3/users/0540aa33182e477db21446ad65bc8be9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:11.357691 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0540aa33182e477db21446ad65bc8be9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:11.357691 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:11.408304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac6d5e-24e9-4fa4-90cb-6e63245a4a91 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:11.423996 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe6bb6-5a24-4686-a04e-ab03e169527d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:11.424990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6bb6-5a24-4686-a04e-ab03e169527d service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:11.425464 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6bb6-5a24-4686-a04e-ab03e169527d service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:11.425887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6bb6-5a24-4686-a04e-ab03e169527d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:11.457566 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe6bb6-5a24-4686-a04e-ab03e169527d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:11.459500 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe6bb6-5a24-4686-a04e-ab03e169527d service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:11.461266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0540aa33182e477db21446ad65bc8be9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:11.475945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0540aa33182e477db21446ad65bc8be9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:11.477008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0540aa33182e477db21446ad65bc8be9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:11.485175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1120/2237] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:11.486777 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:11.500098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0540aa33182e477db21446ad65bc8be9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:11.502860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0540aa33182e477db21446ad65bc8be9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:11.508165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa1840-740d-4ea2-b1dd-b25aac00820e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:11.508724 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa1840-740d-4ea2-b1dd-b25aac00820e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:11.509445 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa1840-740d-4ea2-b1dd-b25aac00820e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:11.544517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1118/2238] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:47:11 2022] DELETE /identity/v3/users/0540aa33182e477db21446ad65bc8be9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:47:11.547924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6eaa1840-740d-4ea2-b1dd-b25aac00820e None None] MFA Rules not processed for user `f1952dc4422c40e285652c5a3f38a986`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:11.556983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6eaa1840-740d-4ea2-b1dd-b25aac00820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:11.764776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1121/2239] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:12.065755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:12.067346 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:12.224652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230d52b-4180-461e-a366-f07cc61ff8c3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:12.236576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:12.237639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:12.237933 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:12.238359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a admin admin] PATH_INFO: `/v3/projects/c657c8f9d7fe4571bda3b371cd2bd3c0` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:12.240162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c657c8f9d7fe4571bda3b371cd2bd3c0)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:12.246119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:12.349341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c657c8f9d7fe4571bda3b371cd2bd3c0', 'request_id': 'req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:12.358337 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c657c8f9d7fe4571bda3b371cd2bd3c0', 'request_id': 'req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:12.389122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c657c8f9d7fe4571bda3b371cd2bd3c0', 'request_id': 'req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:12.406392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a admin admin] The token cache is being invalidate because project c657c8f9d7fe4571bda3b371cd2bd3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:47:12.406392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:12.406392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-0a0084e8-d4e9-4f9a-a624-63cf47b5df4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:12.407113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1119/2240] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:47:12 2022] DELETE /identity/v3/projects/c657c8f9d7fe4571bda3b371cd2bd3c0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:12.413047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404839-7c32-47f7-8002-99e31da65a58 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:12.413583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404839-7c32-47f7-8002-99e31da65a58 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:12.413854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89404839-7c32-47f7-8002-99e31da65a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:12.442585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-89404839-7c32-47f7-8002-99e31da65a58 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:12.444597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-89404839-7c32-47f7-8002-99e31da65a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:12.566773 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1122/2241] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:47:12.569228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87fbfc-3e52-4748-8bb2-675585cbafce None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:12.569228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87fbfc-3e52-4748-8bb2-675585cbafce None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:12.569574 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87fbfc-3e52-4748-8bb2-675585cbafce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:12.597659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6b87fbfc-3e52-4748-8bb2-675585cbafce None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:12.599150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6b87fbfc-3e52-4748-8bb2-675585cbafce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:12.612382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1120/2242] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:12.613969 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404839-7c32-47f7-8002-99e31da65a58 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:12.626159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89404839-7c32-47f7-8002-99e31da65a58 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:12.643128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19c0fb-1427-4c05-af8a-ab3b63a9fadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:12.644681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19c0fb-1427-4c05-af8a-ab3b63a9fadc admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:12.645457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19c0fb-1427-4c05-af8a-ab3b63a9fadc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:12.646102 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19c0fb-1427-4c05-af8a-ab3b63a9fadc admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:12.647141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19c0fb-1427-4c05-af8a-ab3b63a9fadc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:47:12.647453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19c0fb-1427-4c05-af8a-ab3b63a9fadc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:12.649572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19c0fb-1427-4c05-af8a-ab3b63a9fadc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:12.666064 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1123/2243] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:47:12.670721 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87fbfc-3e52-4748-8bb2-675585cbafce None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:12.681011 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87fbfc-3e52-4748-8bb2-675585cbafce None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:12.686032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969cf34-d05a-4771-90d3-a7f5f64a4370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:12.686830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969cf34-d05a-4771-90d3-a7f5f64a4370 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:12.687116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969cf34-d05a-4771-90d3-a7f5f64a4370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:12.687502 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969cf34-d05a-4771-90d3-a7f5f64a4370 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:12.688237 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969cf34-d05a-4771-90d3-a7f5f64a4370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:12.690358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8969cf34-d05a-4771-90d3-a7f5f64a4370 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:12.726920 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1121/2244] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:47:12 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:47:12.728477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19c0fb-1427-4c05-af8a-ab3b63a9fadc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:12.739472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19c0fb-1427-4c05-af8a-ab3b63a9fadc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:12.750918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:12.810597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1257b-e91a-4f05-a2de-bfc857bde2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:12.811232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1257b-e91a-4f05-a2de-bfc857bde2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:12.811516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1257b-e91a-4f05-a2de-bfc857bde2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:12.812503 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1257b-e91a-4f05-a2de-bfc857bde2b4 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:12.813204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1257b-e91a-4f05-a2de-bfc857bde2b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:12.815222 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1257b-e91a-4f05-a2de-bfc857bde2b4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:12.854841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1124/2245] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:47:12 2022] POST /identity/v3/users => generated 282 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:47:12.861083 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969cf34-d05a-4771-90d3-a7f5f64a4370 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:12.875862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969cf34-d05a-4771-90d3-a7f5f64a4370 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:12.883234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee08ed-b037-4478-a7c2-1e3a3807bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:12.884154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee08ed-b037-4478-a7c2-1e3a3807bf02 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:12.884573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee08ed-b037-4478-a7c2-1e3a3807bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:12.884974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee08ed-b037-4478-a7c2-1e3a3807bf02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:12.886087 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee08ed-b037-4478-a7c2-1e3a3807bf02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:12.888902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee08ed-b037-4478-a7c2-1e3a3807bf02 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:12.903773 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1122/2246] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:47:12.908547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1257b-e91a-4f05-a2de-bfc857bde2b4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:12.919219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1257b-e91a-4f05-a2de-bfc857bde2b4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:12.924350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc9657-ae9c-44f6-abe2-6096a1e6695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:12.924974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc9657-ae9c-44f6-abe2-6096a1e6695b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:12.925255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc9657-ae9c-44f6-abe2-6096a1e6695b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:12.925566 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc9657-ae9c-44f6-abe2-6096a1e6695b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:12.926266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc9657-ae9c-44f6-abe2-6096a1e6695b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:12.927875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc9657-ae9c-44f6-abe2-6096a1e6695b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:12.940441 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1125/2247] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:47:12.944684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee08ed-b037-4478-a7c2-1e3a3807bf02 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:12.955125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee08ed-b037-4478-a7c2-1e3a3807bf02 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:12.960377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d787a-2cc5-438e-aaa4-b2f59910bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:12.961047 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d787a-2cc5-438e-aaa4-b2f59910bed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:12.961348 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d787a-2cc5-438e-aaa4-b2f59910bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:12.961623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d787a-2cc5-438e-aaa4-b2f59910bed3 admin admin] PATH_INFO: `/v3/projects/31024ac8b3314365b9990abb1e169c5c/users/f54909faf4d54ea7b902c5e01b0435be/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:12.977778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d787a-2cc5-438e-aaa4-b2f59910bed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31024ac8b3314365b9990abb1e169c5c, user_id=f54909faf4d54ea7b902c5e01b0435be, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:12.980441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d787a-2cc5-438e-aaa4-b2f59910bed3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:12.995121 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1123/2248] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:47:12 2022] PUT /identity/v3/projects/31024ac8b3314365b9990abb1e169c5c/users/f54909faf4d54ea7b902c5e01b0435be/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:13.006729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94594d3-bb42-4dee-bae8-93b5c0c0bf60 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:13.007139 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94594d3-bb42-4dee-bae8-93b5c0c0bf60 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:13.007289 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94594d3-bb42-4dee-bae8-93b5c0c0bf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:13.037303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d94594d3-bb42-4dee-bae8-93b5c0c0bf60 None None] MFA Rules not processed for user `f54909faf4d54ea7b902c5e01b0435be`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:13.038576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d94594d3-bb42-4dee-bae8-93b5c0c0bf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:13.107878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1126/2249] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:13.119588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d787a-2cc5-438e-aaa4-b2f59910bed3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:13.122157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-396d787a-2cc5-438e-aaa4-b2f59910bed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:13.151873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:13.204041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d787a-2cc5-438e-aaa4-b2f59910bed3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:13.207892 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45094a45-ef18-453e-a854-294d76b193d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:13.208533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45094a45-ef18-453e-a854-294d76b193d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:13.208827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45094a45-ef18-453e-a854-294d76b193d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:13.209095 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45094a45-ef18-453e-a854-294d76b193d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:13.228880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45094a45-ef18-453e-a854-294d76b193d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:13.230421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45094a45-ef18-453e-a854-294d76b193d9 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:13.241770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1124/2250] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:13 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:18.690626 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129fc01-0d35-443d-8c32-ae235d27dba8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:18.691173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129fc01-0d35-443d-8c32-ae235d27dba8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:18.691173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129fc01-0d35-443d-8c32-ae235d27dba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:18.752223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e129fc01-0d35-443d-8c32-ae235d27dba8 None None] MFA Rules not processed for user `69246ce0e0544e72a928af58b65930bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:18.754772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e129fc01-0d35-443d-8c32-ae235d27dba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:18.897415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1127/2251] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:23.236605 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=22 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:23.619981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45094a45-ef18-453e-a854-294d76b193d9 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:23.621559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-45094a45-ef18-453e-a854-294d76b193d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:23.699720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45094a45-ef18-453e-a854-294d76b193d9 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:23.704464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:23.705188 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:23.705597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:23.705945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] PATH_INFO: `/v3/users/5154eceb04c94d29861ce9dd1391f616` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:23.707757 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5154eceb04c94d29861ce9dd1391f616)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:23.709815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:23.766474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5154eceb04c94d29861ce9dd1391f616'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:23.776257 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5154eceb04c94d29861ce9dd1391f616'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:23.777035 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5154eceb04c94d29861ce9dd1391f616'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:23.793501 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5154eceb04c94d29861ce9dd1391f616'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:23.794559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5154eceb04c94d29861ce9dd1391f616'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:23.819590 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1125/2252] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:47:23 2022] DELETE /identity/v3/users/5154eceb04c94d29861ce9dd1391f616 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:23.824273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12467f7f-b536-4203-b0b3-96edf1edbbd6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:23.824682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12467f7f-b536-4203-b0b3-96edf1edbbd6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:23.824859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12467f7f-b536-4203-b0b3-96edf1edbbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:23.845317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-12467f7f-b536-4203-b0b3-96edf1edbbd6 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:23.846549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-12467f7f-b536-4203-b0b3-96edf1edbbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:23.881729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:23.940436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1128/2253] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:23.950585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:23.952258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:24.016042 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d674-7dd6-4a64-a869-0777803afbaf admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:24.019929 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb60d7-e180-48ad-8507-64d7867e3dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:24.020638 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb60d7-e180-48ad-8507-64d7867e3dfd service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:24.020984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb60d7-e180-48ad-8507-64d7867e3dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:24.021338 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb60d7-e180-48ad-8507-64d7867e3dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:24.034673 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb60d7-e180-48ad-8507-64d7867e3dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:24.036191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb60d7-e180-48ad-8507-64d7867e3dfd service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:24.046728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1126/2254] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:24.402978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12467f7f-b536-4203-b0b3-96edf1edbbd6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:24.404458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-12467f7f-b536-4203-b0b3-96edf1edbbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:24.434237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12467f7f-b536-4203-b0b3-96edf1edbbd6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:24.441959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:24.443571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:24.443860 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:24.444134 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] PATH_INFO: `/v3/projects/3481a903def14ab581a9a3ed47aa4c62` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:24.448106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3481a903def14ab581a9a3ed47aa4c62)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:24.451972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:24.525899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3481a903def14ab581a9a3ed47aa4c62', 'request_id': 'req-070d1a44-fded-4c37-9366-9a11993d5da2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:24.534175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3481a903def14ab581a9a3ed47aa4c62', 'request_id': 'req-070d1a44-fded-4c37-9366-9a11993d5da2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:24.540313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3481a903def14ab581a9a3ed47aa4c62', 'request_id': 'req-070d1a44-fded-4c37-9366-9a11993d5da2'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:24.552878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] The token cache is being invalidate because project 3481a903def14ab581a9a3ed47aa4c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:47:24.553223 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:24.553947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:24.555836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1129/2255] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:47:24 2022] DELETE /identity/v3/projects/3481a903def14ab581a9a3ed47aa4c62 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:27.663343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6b22-d42a-4594-962f-4639c6d6f4a4 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:27.664005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6b22-d42a-4594-962f-4639c6d6f4a4 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:27.664005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6b22-d42a-4594-962f-4639c6d6f4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:27.697142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ebff6b22-d42a-4594-962f-4639c6d6f4a4 None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:27.698625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ebff6b22-d42a-4594-962f-4639c6d6f4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:27.739010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:27.823762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1127/2256] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:47:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:27.850949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:27.852976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:28.013220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d1a44-fded-4c37-9366-9a11993d5da2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:28.020242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8b727-098d-4ab1-a93c-ae7872de469c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:28.020797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8b727-098d-4ab1-a93c-ae7872de469c service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:28.021071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8b727-098d-4ab1-a93c-ae7872de469c service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:28.021361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8b727-098d-4ab1-a93c-ae7872de469c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:28.033206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8b727-098d-4ab1-a93c-ae7872de469c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:28.034863 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8b727-098d-4ab1-a93c-ae7872de469c service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:28.048882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1130/2257] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:47:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 02:47:31.447845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff6b22-d42a-4594-962f-4639c6d6f4a4 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:31.449828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ebff6b22-d42a-4594-962f-4639c6d6f4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:31.542280 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff6b22-d42a-4594-962f-4639c6d6f4a4 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:31.546130 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6cdda-2e02-48fa-87c6-0ae36959f167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:31.546768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6cdda-2e02-48fa-87c6-0ae36959f167 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:31.547049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6cdda-2e02-48fa-87c6-0ae36959f167 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:31.547321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6cdda-2e02-48fa-87c6-0ae36959f167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:31.549138 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-18f6cdda-2e02-48fa-87c6-0ae36959f167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:31.643479 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6cdda-2e02-48fa-87c6-0ae36959f167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:31.649928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6cdda-2e02-48fa-87c6-0ae36959f167 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:31.656940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1128/2258] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:38.043796 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:41.651464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=65 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:42.307783 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa2691-cef5-4fcb-9062-ed81a2aa6215 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:42.308417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa2691-cef5-4fcb-9062-ed81a2aa6215 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:42.308772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa2691-cef5-4fcb-9062-ed81a2aa6215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:42.336671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4caa2691-cef5-4fcb-9062-ed81a2aa6215 None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:42.339189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4caa2691-cef5-4fcb-9062-ed81a2aa6215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:42.348427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1131/2259] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:47:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:42.363548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6cdda-2e02-48fa-87c6-0ae36959f167 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:42.376049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6cdda-2e02-48fa-87c6-0ae36959f167 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:42.382568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305541a-2e6e-46cf-b2fe-da8c66be12df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:42.383680 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305541a-2e6e-46cf-b2fe-da8c66be12df service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:42.384202 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305541a-2e6e-46cf-b2fe-da8c66be12df service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:42.384764 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305541a-2e6e-46cf-b2fe-da8c66be12df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:42.394595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305541a-2e6e-46cf-b2fe-da8c66be12df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:42.396633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305541a-2e6e-46cf-b2fe-da8c66be12df service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:42.417157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1129/2260] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:47:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:47:43.116547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed110-0fcd-44a3-8ed5-8e6a6ef336d4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:43.116833 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed110-0fcd-44a3-8ed5-8e6a6ef336d4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:43.117479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ed110-0fcd-44a3-8ed5-8e6a6ef336d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:43.144301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9b0ed110-0fcd-44a3-8ed5-8e6a6ef336d4 None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:43.145930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9b0ed110-0fcd-44a3-8ed5-8e6a6ef336d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:43.165601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1132/2261] 10.222.0.39 () {58 vars in 967 bytes} [Tue Jul 26 02:47:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:43.173130 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305541a-2e6e-46cf-b2fe-da8c66be12df service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:43.186811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305541a-2e6e-46cf-b2fe-da8c66be12df service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:43.192940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021257b-a01e-408d-ac0b-e024c17694f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:43.193833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021257b-a01e-408d-ac0b-e024c17694f4 service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:43.194288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021257b-a01e-408d-ac0b-e024c17694f4 service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:43.194616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021257b-a01e-408d-ac0b-e024c17694f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:43.204491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021257b-a01e-408d-ac0b-e024c17694f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:43.206543 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021257b-a01e-408d-ac0b-e024c17694f4 service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:43.216409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1130/2262] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:47:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:47:43.536656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2346fc-e140-4303-ac41-01efe5da074c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:43.537176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2346fc-e140-4303-ac41-01efe5da074c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:43.537176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2346fc-e140-4303-ac41-01efe5da074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:43.557582 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7d2346fc-e140-4303-ac41-01efe5da074c None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:43.558088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7d2346fc-e140-4303-ac41-01efe5da074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:43.565739 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1133/2263] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:47:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:43.578594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021257b-a01e-408d-ac0b-e024c17694f4 service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:43.589567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021257b-a01e-408d-ac0b-e024c17694f4 service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:43.594459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ff2a4-dccb-4317-a02d-4ba48491bc9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:43.595075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ff2a4-dccb-4317-a02d-4ba48491bc9a service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:43.595369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ff2a4-dccb-4317-a02d-4ba48491bc9a service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:43.595635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ff2a4-dccb-4317-a02d-4ba48491bc9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:43.603904 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ff2a4-dccb-4317-a02d-4ba48491bc9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:43.605548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ff2a4-dccb-4317-a02d-4ba48491bc9a service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:43.614499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1131/2264] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:47:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:47:43.999381 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c848dc3-0f38-4d3c-861a-e508a592a1cf None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:43.999910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c848dc3-0f38-4d3c-861a-e508a592a1cf None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:44.000275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c848dc3-0f38-4d3c-861a-e508a592a1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:44.022989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2c848dc3-0f38-4d3c-861a-e508a592a1cf None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:44.024238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2c848dc3-0f38-4d3c-861a-e508a592a1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:44.031628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1134/2265] 10.222.0.39 () {58 vars in 967 bytes} [Tue Jul 26 02:47:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:44.044140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ff2a4-dccb-4317-a02d-4ba48491bc9a service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:44.055956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ff2a4-dccb-4317-a02d-4ba48491bc9a service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:44.061002 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400713a-7a30-4414-b25a-2e84ce1ea42d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:44.061659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400713a-7a30-4414-b25a-2e84ce1ea42d service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:44.061937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400713a-7a30-4414-b25a-2e84ce1ea42d service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:44.062206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400713a-7a30-4414-b25a-2e84ce1ea42d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:44.072742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400713a-7a30-4414-b25a-2e84ce1ea42d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:44.074717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400713a-7a30-4414-b25a-2e84ce1ea42d service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:44.084278 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1132/2266] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:47:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:47:46.356470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c848dc3-0f38-4d3c-861a-e508a592a1cf None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:46.358087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2c848dc3-0f38-4d3c-861a-e508a592a1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:46.442120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c848dc3-0f38-4d3c-861a-e508a592a1cf None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:46.446933 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:46.447596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:46.447875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:46.448171 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] PATH_INFO: `/v3/users/f1952dc4422c40e285652c5a3f38a986` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:46.449907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1952dc4422c40e285652c5a3f38a986)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:46.452143 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:46.506306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1952dc4422c40e285652c5a3f38a986'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:46.515252 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1952dc4422c40e285652c5a3f38a986'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:46.524263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1952dc4422c40e285652c5a3f38a986'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:46.525051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1952dc4422c40e285652c5a3f38a986'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:46.538307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1952dc4422c40e285652c5a3f38a986'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:46.544785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1135/2267] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:47:46 2022] DELETE /identity/v3/users/f1952dc4422c40e285652c5a3f38a986 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:46.549463 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090e4d9-ad91-455a-bb61-078cee2c45d7 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:46.549970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090e4d9-ad91-455a-bb61-078cee2c45d7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:46.549970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090e4d9-ad91-455a-bb61-078cee2c45d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:46.574234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6090e4d9-ad91-455a-bb61-078cee2c45d7 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:46.575629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6090e4d9-ad91-455a-bb61-078cee2c45d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:46.649381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1133/2268] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:46.662521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:46.664145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:46.740017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367a5c4-69a6-43a1-bc81-640c976ff0bd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:46.745116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b87c1-0561-4ac4-9563-77e6501bfc0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:46.745828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b87c1-0561-4ac4-9563-77e6501bfc0c service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:46.746104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b87c1-0561-4ac4-9563-77e6501bfc0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:46.746566 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b87c1-0561-4ac4-9563-77e6501bfc0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:46.755139 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:46.758039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b87c1-0561-4ac4-9563-77e6501bfc0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:46.759832 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b87c1-0561-4ac4-9563-77e6501bfc0c service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:46.771464 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1136/2269] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:46.962597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090e4d9-ad91-455a-bb61-078cee2c45d7 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:46.966376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6090e4d9-ad91-455a-bb61-078cee2c45d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:47.005563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090e4d9-ad91-455a-bb61-078cee2c45d7 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:47.027332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb7d53-6500-4bd1-90fc-133408d6809c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:47.028261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7d53-6500-4bd1-90fc-133408d6809c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:47.028708 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7d53-6500-4bd1-90fc-133408d6809c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:47.029128 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7d53-6500-4bd1-90fc-133408d6809c admin admin] PATH_INFO: `/v3/projects/dd8a69b910f04ef1b4e3f59d96d03dbb` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:47.030519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb7d53-6500-4bd1-90fc-133408d6809c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8a69b910f04ef1b4e3f59d96d03dbb)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:47.034236 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb7d53-6500-4bd1-90fc-133408d6809c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:47.104999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cbbb7d53-6500-4bd1-90fc-133408d6809c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8a69b910f04ef1b4e3f59d96d03dbb', 'request_id': 'req-cbbb7d53-6500-4bd1-90fc-133408d6809c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:47.114369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cbbb7d53-6500-4bd1-90fc-133408d6809c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8a69b910f04ef1b4e3f59d96d03dbb', 'request_id': 'req-cbbb7d53-6500-4bd1-90fc-133408d6809c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:47.123796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cbbb7d53-6500-4bd1-90fc-133408d6809c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8a69b910f04ef1b4e3f59d96d03dbb', 'request_id': 'req-cbbb7d53-6500-4bd1-90fc-133408d6809c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:47.137402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cbbb7d53-6500-4bd1-90fc-133408d6809c admin admin] The token cache is being invalidate because project dd8a69b910f04ef1b4e3f59d96d03dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:47:47.137648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cbbb7d53-6500-4bd1-90fc-133408d6809c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:47.138254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cbbb7d53-6500-4bd1-90fc-133408d6809c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:47.140208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1134/2270] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:47:46 2022] DELETE /identity/v3/projects/dd8a69b910f04ef1b4e3f59d96d03dbb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:47.915005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c098faa-fc15-4187-a016-2f4fa1f1b3f4 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:47.915005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c098faa-fc15-4187-a016-2f4fa1f1b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:47.915005 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c098faa-fc15-4187-a016-2f4fa1f1b3f4 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:47.916623 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1137/2271] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 02:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:47:47.923632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55580f9c-541c-410e-b427-7aa6b7bc6fb7 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:47.924164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55580f9c-541c-410e-b427-7aa6b7bc6fb7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:47.924164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55580f9c-541c-410e-b427-7aa6b7bc6fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:47.944974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-55580f9c-541c-410e-b427-7aa6b7bc6fb7 None None] MFA Rules not processed for user `338b2744014940ca96c08d4e9262697b`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:47.946216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-55580f9c-541c-410e-b427-7aa6b7bc6fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:47.974405 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:48.022167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1135/2272] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 02:47:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:48.034395 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c098faa-fc15-4187-a016-2f4fa1f1b3f4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:48.036236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1c098faa-fc15-4187-a016-2f4fa1f1b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:48.103347 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c098faa-fc15-4187-a016-2f4fa1f1b3f4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:48.107505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbcfbe1-3c4b-459c-8492-a59bbc1ed132 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2402339784b34d98a4670db912617331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:48.108226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcfbe1-3c4b-459c-8492-a59bbc1ed132 service glance] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:48.108526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcfbe1-3c4b-459c-8492-a59bbc1ed132 service glance] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:48.108938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbcfbe1-3c4b-459c-8492-a59bbc1ed132 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:48.110015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55580f9c-541c-410e-b427-7aa6b7bc6fb7 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:48.111493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-55580f9c-541c-410e-b427-7aa6b7bc6fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:48.120978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcfbe1-3c4b-459c-8492-a59bbc1ed132 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:48.122619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbcfbe1-3c4b-459c-8492-a59bbc1ed132 service glance] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:48.134240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1138/2273] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:47:48.203727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55580f9c-541c-410e-b427-7aa6b7bc6fb7 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:48.208899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:48.209582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:48.209877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:48.210230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] PATH_INFO: `/v3/users/f54909faf4d54ea7b902c5e01b0435be` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:48.211552 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54909faf4d54ea7b902c5e01b0435be)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:48.214062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:48.215155 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c7c4f-c20d-4b37-a270-ed27ede3a843 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:48.215460 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c7c4f-c20d-4b37-a270-ed27ede3a843 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:48.215962 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c7c4f-c20d-4b37-a270-ed27ede3a843 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:48.217353 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1139/2274] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 02:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:47:48.221931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c171f-c873-43da-a2f3-9709cc1668f1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:48.222336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c171f-c873-43da-a2f3-9709cc1668f1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:48.222698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c171f-c873-43da-a2f3-9709cc1668f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:48.247619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e69c171f-c873-43da-a2f3-9709cc1668f1 None None] MFA Rules not processed for user `fe228871a7fd4a9bb15645955ff365c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:48.248857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e69c171f-c873-43da-a2f3-9709cc1668f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:48.266509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54909faf4d54ea7b902c5e01b0435be'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:48.273625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54909faf4d54ea7b902c5e01b0435be'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:48.274590 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54909faf4d54ea7b902c5e01b0435be'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:48.287392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54909faf4d54ea7b902c5e01b0435be'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:48.288339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54909faf4d54ea7b902c5e01b0435be'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:48.301531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1140/2275] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 02:47:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:47:48.302246 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1136/2276] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:47:48 2022] DELETE /identity/v3/users/f54909faf4d54ea7b902c5e01b0435be => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:47:48.306606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5bbed-969d-4f59-bf41-c420cb4068d0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:48.306916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5bbed-969d-4f59-bf41-c420cb4068d0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:48.307218 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5bbed-969d-4f59-bf41-c420cb4068d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:48.314758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:48.316890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:48.327630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-47a5bbed-969d-4f59-bf41-c420cb4068d0 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:48.328846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-47a5bbed-969d-4f59-bf41-c420cb4068d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:48.365305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:48.380075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91ec9d-bef3-43ba-839e-a40d5cd4b32c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:48.384394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068419b3-5f33-4ef2-9b09-65c05e17e6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:48.385168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068419b3-5f33-4ef2-9b09-65c05e17e6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:48.385491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068419b3-5f33-4ef2-9b09-65c05e17e6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:48.385769 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068419b3-5f33-4ef2-9b09-65c05e17e6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:48.394617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068419b3-5f33-4ef2-9b09-65c05e17e6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:48.395642 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1141/2277] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:48.396070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068419b3-5f33-4ef2-9b09-65c05e17e6f6 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:48.406286 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5bbed-969d-4f59-bf41-c420cb4068d0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:48.407513 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1137/2278] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:47:48.408674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-47a5bbed-969d-4f59-bf41-c420cb4068d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:48.421836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5bbed-969d-4f59-bf41-c420cb4068d0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:48.426183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c38d96-11da-4e43-bf7d-87b37353f230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:48.426851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c38d96-11da-4e43-bf7d-87b37353f230 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:48.427131 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c38d96-11da-4e43-bf7d-87b37353f230 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:48.427400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c38d96-11da-4e43-bf7d-87b37353f230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:48.437236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c38d96-11da-4e43-bf7d-87b37353f230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:48.438753 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c38d96-11da-4e43-bf7d-87b37353f230 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:48.448941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1142/2279] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:48.496954 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7630e31-882c-44bd-b954-f04adadaf7a9 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:48.497388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7630e31-882c-44bd-b954-f04adadaf7a9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:48.497961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7630e31-882c-44bd-b954-f04adadaf7a9 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:48.499450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1138/2280] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 02:47:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:47:48.506010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169d964-067e-4f78-a173-17cde0a7ad56 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:48.506827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169d964-067e-4f78-a173-17cde0a7ad56 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:48.506827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169d964-067e-4f78-a173-17cde0a7ad56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:48.529452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2169d964-067e-4f78-a173-17cde0a7ad56 None None] MFA Rules not processed for user `338b2744014940ca96c08d4e9262697b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:48.530735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2169d964-067e-4f78-a173-17cde0a7ad56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:48.566833 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:47:48.612179 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1143/2281] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 02:47:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:48.623157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7630e31-882c-44bd-b954-f04adadaf7a9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:48.638246 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7630e31-882c-44bd-b954-f04adadaf7a9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:48.641877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e159d-c6ac-4936-8e7d-32b1e084d64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:48.642714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e159d-c6ac-4936-8e7d-32b1e084d64c service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:48.643001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e159d-c6ac-4936-8e7d-32b1e084d64c service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:48.643271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e159d-c6ac-4936-8e7d-32b1e084d64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:48.654222 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e159d-c6ac-4936-8e7d-32b1e084d64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:48.655888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e159d-c6ac-4936-8e7d-32b1e084d64c service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:48.667841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1139/2282] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:47:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:47:48.745268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169d964-067e-4f78-a173-17cde0a7ad56 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:48.747037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2169d964-067e-4f78-a173-17cde0a7ad56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:48.767158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169d964-067e-4f78-a173-17cde0a7ad56 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:48.772318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:48.773093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:48.773489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:48.773846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] PATH_INFO: `/v3/projects/31024ac8b3314365b9990abb1e169c5c` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:48.775277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] RBAC: Authorizing `identity:delete_project(project_id=31024ac8b3314365b9990abb1e169c5c)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:48.777271 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:48.835075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31024ac8b3314365b9990abb1e169c5c', 'request_id': 'req-55e9f996-9fc7-4bce-90aa-b898411a532f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:48.845686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31024ac8b3314365b9990abb1e169c5c', 'request_id': 'req-55e9f996-9fc7-4bce-90aa-b898411a532f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:48.854386 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31024ac8b3314365b9990abb1e169c5c', 'request_id': 'req-55e9f996-9fc7-4bce-90aa-b898411a532f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:48.867185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] The token cache is being invalidate because project 31024ac8b3314365b9990abb1e169c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:47:48.867464 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:48.868137 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:47:48.870905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1144/2283] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:47:48 2022] DELETE /identity/v3/projects/31024ac8b3314365b9990abb1e169c5c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:47:51.502759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1d644-71b8-4db8-a093-397b563e3993 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:51.503194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1d644-71b8-4db8-a093-397b563e3993 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:51.503432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1d644-71b8-4db8-a093-397b563e3993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:51.526889 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-89f1d644-71b8-4db8-a093-397b563e3993 None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:51.528287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-89f1d644-71b8-4db8-a093-397b563e3993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:51.609344 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1140/2284] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:47:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:47:51.632156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:47:51.634022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:51.729550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9f996-9fc7-4bce-90aa-b898411a532f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:47:51.739435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cace59-28d8-47c3-89f0-049a30fd055b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:47:51.740260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cace59-28d8-47c3-89f0-049a30fd055b service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:51.740558 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cace59-28d8-47c3-89f0-049a30fd055b service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:51.740818 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cace59-28d8-47c3-89f0-049a30fd055b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:51.757597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cace59-28d8-47c3-89f0-049a30fd055b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:47:51.759233 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cace59-28d8-47c3-89f0-049a30fd055b service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:47:51.768522 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1145/2285] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:47:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:47:53.028956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fb581-7f77-4c01-9341-52be7b24bbad None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:47:53.029517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fb581-7f77-4c01-9341-52be7b24bbad None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:47:53.029517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fb581-7f77-4c01-9341-52be7b24bbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:47:53.049411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6e7fb581-7f77-4c01-9341-52be7b24bbad None None] MFA Rules not processed for user `e5ad4dddff55436095a7d6a43317426f`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:47:53.050597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6e7fb581-7f77-4c01-9341-52be7b24bbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:47:53.107039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1141/2286] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:47:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:48:01.764619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:48:03.100027 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=63 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:48:12.567155 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39fb83-66fd-4e07-a858-c05bd14b6618 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:48:12.567751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39fb83-66fd-4e07-a858-c05bd14b6618 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:48:12.567751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39fb83-66fd-4e07-a858-c05bd14b6618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:48:12.591474 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-dc39fb83-66fd-4e07-a858-c05bd14b6618 None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:48:12.592723 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dc39fb83-66fd-4e07-a858-c05bd14b6618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:48:12.600698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1146/2287] 10.222.0.39 () {58 vars in 967 bytes} [Tue Jul 26 02:48:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:48:12.620929 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fb581-7f77-4c01-9341-52be7b24bbad None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:48:12.634450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fb581-7f77-4c01-9341-52be7b24bbad None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:48:12.639991 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d96f0-9f76-4f23-a111-3d41e0c1b3ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:48:12.640641 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d96f0-9f76-4f23-a111-3d41e0c1b3ba service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:48:12.640919 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d96f0-9f76-4f23-a111-3d41e0c1b3ba service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:48:12.641187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d96f0-9f76-4f23-a111-3d41e0c1b3ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:48:12.650780 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d96f0-9f76-4f23-a111-3d41e0c1b3ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:48:12.652709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d96f0-9f76-4f23-a111-3d41e0c1b3ba service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:48:12.663492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1142/2288] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:48:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:48:19.117104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39fb83-66fd-4e07-a858-c05bd14b6618 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:48:19.118731 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dc39fb83-66fd-4e07-a858-c05bd14b6618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:48:19.188885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39fb83-66fd-4e07-a858-c05bd14b6618 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:48:19.194572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5dd46b-ecb9-424d-8a4f-18dee66e03b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629b38364f6a414aa14123c0749ba164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:48:19.195193 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd46b-ecb9-424d-8a4f-18dee66e03b9 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:48:19.195463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd46b-ecb9-424d-8a4f-18dee66e03b9 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:48:19.195724 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5dd46b-ecb9-424d-8a4f-18dee66e03b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:48:19.197539 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-de5dd46b-ecb9-424d-8a4f-18dee66e03b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:48:19.208723 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dd46b-ecb9-424d-8a4f-18dee66e03b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:48:19.210441 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5dd46b-ecb9-424d-8a4f-18dee66e03b9 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:48:19.220513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1147/2289] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:48:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:48:22.659263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:48:29.216545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=35 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:48:50.286261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec3d7c-b72c-46eb-89b4-df3da45f90f1 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:48:50.286876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec3d7c-b72c-46eb-89b4-df3da45f90f1 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:48:50.286876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec3d7c-b72c-46eb-89b4-df3da45f90f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:48:50.308891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7cec3d7c-b72c-46eb-89b4-df3da45f90f1 None None] MFA Rules not processed for user `69246ce0e0544e72a928af58b65930bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:48:50.310075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7cec3d7c-b72c-46eb-89b4-df3da45f90f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:48:50.369234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1143/2290] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:48:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:49:00.361625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=25 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:49:04.357261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b538ed-95ba-48ce-83fb-2c04878c5015 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:49:04.357976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b538ed-95ba-48ce-83fb-2c04878c5015 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:49:04.357976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b538ed-95ba-48ce-83fb-2c04878c5015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:49:04.380124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-07b538ed-95ba-48ce-83fb-2c04878c5015 None None] MFA Rules not processed for user `adea8e6fd0cb47f394e811865db51ade`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:49:04.381445 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-07b538ed-95ba-48ce-83fb-2c04878c5015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:49:04.480765 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1148/2291] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:49:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:49:14.462394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=25 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:49:27.830677 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c06f-cb85-48bb-8959-175e087c1262 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:49:27.831547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c06f-cb85-48bb-8959-175e087c1262 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:49:27.831547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c06f-cb85-48bb-8959-175e087c1262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:49:27.855485 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a409c06f-cb85-48bb-8959-175e087c1262 None None] MFA Rules not processed for user `e5ad4dddff55436095a7d6a43317426f`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:49:27.856745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a409c06f-cb85-48bb-8959-175e087c1262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:49:27.865258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1144/2292] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:49:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:49:32.710676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40008-a72c-49d9-9ebf-1d8cb21a8757 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:49:32.711144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40008-a72c-49d9-9ebf-1d8cb21a8757 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:49:32.711232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40008-a72c-49d9-9ebf-1d8cb21a8757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:49:32.731743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ded40008-a72c-49d9-9ebf-1d8cb21a8757 None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:49:32.732879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ded40008-a72c-49d9-9ebf-1d8cb21a8757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:49:32.740814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1149/2293] 10.222.0.39 () {58 vars in 967 bytes} [Tue Jul 26 02:49:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:49:32.792282 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409c06f-cb85-48bb-8959-175e087c1262 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:49:32.804987 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409c06f-cb85-48bb-8959-175e087c1262 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:49:32.810364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83ebd9-4ff8-40e8-ab19-bb244d6cc04f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:49:32.810989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83ebd9-4ff8-40e8-ab19-bb244d6cc04f service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:49:32.811265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83ebd9-4ff8-40e8-ab19-bb244d6cc04f service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:49:32.811538 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83ebd9-4ff8-40e8-ab19-bb244d6cc04f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:49:32.823309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83ebd9-4ff8-40e8-ab19-bb244d6cc04f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:49:32.823309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83ebd9-4ff8-40e8-ab19-bb244d6cc04f service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:49:32.830492 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1145/2294] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:49:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:49:36.702935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75885d-e593-42ee-a5fc-096ff59da34e None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:49:36.703548 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75885d-e593-42ee-a5fc-096ff59da34e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:49:36.703548 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75885d-e593-42ee-a5fc-096ff59da34e None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:49:36.704914 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1150/2295] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 02:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:49:36.734924 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb817-0450-4201-a362-e402186092cb None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:49:36.735553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb817-0450-4201-a362-e402186092cb None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:49:36.735553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb817-0450-4201-a362-e402186092cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:49:36.757634 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b09eb817-0450-4201-a362-e402186092cb None None] MFA Rules not processed for user `629b38364f6a414aa14123c0749ba164`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:49:36.758862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b09eb817-0450-4201-a362-e402186092cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:49:36.769342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1146/2296] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 02:49:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:49:36.808495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75885d-e593-42ee-a5fc-096ff59da34e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:49:36.827300 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75885d-e593-42ee-a5fc-096ff59da34e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:49:36.831213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25dfc5-8f61-4431-831e-f56c98c41d12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629b38364f6a414aa14123c0749ba164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:49:36.832158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25dfc5-8f61-4431-831e-f56c98c41d12 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:49:36.832448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25dfc5-8f61-4431-831e-f56c98c41d12 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:49:36.832722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25dfc5-8f61-4431-831e-f56c98c41d12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:49:36.843288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25dfc5-8f61-4431-831e-f56c98c41d12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:49:36.845012 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25dfc5-8f61-4431-831e-f56c98c41d12 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:49:36.856610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1151/2297] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:49:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:49:40.099140 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eb817-0450-4201-a362-e402186092cb None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:49:40.100701 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b09eb817-0450-4201-a362-e402186092cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:49:40.174200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eb817-0450-4201-a362-e402186092cb None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:49:40.178933 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:49:40.179687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:49:40.180062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:49:40.180432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] PATH_INFO: `/v3/users/4a27e5b69e724f8f9148973a012a8ce5` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:49:40.181744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a27e5b69e724f8f9148973a012a8ce5)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:49:40.183813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:49:40.236704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a27e5b69e724f8f9148973a012a8ce5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.243636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a27e5b69e724f8f9148973a012a8ce5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.244264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a27e5b69e724f8f9148973a012a8ce5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.256245 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a27e5b69e724f8f9148973a012a8ce5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.256940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a27e5b69e724f8f9148973a012a8ce5'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.271045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1147/2298] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:49:40 2022] DELETE /identity/v3/users/4a27e5b69e724f8f9148973a012a8ce5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:49:40.448369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25dfc5-8f61-4431-831e-f56c98c41d12 service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:49:40.460034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25dfc5-8f61-4431-831e-f56c98c41d12 service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:49:40.567219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:49:40.567938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:49:40.568225 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:49:40.568554 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] PATH_INFO: `/v3/projects/1410afc537fc4d6bb47e6475a2d7d7d7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:49:40.570436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] RBAC: Authorizing `identity:delete_project(project_id=1410afc537fc4d6bb47e6475a2d7d7d7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:49:40.572840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:49:40.643664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1410afc537fc4d6bb47e6475a2d7d7d7', 'request_id': 'req-65aaf882-df93-46ae-b152-44a326ab98da'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.653031 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1410afc537fc4d6bb47e6475a2d7d7d7', 'request_id': 'req-65aaf882-df93-46ae-b152-44a326ab98da'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.660381 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1410afc537fc4d6bb47e6475a2d7d7d7', 'request_id': 'req-65aaf882-df93-46ae-b152-44a326ab98da'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.678165 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] The token cache is being invalidate because project 1410afc537fc4d6bb47e6475a2d7d7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:49:40.678742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.679618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.681363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1152/2299] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:49:40 2022] DELETE /identity/v3/projects/1410afc537fc4d6bb47e6475a2d7d7d7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:49:40.685759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:49:40.687566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:49:40.701886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687662b9-0304-482e-99bc-7f07c855734b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:49:40.752100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:49:40.763248 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3ef2d-0d4d-4a8b-b8dc-22c5f43a11b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:49:40.764273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3ef2d-0d4d-4a8b-b8dc-22c5f43a11b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:49:40.764853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3ef2d-0d4d-4a8b-b8dc-22c5f43a11b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:49:40.765413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3ef2d-0d4d-4a8b-b8dc-22c5f43a11b8 admin admin] PATH_INFO: `/v3/users/1338eb4a91464527b4431e83a76d296c` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:49:40.766858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3ef2d-0d4d-4a8b-b8dc-22c5f43a11b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1338eb4a91464527b4431e83a76d296c)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:49:40.768815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3ef2d-0d4d-4a8b-b8dc-22c5f43a11b8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:49:40.818963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-34a3ef2d-0d4d-4a8b-b8dc-22c5f43a11b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1338eb4a91464527b4431e83a76d296c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.826075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-34a3ef2d-0d4d-4a8b-b8dc-22c5f43a11b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1338eb4a91464527b4431e83a76d296c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.826651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-34a3ef2d-0d4d-4a8b-b8dc-22c5f43a11b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1338eb4a91464527b4431e83a76d296c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.840050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-34a3ef2d-0d4d-4a8b-b8dc-22c5f43a11b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1338eb4a91464527b4431e83a76d296c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.840744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-34a3ef2d-0d4d-4a8b-b8dc-22c5f43a11b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1338eb4a91464527b4431e83a76d296c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:40.856983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1148/2300] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:49:40 2022] DELETE /identity/v3/users/1338eb4a91464527b4431e83a76d296c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:49:41.088637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:49:41.091686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:49:41.114330 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaf882-df93-46ae-b152-44a326ab98da admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:49:41.179342 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b1163-52fd-48d7-a65c-451cd99d8dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:49:41.180002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b1163-52fd-48d7-a65c-451cd99d8dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:49:41.180286 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b1163-52fd-48d7-a65c-451cd99d8dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:49:41.180561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b1163-52fd-48d7-a65c-451cd99d8dc9 admin admin] PATH_INFO: `/v3/projects/ac343425abb84edbb92dc39df7ad7a1b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:49:41.181806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b1163-52fd-48d7-a65c-451cd99d8dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac343425abb84edbb92dc39df7ad7a1b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:49:41.183994 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b1163-52fd-48d7-a65c-451cd99d8dc9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:49:41.196281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:49:41.237511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-061b1163-52fd-48d7-a65c-451cd99d8dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac343425abb84edbb92dc39df7ad7a1b', 'request_id': 'req-061b1163-52fd-48d7-a65c-451cd99d8dc9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:41.246326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-061b1163-52fd-48d7-a65c-451cd99d8dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac343425abb84edbb92dc39df7ad7a1b', 'request_id': 'req-061b1163-52fd-48d7-a65c-451cd99d8dc9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:41.252461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-061b1163-52fd-48d7-a65c-451cd99d8dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac343425abb84edbb92dc39df7ad7a1b', 'request_id': 'req-061b1163-52fd-48d7-a65c-451cd99d8dc9'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:41.264417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-061b1163-52fd-48d7-a65c-451cd99d8dc9 admin admin] The token cache is being invalidate because project ac343425abb84edbb92dc39df7ad7a1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:49:41.264725 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-061b1163-52fd-48d7-a65c-451cd99d8dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:41.265687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-061b1163-52fd-48d7-a65c-451cd99d8dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:49:41.267944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1153/2301] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:49:41 2022] DELETE /identity/v3/projects/ac343425abb84edbb92dc39df7ad7a1b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:49:43.944343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95dee-a431-4c6c-94ac-b80b91ecd6ae None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:49:43.945260 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95dee-a431-4c6c-94ac-b80b91ecd6ae None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:49:43.945736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95dee-a431-4c6c-94ac-b80b91ecd6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:49:43.967938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-3ac95dee-a431-4c6c-94ac-b80b91ecd6ae None None] MFA Rules not processed for user `8de4ea727e9543f285c86e649d36c760`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:49:43.969165 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3ac95dee-a431-4c6c-94ac-b80b91ecd6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:49:44.027232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1149/2302] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:49:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:49:51.261352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:49:54.019781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:01.601721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc3007-6195-459d-b057-ed7de84e9447 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:01.602306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc3007-6195-459d-b057-ed7de84e9447 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:01.602306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc3007-6195-459d-b057-ed7de84e9447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:01.623827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c9bc3007-6195-459d-b057-ed7de84e9447 None None] MFA Rules not processed for user `69246ce0e0544e72a928af58b65930bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:01.625058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c9bc3007-6195-459d-b057-ed7de84e9447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:01.682598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1154/2303] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:11.675502 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=25 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:13.073115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95dee-a431-4c6c-94ac-b80b91ecd6ae None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:13.074785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3ac95dee-a431-4c6c-94ac-b80b91ecd6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:13.135325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95dee-a431-4c6c-94ac-b80b91ecd6ae None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:13.139068 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a3d7c-1792-4c5c-8580-6b50a75a570a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:13.139693 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a3d7c-1792-4c5c-8580-6b50a75a570a service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:13.139966 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a3d7c-1792-4c5c-8580-6b50a75a570a service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:13.140243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a3d7c-1792-4c5c-8580-6b50a75a570a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:13.142166 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4e8a3d7c-1792-4c5c-8580-6b50a75a570a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:13.213423 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a3d7c-1792-4c5c-8580-6b50a75a570a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:13.214922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a3d7c-1792-4c5c-8580-6b50a75a570a service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:13.225912 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1150/2304] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:50:15.209032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc3007-6195-459d-b057-ed7de84e9447 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:15.220041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc3007-6195-459d-b057-ed7de84e9447 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:15.224133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac63fa6-254b-4154-acf2-5b1e7cefe358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:15.225015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac63fa6-254b-4154-acf2-5b1e7cefe358 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:15.225351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac63fa6-254b-4154-acf2-5b1e7cefe358 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:15.225602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac63fa6-254b-4154-acf2-5b1e7cefe358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:15.227527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7ac63fa6-254b-4154-acf2-5b1e7cefe358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:15.242368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac63fa6-254b-4154-acf2-5b1e7cefe358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:15.243830 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac63fa6-254b-4154-acf2-5b1e7cefe358 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:15.260544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1155/2305] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:50:20.287148 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed568262-ec0e-411e-b944-56cd042eba7b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:20.288029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed568262-ec0e-411e-b944-56cd042eba7b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:20.288520 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed568262-ec0e-411e-b944-56cd042eba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:20.319926 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ed568262-ec0e-411e-b944-56cd042eba7b None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:20.322081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ed568262-ec0e-411e-b944-56cd042eba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:20.419189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1151/2306] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:50:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:20.428979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac63fa6-254b-4154-acf2-5b1e7cefe358 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:20.431710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7ac63fa6-254b-4154-acf2-5b1e7cefe358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:20.532657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac63fa6-254b-4154-acf2-5b1e7cefe358 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:20.540435 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe31734-42ab-4cca-8546-1efbb1bd6a20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:20.541086 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe31734-42ab-4cca-8546-1efbb1bd6a20 service swift] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:20.541434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe31734-42ab-4cca-8546-1efbb1bd6a20 service swift] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:20.541775 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe31734-42ab-4cca-8546-1efbb1bd6a20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:20.551006 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe31734-42ab-4cca-8546-1efbb1bd6a20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:20.553087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe31734-42ab-4cca-8546-1efbb1bd6a20 service swift] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:20.562883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1156/2307] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:50:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:50:30.404040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=79 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:30.558791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=38 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:31.094265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed568262-ec0e-411e-b944-56cd042eba7b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:31.095900 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ed568262-ec0e-411e-b944-56cd042eba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:31.113161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed568262-ec0e-411e-b944-56cd042eba7b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:31.120031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22e1bf-d670-4370-8a08-cc6f5fd132d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:31.120657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22e1bf-d670-4370-8a08-cc6f5fd132d2 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:31.120933 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22e1bf-d670-4370-8a08-cc6f5fd132d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:31.121214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22e1bf-d670-4370-8a08-cc6f5fd132d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:31.123227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ca22e1bf-d670-4370-8a08-cc6f5fd132d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:31.182873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22e1bf-d670-4370-8a08-cc6f5fd132d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:31.184499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22e1bf-d670-4370-8a08-cc6f5fd132d2 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:31.194386 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1152/2308] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:50:36.305231 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe31734-42ab-4cca-8546-1efbb1bd6a20 service swift] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:36.315721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe31734-42ab-4cca-8546-1efbb1bd6a20 service swift] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:36.320200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70108f-dfde-4ef7-bd42-a1282b77d30f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:36.320647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70108f-dfde-4ef7-bd42-a1282b77d30f service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:36.321124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70108f-dfde-4ef7-bd42-a1282b77d30f service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:36.321124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70108f-dfde-4ef7-bd42-a1282b77d30f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:36.323404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4b70108f-dfde-4ef7-bd42-a1282b77d30f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:36.396765 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70108f-dfde-4ef7-bd42-a1282b77d30f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:36.398219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70108f-dfde-4ef7-bd42-a1282b77d30f service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:36.411930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1157/2309] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:50:36.557842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22e1bf-d670-4370-8a08-cc6f5fd132d2 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:36.559402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ca22e1bf-d670-4370-8a08-cc6f5fd132d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:36.581755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22e1bf-d670-4370-8a08-cc6f5fd132d2 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:36.589600 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd55bc-7676-41fd-84a6-eb7750c488e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:36.590244 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd55bc-7676-41fd-84a6-eb7750c488e8 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:36.590525 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd55bc-7676-41fd-84a6-eb7750c488e8 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:36.590804 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd55bc-7676-41fd-84a6-eb7750c488e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:36.593078 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-10fd55bc-7676-41fd-84a6-eb7750c488e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:36.663606 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd55bc-7676-41fd-84a6-eb7750c488e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:36.665221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fd55bc-7676-41fd-84a6-eb7750c488e8 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:36.675682 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1153/2310] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:50:38.533727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70108f-dfde-4ef7-bd42-a1282b77d30f service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:38.535878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4b70108f-dfde-4ef7-bd42-a1282b77d30f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:38.638013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70108f-dfde-4ef7-bd42-a1282b77d30f service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:38.643208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926dd5f-ef29-44cc-8361-c64fed01f8cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629b38364f6a414aa14123c0749ba164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:38.643949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926dd5f-ef29-44cc-8361-c64fed01f8cb service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:38.644293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926dd5f-ef29-44cc-8361-c64fed01f8cb service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:38.644631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926dd5f-ef29-44cc-8361-c64fed01f8cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:38.646606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9926dd5f-ef29-44cc-8361-c64fed01f8cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:38.659136 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926dd5f-ef29-44cc-8361-c64fed01f8cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:38.660858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926dd5f-ef29-44cc-8361-c64fed01f8cb service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:38.672685 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1158/2311] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:50:38.921082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd55bc-7676-41fd-84a6-eb7750c488e8 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:38.935856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd55bc-7676-41fd-84a6-eb7750c488e8 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:38.957163 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67adf6-88ec-4e00-8052-2bbf26a34eea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:38.958812 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67adf6-88ec-4e00-8052-2bbf26a34eea service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:38.959273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67adf6-88ec-4e00-8052-2bbf26a34eea service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:38.959534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67adf6-88ec-4e00-8052-2bbf26a34eea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:38.962142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3d67adf6-88ec-4e00-8052-2bbf26a34eea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:38.980939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67adf6-88ec-4e00-8052-2bbf26a34eea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:38.982608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67adf6-88ec-4e00-8052-2bbf26a34eea service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:39.004366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1154/2312] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:50:40.226660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926dd5f-ef29-44cc-8361-c64fed01f8cb service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:40.228125 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9926dd5f-ef29-44cc-8361-c64fed01f8cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:40.244527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926dd5f-ef29-44cc-8361-c64fed01f8cb service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:40.249384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:40.250230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:40.250513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:40.250787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] PATH_INFO: `/v3/users/e5ad4dddff55436095a7d6a43317426f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:40.252068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ad4dddff55436095a7d6a43317426f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:40.254065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:40.307807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ad4dddff55436095a7d6a43317426f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:40.315448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ad4dddff55436095a7d6a43317426f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:40.324517 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ad4dddff55436095a7d6a43317426f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:40.325182 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ad4dddff55436095a7d6a43317426f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:40.337697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:40.339008 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ad4dddff55436095a7d6a43317426f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:40.346305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1159/2313] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:50:40 2022] DELETE /identity/v3/users/e5ad4dddff55436095a7d6a43317426f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:40.511683 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08208a-80be-4ead-b560-1d29c69ef144 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:40.512220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08208a-80be-4ead-b560-1d29c69ef144 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:40.512220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08208a-80be-4ead-b560-1d29c69ef144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:40.534507 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-0d08208a-80be-4ead-b560-1d29c69ef144 None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:40.536040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0d08208a-80be-4ead-b560-1d29c69ef144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:40.547115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:40.548997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:40.621451 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1155/2314] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:50:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:40.635872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a54d80-0360-4529-b60c-b037c5ffe223 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:40.642086 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:40.643108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:40.643476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:40.643838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3 admin admin] PATH_INFO: `/v3/projects/cd58f56a1c614317ab83f279e354896b` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:40.645475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd58f56a1c614317ab83f279e354896b)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:40.646204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08208a-80be-4ead-b560-1d29c69ef144 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:40.647596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0d08208a-80be-4ead-b560-1d29c69ef144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:40.647713 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:40.682920 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:40.703507 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd58f56a1c614317ab83f279e354896b', 'request_id': 'req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:40.713187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd58f56a1c614317ab83f279e354896b', 'request_id': 'req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:40.720389 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd58f56a1c614317ab83f279e354896b', 'request_id': 'req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:40.731866 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08208a-80be-4ead-b560-1d29c69ef144 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:40.733687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3 admin admin] The token cache is being invalidate because project cd58f56a1c614317ab83f279e354896b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:50:40.733978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:40.734764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-7cccff31-32a9-4b1e-8626-9b9509b0cfc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:40.736498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1160/2315] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:50:40 2022] DELETE /identity/v3/projects/cd58f56a1c614317ab83f279e354896b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:40.741262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf52192-1531-4895-aeaf-f72348af2290 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:40.741575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf52192-1531-4895-aeaf-f72348af2290 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:40.741864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf52192-1531-4895-aeaf-f72348af2290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:40.770406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3bf52192-1531-4895-aeaf-f72348af2290 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:40.771884 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3bf52192-1531-4895-aeaf-f72348af2290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:40.824996 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b443a-0fc7-437c-98a1-ab6e27a19f2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:40.826523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b443a-0fc7-437c-98a1-ab6e27a19f2a service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:40.826816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b443a-0fc7-437c-98a1-ab6e27a19f2a service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:40.827091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b443a-0fc7-437c-98a1-ab6e27a19f2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:40.829563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cd9b443a-0fc7-437c-98a1-ab6e27a19f2a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:40.853625 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1161/2316] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:50:40.861575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e68fa-9ddc-4d78-818c-65e6cb9441a2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:40.861812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e68fa-9ddc-4d78-818c-65e6cb9441a2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:40.862104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e68fa-9ddc-4d78-818c-65e6cb9441a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:40.887075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a93e68fa-9ddc-4d78-818c-65e6cb9441a2 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:40.889654 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a93e68fa-9ddc-4d78-818c-65e6cb9441a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:40.905398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1162/2317] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:50:40.908963 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e68fa-9ddc-4d78-818c-65e6cb9441a2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:40.917509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b443a-0fc7-437c-98a1-ab6e27a19f2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:40.919708 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b443a-0fc7-437c-98a1-ab6e27a19f2a service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:40.927511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e68fa-9ddc-4d78-818c-65e6cb9441a2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:40.932934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d12fd-a544-420c-a2e1-584e79851375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:40.933607 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d12fd-a544-420c-a2e1-584e79851375 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:40.934285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d12fd-a544-420c-a2e1-584e79851375 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:40.934285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d12fd-a544-420c-a2e1-584e79851375 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:40.936277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d12fd-a544-420c-a2e1-584e79851375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:50:40.936635 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d12fd-a544-420c-a2e1-584e79851375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:40.938513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d12fd-a544-420c-a2e1-584e79851375 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:40.940043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1156/2318] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:50:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:50:40.955017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1163/2319] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:50:40.959698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b443a-0fc7-437c-98a1-ab6e27a19f2a service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:40.978483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b443a-0fc7-437c-98a1-ab6e27a19f2a service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:40.984051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f13770-5bda-45f7-b578-4febd4c7a53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:40.984821 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f13770-5bda-45f7-b578-4febd4c7a53f admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:40.985064 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f13770-5bda-45f7-b578-4febd4c7a53f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:40.985367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f13770-5bda-45f7-b578-4febd4c7a53f admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:40.986130 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f13770-5bda-45f7-b578-4febd4c7a53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:40.989023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f13770-5bda-45f7-b578-4febd4c7a53f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:41.045912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d12fd-a544-420c-a2e1-584e79851375 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:41.046834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1157/2320] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:50:40 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:50:41.061255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d12fd-a544-420c-a2e1-584e79851375 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:41.069863 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:41.196038 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88881778-7e25-430a-be8b-db346f9593c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:41.196920 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88881778-7e25-430a-be8b-db346f9593c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:41.197584 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88881778-7e25-430a-be8b-db346f9593c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:41.198041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88881778-7e25-430a-be8b-db346f9593c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:41.198908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88881778-7e25-430a-be8b-db346f9593c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:41.201274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88881778-7e25-430a-be8b-db346f9593c9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:41.229020 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1164/2321] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:50:41 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:50:41.233355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f13770-5bda-45f7-b578-4febd4c7a53f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:41.247214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f13770-5bda-45f7-b578-4febd4c7a53f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:41.253933 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4112c-e1a0-4820-a30f-4265b95436b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:41.254872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4112c-e1a0-4820-a30f-4265b95436b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:41.255348 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4112c-e1a0-4820-a30f-4265b95436b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:41.255834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4112c-e1a0-4820-a30f-4265b95436b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:41.257069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4112c-e1a0-4820-a30f-4265b95436b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:41.259204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4112c-e1a0-4820-a30f-4265b95436b7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:41.275762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1158/2322] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:50:41.280017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88881778-7e25-430a-be8b-db346f9593c9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:41.293626 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88881778-7e25-430a-be8b-db346f9593c9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:41.299056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c20fc-f900-4079-a723-750b116ac0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:41.299701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c20fc-f900-4079-a723-750b116ac0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:41.299982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c20fc-f900-4079-a723-750b116ac0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:41.300257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c20fc-f900-4079-a723-750b116ac0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:41.300967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c20fc-f900-4079-a723-750b116ac0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:41.302950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c20fc-f900-4079-a723-750b116ac0d6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:41.318479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1165/2323] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:50:41.319671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4112c-e1a0-4820-a30f-4265b95436b7 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:41.331520 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4112c-e1a0-4820-a30f-4265b95436b7 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:41.337226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc1c10-7be4-4bad-99da-bf3a0b88c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:41.338179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc1c10-7be4-4bad-99da-bf3a0b88c5db admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:41.338458 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc1c10-7be4-4bad-99da-bf3a0b88c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:41.338735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc1c10-7be4-4bad-99da-bf3a0b88c5db admin admin] PATH_INFO: `/v3/projects/2280c1a4484e42b1a0d567a0fd310e5b/users/e9de1420719b419aaf58fde85770132a/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:41.365379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc1c10-7be4-4bad-99da-bf3a0b88c5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=2280c1a4484e42b1a0d567a0fd310e5b, user_id=e9de1420719b419aaf58fde85770132a, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:41.368248 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc1c10-7be4-4bad-99da-bf3a0b88c5db admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:41.390103 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1159/2324] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:50:41 2022] PUT /identity/v3/projects/2280c1a4484e42b1a0d567a0fd310e5b/users/e9de1420719b419aaf58fde85770132a/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:41.400822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c9a33-671a-472c-b74f-f21aa55e20c6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:41.401106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c9a33-671a-472c-b74f-f21aa55e20c6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:41.401412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c9a33-671a-472c-b74f-f21aa55e20c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:41.445630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9b9c9a33-671a-472c-b74f-f21aa55e20c6 None None] MFA Rules not processed for user `e9de1420719b419aaf58fde85770132a`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:41.446882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9b9c9a33-671a-472c-b74f-f21aa55e20c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:41.525055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1166/2325] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:41.529576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc1c10-7be4-4bad-99da-bf3a0b88c5db admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:41.549475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:41.599318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc1c10-7be4-4bad-99da-bf3a0b88c5db admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:41.604132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0918cb-aa7a-4647-a02d-61d3245e28fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:41.604788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0918cb-aa7a-4647-a02d-61d3245e28fe admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:41.605048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0918cb-aa7a-4647-a02d-61d3245e28fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:41.605338 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0918cb-aa7a-4647-a02d-61d3245e28fe admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:41.606021 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0918cb-aa7a-4647-a02d-61d3245e28fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:41.609333 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0918cb-aa7a-4647-a02d-61d3245e28fe admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:41.650374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1160/2326] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:50:41 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:50:41.654518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c9a33-671a-472c-b74f-f21aa55e20c6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:41.672500 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c9a33-671a-472c-b74f-f21aa55e20c6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:41.749778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed384b2f-8207-44f7-85cc-82654da88686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:41.750786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed384b2f-8207-44f7-85cc-82654da88686 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:41.751299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed384b2f-8207-44f7-85cc-82654da88686 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:41.752032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed384b2f-8207-44f7-85cc-82654da88686 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:41.752960 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed384b2f-8207-44f7-85cc-82654da88686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:41.755770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed384b2f-8207-44f7-85cc-82654da88686 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:41.784106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1167/2327] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:50:41 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:50:41.789041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0918cb-aa7a-4647-a02d-61d3245e28fe admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:41.800689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0918cb-aa7a-4647-a02d-61d3245e28fe admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:41.805931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a8c1f-aab7-4521-8600-cdce9f60658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:41.806718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a8c1f-aab7-4521-8600-cdce9f60658c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:41.807070 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a8c1f-aab7-4521-8600-cdce9f60658c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:41.807567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a8c1f-aab7-4521-8600-cdce9f60658c admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:41.818161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a8c1f-aab7-4521-8600-cdce9f60658c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:41.821410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a8c1f-aab7-4521-8600-cdce9f60658c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:41.834473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1161/2328] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:50:41.841311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed384b2f-8207-44f7-85cc-82654da88686 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:41.846078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:41.852469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed384b2f-8207-44f7-85cc-82654da88686 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:41.867312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff613de6-4dbf-4c03-8f92-5c3aaf4d68e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:41.871300 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff613de6-4dbf-4c03-8f92-5c3aaf4d68e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:41.872681 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff613de6-4dbf-4c03-8f92-5c3aaf4d68e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:41.874179 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff613de6-4dbf-4c03-8f92-5c3aaf4d68e5 admin admin] PATH_INFO: `/v3/projects/cd8624452e6b4c119fee27030c4b08b4/users/17fb0dd6cd2549fd830ca20c0ad22703/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:41.894585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff613de6-4dbf-4c03-8f92-5c3aaf4d68e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8624452e6b4c119fee27030c4b08b4, user_id=17fb0dd6cd2549fd830ca20c0ad22703, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:41.903863 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff613de6-4dbf-4c03-8f92-5c3aaf4d68e5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:41.929256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1168/2329] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:50:41 2022] PUT /identity/v3/projects/cd8624452e6b4c119fee27030c4b08b4/users/17fb0dd6cd2549fd830ca20c0ad22703/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:50:41.933944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a8c1f-aab7-4521-8600-cdce9f60658c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:41.949013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a8c1f-aab7-4521-8600-cdce9f60658c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:42.040793 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db951e36-f354-45ed-b461-7ac9df6a27cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:42.041939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db951e36-f354-45ed-b461-7ac9df6a27cf admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:42.042454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db951e36-f354-45ed-b461-7ac9df6a27cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:42.042939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db951e36-f354-45ed-b461-7ac9df6a27cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:42.043854 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db951e36-f354-45ed-b461-7ac9df6a27cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:42.045806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db951e36-f354-45ed-b461-7ac9df6a27cf admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:42.057103 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1162/2330] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:50:42.061615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff613de6-4dbf-4c03-8f92-5c3aaf4d68e5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:42.077908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff613de6-4dbf-4c03-8f92-5c3aaf4d68e5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:42.084673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78238289-5e7e-42c7-bc27-b2a8a022095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:42.085524 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78238289-5e7e-42c7-bc27-b2a8a022095d admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:42.085820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78238289-5e7e-42c7-bc27-b2a8a022095d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:42.086081 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78238289-5e7e-42c7-bc27-b2a8a022095d admin admin] PATH_INFO: `/v3/projects/cd8624452e6b4c119fee27030c4b08b4/users/17fb0dd6cd2549fd830ca20c0ad22703/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:42.092417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78238289-5e7e-42c7-bc27-b2a8a022095d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8624452e6b4c119fee27030c4b08b4, user_id=17fb0dd6cd2549fd830ca20c0ad22703, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:42.095169 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78238289-5e7e-42c7-bc27-b2a8a022095d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:42.117851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1169/2331] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:50:42 2022] PUT /identity/v3/projects/cd8624452e6b4c119fee27030c4b08b4/users/17fb0dd6cd2549fd830ca20c0ad22703/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:50:42.119564 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702fedd-48fe-43ae-8430-3844e61fd335 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:42.119851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702fedd-48fe-43ae-8430-3844e61fd335 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:42.120134 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702fedd-48fe-43ae-8430-3844e61fd335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:42.152507 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f702fedd-48fe-43ae-8430-3844e61fd335 None None] MFA Rules not processed for user `17fb0dd6cd2549fd830ca20c0ad22703`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:42.154660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f702fedd-48fe-43ae-8430-3844e61fd335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:42.251585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1163/2332] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:42.266191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78238289-5e7e-42c7-bc27-b2a8a022095d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:42.268571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-78238289-5e7e-42c7-bc27-b2a8a022095d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:42.336685 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78238289-5e7e-42c7-bc27-b2a8a022095d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:42.340398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330749a-7ebc-4e1c-94ff-ab98ac7adba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:42.341051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330749a-7ebc-4e1c-94ff-ab98ac7adba2 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:42.341367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330749a-7ebc-4e1c-94ff-ab98ac7adba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:42.341641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330749a-7ebc-4e1c-94ff-ab98ac7adba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:42.351563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330749a-7ebc-4e1c-94ff-ab98ac7adba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:42.353030 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330749a-7ebc-4e1c-94ff-ab98ac7adba2 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:42.363819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1170/2333] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:50:42.460469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702fedd-48fe-43ae-8430-3844e61fd335 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:42.479710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702fedd-48fe-43ae-8430-3844e61fd335 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:42.487193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784e832-7057-40a1-abb3-b092e043508f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:42.488230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784e832-7057-40a1-abb3-b092e043508f service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:42.488718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784e832-7057-40a1-abb3-b092e043508f service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:42.489190 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784e832-7057-40a1-abb3-b092e043508f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:42.504221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:42.604527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784e832-7057-40a1-abb3-b092e043508f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:42.607675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784e832-7057-40a1-abb3-b092e043508f service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:42.636801 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1164/2334] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:50:49.718516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330749a-7ebc-4e1c-94ff-ab98ac7adba2 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:49.783254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330749a-7ebc-4e1c-94ff-ab98ac7adba2 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:49.787640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:49.788272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:49.788547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:49.788810 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] PATH_INFO: `/v3/users/e9de1420719b419aaf58fde85770132a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:49.789973 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9de1420719b419aaf58fde85770132a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:49.792220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:49.839144 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9de1420719b419aaf58fde85770132a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:49.845984 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9de1420719b419aaf58fde85770132a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:49.854436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9de1420719b419aaf58fde85770132a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:49.855201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9de1420719b419aaf58fde85770132a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:49.862761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:49.868951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9de1420719b419aaf58fde85770132a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:49.875549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1171/2335] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:50:49 2022] DELETE /identity/v3/users/e9de1420719b419aaf58fde85770132a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:49.880197 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3075e3-aa5b-4c9a-971f-12bff51b98e8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:49.880690 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3075e3-aa5b-4c9a-971f-12bff51b98e8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:49.880799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3075e3-aa5b-4c9a-971f-12bff51b98e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:49.900248 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9b3075e3-aa5b-4c9a-971f-12bff51b98e8 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:49.901484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9b3075e3-aa5b-4c9a-971f-12bff51b98e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:49.961896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1165/2336] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:49.972002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:49.973432 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:50.030845 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7f640-e6f4-4c61-acaa-7d29ecb491ed admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:50.034876 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c67a90-a4bd-4bfc-931a-f98f8c389d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:50.035570 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c67a90-a4bd-4bfc-931a-f98f8c389d54 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:50.035852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c67a90-a4bd-4bfc-931a-f98f8c389d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:50.036099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c67a90-a4bd-4bfc-931a-f98f8c389d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:50.045689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c67a90-a4bd-4bfc-931a-f98f8c389d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:50.047180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c67a90-a4bd-4bfc-931a-f98f8c389d54 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:50.057085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1172/2337] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:50:50.339540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3075e3-aa5b-4c9a-971f-12bff51b98e8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:50.341232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9b3075e3-aa5b-4c9a-971f-12bff51b98e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:50.356836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3075e3-aa5b-4c9a-971f-12bff51b98e8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:50.362333 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:50.363020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:50.363275 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:50.363552 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] PATH_INFO: `/v3/projects/2280c1a4484e42b1a0d567a0fd310e5b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:50.364938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2280c1a4484e42b1a0d567a0fd310e5b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:50.366891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:50.417863 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2280c1a4484e42b1a0d567a0fd310e5b', 'request_id': 'req-941ae846-8504-4f02-942c-fe78ebb2d959'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:50.424228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2280c1a4484e42b1a0d567a0fd310e5b', 'request_id': 'req-941ae846-8504-4f02-942c-fe78ebb2d959'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:50.431383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2280c1a4484e42b1a0d567a0fd310e5b', 'request_id': 'req-941ae846-8504-4f02-942c-fe78ebb2d959'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:50.445759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] The token cache is being invalidate because project 2280c1a4484e42b1a0d567a0fd310e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:50:50.446049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:50.446774 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:50.448606 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1166/2338] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:50:50 2022] DELETE /identity/v3/projects/2280c1a4484e42b1a0d567a0fd310e5b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:50.452943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c67a90-a4bd-4bfc-931a-f98f8c389d54 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:50.463068 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c67a90-a4bd-4bfc-931a-f98f8c389d54 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:50.524427 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e7192-1766-486c-99e9-002ba1f5df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:50.525195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e7192-1766-486c-99e9-002ba1f5df0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:50.525592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e7192-1766-486c-99e9-002ba1f5df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:50.525932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e7192-1766-486c-99e9-002ba1f5df0b admin admin] PATH_INFO: `/v3/users/17fb0dd6cd2549fd830ca20c0ad22703` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:50.527206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e7192-1766-486c-99e9-002ba1f5df0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17fb0dd6cd2549fd830ca20c0ad22703)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:50.529138 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e7192-1766-486c-99e9-002ba1f5df0b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:50.580734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9d6e7192-1766-486c-99e9-002ba1f5df0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fb0dd6cd2549fd830ca20c0ad22703'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:50.588754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9d6e7192-1766-486c-99e9-002ba1f5df0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fb0dd6cd2549fd830ca20c0ad22703'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:50.598514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9d6e7192-1766-486c-99e9-002ba1f5df0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fb0dd6cd2549fd830ca20c0ad22703'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:50.599152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9d6e7192-1766-486c-99e9-002ba1f5df0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fb0dd6cd2549fd830ca20c0ad22703'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:50.616232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9d6e7192-1766-486c-99e9-002ba1f5df0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fb0dd6cd2549fd830ca20c0ad22703'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:50.622486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1173/2339] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:50:50 2022] DELETE /identity/v3/users/17fb0dd6cd2549fd830ca20c0ad22703 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:50.890580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:50.892206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:50.905974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ae846-8504-4f02-942c-fe78ebb2d959 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:50.947943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:50.977697 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07cd2e-9240-4630-bf73-89e0837c83d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:50.978518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07cd2e-9240-4630-bf73-89e0837c83d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:50.978803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07cd2e-9240-4630-bf73-89e0837c83d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:50.979079 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07cd2e-9240-4630-bf73-89e0837c83d3 admin admin] PATH_INFO: `/v3/projects/cd8624452e6b4c119fee27030c4b08b4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:50.980287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07cd2e-9240-4630-bf73-89e0837c83d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8624452e6b4c119fee27030c4b08b4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:50.982258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07cd2e-9240-4630-bf73-89e0837c83d3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:51.028137 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cd07cd2e-9240-4630-bf73-89e0837c83d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8624452e6b4c119fee27030c4b08b4', 'request_id': 'req-cd07cd2e-9240-4630-bf73-89e0837c83d3'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:51.034665 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cd07cd2e-9240-4630-bf73-89e0837c83d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8624452e6b4c119fee27030c4b08b4', 'request_id': 'req-cd07cd2e-9240-4630-bf73-89e0837c83d3'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:51.042831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cd07cd2e-9240-4630-bf73-89e0837c83d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8624452e6b4c119fee27030c4b08b4', 'request_id': 'req-cd07cd2e-9240-4630-bf73-89e0837c83d3'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:51.053024 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cd07cd2e-9240-4630-bf73-89e0837c83d3 admin admin] The token cache is being invalidate because project cd8624452e6b4c119fee27030c4b08b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:50:51.053341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cd07cd2e-9240-4630-bf73-89e0837c83d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:51.053954 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cd07cd2e-9240-4630-bf73-89e0837c83d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:51.055475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1167/2340] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:50:50 2022] DELETE /identity/v3/projects/cd8624452e6b4c119fee27030c4b08b4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:51.060683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d602fa-9566-4067-b45b-14043ce69839 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:51.061171 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d602fa-9566-4067-b45b-14043ce69839 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:51.061316 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d602fa-9566-4067-b45b-14043ce69839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:51.082278 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f3d602fa-9566-4067-b45b-14043ce69839 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:51.083871 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f3d602fa-9566-4067-b45b-14043ce69839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:51.090787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:51.157432 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1174/2341] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:51.159366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15356024-ac68-47c1-bdac-e860c0a992a6 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:51.159542 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15356024-ac68-47c1-bdac-e860c0a992a6 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:51.159812 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15356024-ac68-47c1-bdac-e860c0a992a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:51.185339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-15356024-ac68-47c1-bdac-e860c0a992a6 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:51.186725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-15356024-ac68-47c1-bdac-e860c0a992a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:51.195297 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1168/2342] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:51.200327 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d602fa-9566-4067-b45b-14043ce69839 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:51.211280 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d602fa-9566-4067-b45b-14043ce69839 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:51.216266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b4ad9-c6d2-490b-a776-634249fac8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:51.216957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b4ad9-c6d2-490b-a776-634249fac8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:51.217234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b4ad9-c6d2-490b-a776-634249fac8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:51.217547 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b4ad9-c6d2-490b-a776-634249fac8d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:51.218306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b4ad9-c6d2-490b-a776-634249fac8d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:50:51.218598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b4ad9-c6d2-490b-a776-634249fac8d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:51.220321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b4ad9-c6d2-490b-a776-634249fac8d2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:51.233315 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1175/2343] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:50:51.237582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15356024-ac68-47c1-bdac-e860c0a992a6 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:51.247306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15356024-ac68-47c1-bdac-e860c0a992a6 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:51.252251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2a204-23d0-451c-9239-90a62b90de8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:51.252875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2a204-23d0-451c-9239-90a62b90de8c admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:51.253157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2a204-23d0-451c-9239-90a62b90de8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:51.253475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2a204-23d0-451c-9239-90a62b90de8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:51.254161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2a204-23d0-451c-9239-90a62b90de8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:51.256075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2a204-23d0-451c-9239-90a62b90de8c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:51.283740 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1169/2344] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:50:51 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:50:51.288025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b4ad9-c6d2-490b-a776-634249fac8d2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:51.298624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b4ad9-c6d2-490b-a776-634249fac8d2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:51.359652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a3746-7683-4866-a2c1-9342c6a9fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:51.360270 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a3746-7683-4866-a2c1-9342c6a9fec9 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:51.360545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a3746-7683-4866-a2c1-9342c6a9fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:51.360812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a3746-7683-4866-a2c1-9342c6a9fec9 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:51.361483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a3746-7683-4866-a2c1-9342c6a9fec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:51.363421 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a3746-7683-4866-a2c1-9342c6a9fec9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:51.385399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1176/2345] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:50:51 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:50:51.389610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2a204-23d0-451c-9239-90a62b90de8c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:51.400141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2a204-23d0-451c-9239-90a62b90de8c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:51.405327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c6c37-6171-4fdd-9979-7497d4d722b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:51.405936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c6c37-6171-4fdd-9979-7497d4d722b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:51.406216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c6c37-6171-4fdd-9979-7497d4d722b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:51.406488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c6c37-6171-4fdd-9979-7497d4d722b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:51.407188 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c6c37-6171-4fdd-9979-7497d4d722b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:51.408873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c6c37-6171-4fdd-9979-7497d4d722b2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:51.419704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1170/2346] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:50:51.424182 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a3746-7683-4866-a2c1-9342c6a9fec9 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:51.435098 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a3746-7683-4866-a2c1-9342c6a9fec9 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:51.441106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dba73f-606c-477a-9d6a-5384185cd43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:51.441773 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dba73f-606c-477a-9d6a-5384185cd43f admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:51.442054 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dba73f-606c-477a-9d6a-5384185cd43f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:51.442321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dba73f-606c-477a-9d6a-5384185cd43f admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:51.443013 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dba73f-606c-477a-9d6a-5384185cd43f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:51.445172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dba73f-606c-477a-9d6a-5384185cd43f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:51.457871 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1177/2347] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:50:51.462350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c6c37-6171-4fdd-9979-7497d4d722b2 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:51.473743 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c6c37-6171-4fdd-9979-7497d4d722b2 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:51.479539 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b879d63-b6ec-479d-9107-2f126ad829fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:51.480285 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b879d63-b6ec-479d-9107-2f126ad829fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:51.480631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b879d63-b6ec-479d-9107-2f126ad829fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:51.480959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b879d63-b6ec-479d-9107-2f126ad829fb admin admin] PATH_INFO: `/v3/projects/536309ed4c9f4ab3aa3c0794ab1a07e7/users/55d79d623dc84c538cd39f361d61e583/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:51.496402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b879d63-b6ec-479d-9107-2f126ad829fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=536309ed4c9f4ab3aa3c0794ab1a07e7, user_id=55d79d623dc84c538cd39f361d61e583, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:51.499176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b879d63-b6ec-479d-9107-2f126ad829fb admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:51.513392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1171/2348] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:50:51 2022] PUT /identity/v3/projects/536309ed4c9f4ab3aa3c0794ab1a07e7/users/55d79d623dc84c538cd39f361d61e583/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:51.525457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db6d31-4a4d-4591-9f4c-a755eca0e559 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:51.525744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db6d31-4a4d-4591-9f4c-a755eca0e559 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:51.526025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db6d31-4a4d-4591-9f4c-a755eca0e559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:51.556088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c3db6d31-4a4d-4591-9f4c-a755eca0e559 None None] MFA Rules not processed for user `55d79d623dc84c538cd39f361d61e583`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:51.557506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c3db6d31-4a4d-4591-9f4c-a755eca0e559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:51.633012 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1178/2349] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:51.637884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b879d63-b6ec-479d-9107-2f126ad829fb admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:51.719185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b879d63-b6ec-479d-9107-2f126ad829fb admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:51.724401 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aac64-2d99-4c37-948f-9a07d7fdc0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:51.725081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aac64-2d99-4c37-948f-9a07d7fdc0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:51.725397 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aac64-2d99-4c37-948f-9a07d7fdc0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:51.725667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aac64-2d99-4c37-948f-9a07d7fdc0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:51.726527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479aac64-2d99-4c37-948f-9a07d7fdc0f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:51.728491 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479aac64-2d99-4c37-948f-9a07d7fdc0f9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:51.733357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:51.766861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1172/2350] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:50:51 2022] POST /identity/v3/projects => generated 363 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:50:51.768400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db6d31-4a4d-4591-9f4c-a755eca0e559 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:51.780337 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db6d31-4a4d-4591-9f4c-a755eca0e559 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:51.784641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:51.843167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2a46d-da41-477d-b017-8d2c751ea9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:51.843798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a46d-da41-477d-b017-8d2c751ea9ad admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:51.844072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a46d-da41-477d-b017-8d2c751ea9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:51.844504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a46d-da41-477d-b017-8d2c751ea9ad admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:51.845319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2a46d-da41-477d-b017-8d2c751ea9ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:51.847626 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2a46d-da41-477d-b017-8d2c751ea9ad admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:51.874076 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1179/2351] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:50:51 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:50:51.875454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aac64-2d99-4c37-948f-9a07d7fdc0f9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:51.887435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aac64-2d99-4c37-948f-9a07d7fdc0f9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:51.892954 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02ede6-037d-4120-b262-7d916294c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:51.893645 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02ede6-037d-4120-b262-7d916294c0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:51.893942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02ede6-037d-4120-b262-7d916294c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:51.894203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02ede6-037d-4120-b262-7d916294c0d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:51.894996 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02ede6-037d-4120-b262-7d916294c0d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:51.896589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02ede6-037d-4120-b262-7d916294c0d1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:51.908723 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1173/2352] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:50:51.913655 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2a46d-da41-477d-b017-8d2c751ea9ad admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:51.925237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2a46d-da41-477d-b017-8d2c751ea9ad admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:51.933035 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e3ddf-7069-44f9-95fa-ddc9b2834a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:51.933838 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e3ddf-7069-44f9-95fa-ddc9b2834a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:51.934186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e3ddf-7069-44f9-95fa-ddc9b2834a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:51.934531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e3ddf-7069-44f9-95fa-ddc9b2834a4c admin admin] PATH_INFO: `/v3/projects/ee68a3249ec449908bfb6605c77bfb9b/users/bc1175173217473aa9892384c8ed16e7/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:51.952119 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e3ddf-7069-44f9-95fa-ddc9b2834a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee68a3249ec449908bfb6605c77bfb9b, user_id=bc1175173217473aa9892384c8ed16e7, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:51.955148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e3ddf-7069-44f9-95fa-ddc9b2834a4c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:51.972440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1180/2353] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:50:51 2022] PUT /identity/v3/projects/ee68a3249ec449908bfb6605c77bfb9b/users/bc1175173217473aa9892384c8ed16e7/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:50:51.976381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02ede6-037d-4120-b262-7d916294c0d1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:51.990013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02ede6-037d-4120-b262-7d916294c0d1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:52.052639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9e74d-65e8-49de-9dff-a863f24d6904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:52.053254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e74d-65e8-49de-9dff-a863f24d6904 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:52.053563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e74d-65e8-49de-9dff-a863f24d6904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:52.053829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9e74d-65e8-49de-9dff-a863f24d6904 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:52.054515 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9e74d-65e8-49de-9dff-a863f24d6904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:52.056159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9e74d-65e8-49de-9dff-a863f24d6904 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:52.066643 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1174/2354] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:50:52.071357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e3ddf-7069-44f9-95fa-ddc9b2834a4c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:52.082363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e3ddf-7069-44f9-95fa-ddc9b2834a4c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:52.088189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60517740-3a34-4342-9ea5-7c981e63e2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:52.088868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60517740-3a34-4342-9ea5-7c981e63e2da admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:52.089149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60517740-3a34-4342-9ea5-7c981e63e2da admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:52.089456 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60517740-3a34-4342-9ea5-7c981e63e2da admin admin] PATH_INFO: `/v3/projects/ee68a3249ec449908bfb6605c77bfb9b/users/bc1175173217473aa9892384c8ed16e7/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:52.091637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60517740-3a34-4342-9ea5-7c981e63e2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee68a3249ec449908bfb6605c77bfb9b, user_id=bc1175173217473aa9892384c8ed16e7, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:52.094359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60517740-3a34-4342-9ea5-7c981e63e2da admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:52.105674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1181/2355] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:50:52 2022] PUT /identity/v3/projects/ee68a3249ec449908bfb6605c77bfb9b/users/bc1175173217473aa9892384c8ed16e7/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:52.116099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad83f0-5e31-4f46-a043-8783c82ea21c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:52.116388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad83f0-5e31-4f46-a043-8783c82ea21c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:52.116668 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad83f0-5e31-4f46-a043-8783c82ea21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:52.145119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-69ad83f0-5e31-4f46-a043-8783c82ea21c None None] MFA Rules not processed for user `bc1175173217473aa9892384c8ed16e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:52.146374 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-69ad83f0-5e31-4f46-a043-8783c82ea21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:52.216200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1175/2356] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:52 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:52.228210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60517740-3a34-4342-9ea5-7c981e63e2da admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:52.230030 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-60517740-3a34-4342-9ea5-7c981e63e2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:52.291363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60517740-3a34-4342-9ea5-7c981e63e2da admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:52.295898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2087681-cc0c-4a20-aeaf-e3f1d3b5036a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:52.296530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2087681-cc0c-4a20-aeaf-e3f1d3b5036a service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:52.296813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2087681-cc0c-4a20-aeaf-e3f1d3b5036a service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:52.297101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2087681-cc0c-4a20-aeaf-e3f1d3b5036a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:52.308103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2087681-cc0c-4a20-aeaf-e3f1d3b5036a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:52.309597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2087681-cc0c-4a20-aeaf-e3f1d3b5036a service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:52.320490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1182/2357] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:52 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:50:52.398902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad83f0-5e31-4f46-a043-8783c82ea21c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:52.409008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad83f0-5e31-4f46-a043-8783c82ea21c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:52.413021 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0027a4-d745-469c-8836-92290aa6f772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:52.413672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0027a4-d745-469c-8836-92290aa6f772 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:52.413958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0027a4-d745-469c-8836-92290aa6f772 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:52.414227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0027a4-d745-469c-8836-92290aa6f772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:52.467700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:52.471756 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0027a4-d745-469c-8836-92290aa6f772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:52.473266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0027a4-d745-469c-8836-92290aa6f772 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:52.484933 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1176/2358] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:50:54.703477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2087681-cc0c-4a20-aeaf-e3f1d3b5036a service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:54.705071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d2087681-cc0c-4a20-aeaf-e3f1d3b5036a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:54.765263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2087681-cc0c-4a20-aeaf-e3f1d3b5036a service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:54.769213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874ab86-b8b1-4b9c-8e0e-683cbbdf60ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:54.769855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874ab86-b8b1-4b9c-8e0e-683cbbdf60ff service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:54.770137 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874ab86-b8b1-4b9c-8e0e-683cbbdf60ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:54.770407 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874ab86-b8b1-4b9c-8e0e-683cbbdf60ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:54.772332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7874ab86-b8b1-4b9c-8e0e-683cbbdf60ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:54.782227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874ab86-b8b1-4b9c-8e0e-683cbbdf60ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:54.783669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874ab86-b8b1-4b9c-8e0e-683cbbdf60ff service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:54.791720 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1183/2359] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:50:55.295578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0027a4-d745-469c-8836-92290aa6f772 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:55.359016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0027a4-d745-469c-8836-92290aa6f772 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:55.363742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:55.364396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:55.364670 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:55.364944 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] PATH_INFO: `/v3/users/55d79d623dc84c538cd39f361d61e583` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:55.366175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d79d623dc84c538cd39f361d61e583)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:55.368105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:55.414878 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d79d623dc84c538cd39f361d61e583'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:55.421660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d79d623dc84c538cd39f361d61e583'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:55.422321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d79d623dc84c538cd39f361d61e583'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:55.435673 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d79d623dc84c538cd39f361d61e583'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:55.436269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d79d623dc84c538cd39f361d61e583'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:55.451382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1177/2360] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:50:55 2022] DELETE /identity/v3/users/55d79d623dc84c538cd39f361d61e583 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:55.456128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc1835-49cb-4bde-bcab-39ceb8ad0803 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:55.456494 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc1835-49cb-4bde-bcab-39ceb8ad0803 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:55.456843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc1835-49cb-4bde-bcab-39ceb8ad0803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:55.466266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:55.479253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-01dc1835-49cb-4bde-bcab-39ceb8ad0803 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:55.480481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-01dc1835-49cb-4bde-bcab-39ceb8ad0803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:55.549622 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1184/2361] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:55.559880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:55.561433 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:55.624193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c522f-7151-4e48-accc-c74674b3f964 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:55.628314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a79cbf-6ca7-4ef5-95b3-d4e9661a8a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:55.629038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a79cbf-6ca7-4ef5-95b3-d4e9661a8a6b service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:55.629474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a79cbf-6ca7-4ef5-95b3-d4e9661a8a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:55.629747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a79cbf-6ca7-4ef5-95b3-d4e9661a8a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:55.640180 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a79cbf-6ca7-4ef5-95b3-d4e9661a8a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:55.641663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a79cbf-6ca7-4ef5-95b3-d4e9661a8a6b service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:55.652138 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1178/2362] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:50:55.923222 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc1835-49cb-4bde-bcab-39ceb8ad0803 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:55.924870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-01dc1835-49cb-4bde-bcab-39ceb8ad0803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:55.940155 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc1835-49cb-4bde-bcab-39ceb8ad0803 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:55.945699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:55.946294 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:55.946580 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:55.947015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] PATH_INFO: `/v3/projects/536309ed4c9f4ab3aa3c0794ab1a07e7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:55.948462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=536309ed4c9f4ab3aa3c0794ab1a07e7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:55.950495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:56.003943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa6aed-87bd-4a75-b982-d7747b6b6f65 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:56.004329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa6aed-87bd-4a75-b982-d7747b6b6f65 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:56.004710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa6aed-87bd-4a75-b982-d7747b6b6f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:56.007387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536309ed4c9f4ab3aa3c0794ab1a07e7', 'request_id': 'req-d62ab280-0229-49e3-bf09-380e62724283'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.016945 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536309ed4c9f4ab3aa3c0794ab1a07e7', 'request_id': 'req-d62ab280-0229-49e3-bf09-380e62724283'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.023097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536309ed4c9f4ab3aa3c0794ab1a07e7', 'request_id': 'req-d62ab280-0229-49e3-bf09-380e62724283'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.027718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b0fa6aed-87bd-4a75-b982-d7747b6b6f65 None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:56.029514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b0fa6aed-87bd-4a75-b982-d7747b6b6f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:56.035388 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] The token cache is being invalidate because project 536309ed4c9f4ab3aa3c0794ab1a07e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:50:56.035761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.036470 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.038750 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1185/2363] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:50:55 2022] DELETE /identity/v3/projects/536309ed4c9f4ab3aa3c0794ab1a07e7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:56.042560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:56.043029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:56.046252 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:56.104472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1179/2364] 10.222.0.39 () {58 vars in 967 bytes} [Tue Jul 26 02:50:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:50:56.114148 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa6aed-87bd-4a75-b982-d7747b6b6f65 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:56.115615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b0fa6aed-87bd-4a75-b982-d7747b6b6f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:56.121626 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ab280-0229-49e3-bf09-380e62724283 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:56.126358 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0bb1b-2676-4e3d-af2c-362b196647d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:56.127079 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0bb1b-2676-4e3d-af2c-362b196647d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:56.127361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0bb1b-2676-4e3d-af2c-362b196647d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:56.127724 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0bb1b-2676-4e3d-af2c-362b196647d1 admin admin] PATH_INFO: `/v3/users/bc1175173217473aa9892384c8ed16e7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:56.129094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0bb1b-2676-4e3d-af2c-362b196647d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1175173217473aa9892384c8ed16e7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:56.131261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e0bb1b-2676-4e3d-af2c-362b196647d1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:56.170268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:56.189796 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e6e0bb1b-2676-4e3d-af2c-362b196647d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1175173217473aa9892384c8ed16e7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.197814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e6e0bb1b-2676-4e3d-af2c-362b196647d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1175173217473aa9892384c8ed16e7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.203136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa6aed-87bd-4a75-b982-d7747b6b6f65 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:56.209022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e6e0bb1b-2676-4e3d-af2c-362b196647d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1175173217473aa9892384c8ed16e7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.209811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307881b9-eec0-41be-b7ff-b543e99bfdbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:56.210346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e6e0bb1b-2676-4e3d-af2c-362b196647d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1175173217473aa9892384c8ed16e7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.210523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307881b9-eec0-41be-b7ff-b543e99bfdbb service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:56.210709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307881b9-eec0-41be-b7ff-b543e99bfdbb service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:56.210979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307881b9-eec0-41be-b7ff-b543e99bfdbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:56.221369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307881b9-eec0-41be-b7ff-b543e99bfdbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:56.222989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307881b9-eec0-41be-b7ff-b543e99bfdbb service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:56.225918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e6e0bb1b-2676-4e3d-af2c-362b196647d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1175173217473aa9892384c8ed16e7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.232655 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1180/2365] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:50:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 02:50:56.233558 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1186/2366] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:50:56 2022] DELETE /identity/v3/users/bc1175173217473aa9892384c8ed16e7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:56.562855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307881b9-eec0-41be-b7ff-b543e99bfdbb service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:56.575142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307881b9-eec0-41be-b7ff-b543e99bfdbb service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:56.639514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:56.640175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:56.640449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:56.640719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56 admin admin] PATH_INFO: `/v3/projects/ee68a3249ec449908bfb6605c77bfb9b` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:56.641896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee68a3249ec449908bfb6605c77bfb9b)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:56.643839 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:56.693945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee68a3249ec449908bfb6605c77bfb9b', 'request_id': 'req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.695735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:56.700381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee68a3249ec449908bfb6605c77bfb9b', 'request_id': 'req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.711888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee68a3249ec449908bfb6605c77bfb9b', 'request_id': 'req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.721922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56 admin admin] The token cache is being invalidate because project ee68a3249ec449908bfb6605c77bfb9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:50:56.722203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.722810 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b549ad3a-3e77-4d37-9c9b-0c2eb48b0b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:50:56.724326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1181/2367] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:50:56 2022] DELETE /identity/v3/projects/ee68a3249ec449908bfb6605c77bfb9b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:56.729351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ee60-98b9-4e04-8b77-3a747222bd42 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:56.729905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ee60-98b9-4e04-8b77-3a747222bd42 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:56.730442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ee60-98b9-4e04-8b77-3a747222bd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:56.751124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-64f6ee60-98b9-4e04-8b77-3a747222bd42 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:56.752322 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-64f6ee60-98b9-4e04-8b77-3a747222bd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:56.813585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1187/2368] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:56.821687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087754-ca66-47c0-b1af-2f7a71d62779 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:56.821983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087754-ca66-47c0-b1af-2f7a71d62779 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:56.822252 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99087754-ca66-47c0-b1af-2f7a71d62779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:56.842301 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-99087754-ca66-47c0-b1af-2f7a71d62779 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:56.843503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-99087754-ca66-47c0-b1af-2f7a71d62779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:56.851424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1182/2369] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:56.855831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6ee60-98b9-4e04-8b77-3a747222bd42 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:56.865337 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6ee60-98b9-4e04-8b77-3a747222bd42 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:56.870315 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167194a-c453-48d6-bf5b-67b7ad9f074c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:56.870924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167194a-c453-48d6-bf5b-67b7ad9f074c admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:56.871198 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167194a-c453-48d6-bf5b-67b7ad9f074c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:56.871460 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167194a-c453-48d6-bf5b-67b7ad9f074c admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:56.872180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167194a-c453-48d6-bf5b-67b7ad9f074c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:50:56.872474 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167194a-c453-48d6-bf5b-67b7ad9f074c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:56.874128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167194a-c453-48d6-bf5b-67b7ad9f074c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:56.885940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1188/2370] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:50:56.890497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99087754-ca66-47c0-b1af-2f7a71d62779 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:56.900332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99087754-ca66-47c0-b1af-2f7a71d62779 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:56.905624 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95830f4-8f3f-4b62-b9e2-bb5c0106dfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:56.906234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95830f4-8f3f-4b62-b9e2-bb5c0106dfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:56.906515 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95830f4-8f3f-4b62-b9e2-bb5c0106dfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:56.906786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95830f4-8f3f-4b62-b9e2-bb5c0106dfe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:56.907455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95830f4-8f3f-4b62-b9e2-bb5c0106dfe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:56.909429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95830f4-8f3f-4b62-b9e2-bb5c0106dfe9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:56.938692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1183/2371] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:50:56 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:50:56.942886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167194a-c453-48d6-bf5b-67b7ad9f074c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:56.953454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167194a-c453-48d6-bf5b-67b7ad9f074c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:57.015320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f44fa5-5e97-48bd-ab5f-7ca00c4cab45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:57.015851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f44fa5-5e97-48bd-ab5f-7ca00c4cab45 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.016128 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f44fa5-5e97-48bd-ab5f-7ca00c4cab45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.016395 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f44fa5-5e97-48bd-ab5f-7ca00c4cab45 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.017075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f44fa5-5e97-48bd-ab5f-7ca00c4cab45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:57.019029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f44fa5-5e97-48bd-ab5f-7ca00c4cab45 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:57.040057 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1189/2372] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:50:56 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:50:57.044364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95830f4-8f3f-4b62-b9e2-bb5c0106dfe9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:57.055194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95830f4-8f3f-4b62-b9e2-bb5c0106dfe9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:57.061451 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4299a-b2aa-44a8-b34c-7491348bc149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:57.062232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4299a-b2aa-44a8-b34c-7491348bc149 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.062619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4299a-b2aa-44a8-b34c-7491348bc149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.062897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4299a-b2aa-44a8-b34c-7491348bc149 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.063783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4299a-b2aa-44a8-b34c-7491348bc149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:57.065462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4299a-b2aa-44a8-b34c-7491348bc149 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:57.078135 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1184/2373] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:50:57.081972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f44fa5-5e97-48bd-ab5f-7ca00c4cab45 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:57.092974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f44fa5-5e97-48bd-ab5f-7ca00c4cab45 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:57.097984 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059eb01-e25f-4332-825d-5a5667c22fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:57.098861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059eb01-e25f-4332-825d-5a5667c22fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.099146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059eb01-e25f-4332-825d-5a5667c22fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.099462 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059eb01-e25f-4332-825d-5a5667c22fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.100356 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059eb01-e25f-4332-825d-5a5667c22fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:57.102688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059eb01-e25f-4332-825d-5a5667c22fd9 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:57.115799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1190/2374] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:50:57.120303 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4299a-b2aa-44a8-b34c-7491348bc149 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:57.132233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4299a-b2aa-44a8-b34c-7491348bc149 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:57.138865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a6931-c272-486a-8b7f-8506a91590be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:57.140206 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6931-c272-486a-8b7f-8506a91590be admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.141045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6931-c272-486a-8b7f-8506a91590be admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.141368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a6931-c272-486a-8b7f-8506a91590be admin admin] PATH_INFO: `/v3/projects/e1a8a20b3293425eb2771b0a83428262/users/794dfa40236a4550a05423acd71986fd/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.159071 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a6931-c272-486a-8b7f-8506a91590be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a8a20b3293425eb2771b0a83428262, user_id=794dfa40236a4550a05423acd71986fd, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:57.161776 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a6931-c272-486a-8b7f-8506a91590be admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:57.174792 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1185/2375] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:50:57 2022] PUT /identity/v3/projects/e1a8a20b3293425eb2771b0a83428262/users/794dfa40236a4550a05423acd71986fd/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:57.186371 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22f37d-44c8-493e-b740-4da1b6777ffa None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.186657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22f37d-44c8-493e-b740-4da1b6777ffa None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.186935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22f37d-44c8-493e-b740-4da1b6777ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.214792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:57.218536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1c22f37d-44c8-493e-b740-4da1b6777ffa None None] MFA Rules not processed for user `794dfa40236a4550a05423acd71986fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:57.220543 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1c22f37d-44c8-493e-b740-4da1b6777ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:57.283762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1191/2376] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:57.288951 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a6931-c272-486a-8b7f-8506a91590be admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:57.352729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a6931-c272-486a-8b7f-8506a91590be admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:57.358428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cabfd-cf92-4d5c-8f2d-7a36f6314af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:57.359188 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cabfd-cf92-4d5c-8f2d-7a36f6314af8 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.359465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cabfd-cf92-4d5c-8f2d-7a36f6314af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.359736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cabfd-cf92-4d5c-8f2d-7a36f6314af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.360414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cabfd-cf92-4d5c-8f2d-7a36f6314af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:57.362378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cabfd-cf92-4d5c-8f2d-7a36f6314af8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:57.389510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1186/2377] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:50:57 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:50:57.393758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22f37d-44c8-493e-b740-4da1b6777ffa None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:57.405036 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22f37d-44c8-493e-b740-4da1b6777ffa None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:57.468024 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f0689-f912-4dcf-a67d-15f21631b805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:57.468660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f0689-f912-4dcf-a67d-15f21631b805 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.468944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f0689-f912-4dcf-a67d-15f21631b805 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.469680 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f0689-f912-4dcf-a67d-15f21631b805 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.469925 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f0689-f912-4dcf-a67d-15f21631b805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:57.471848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f0689-f912-4dcf-a67d-15f21631b805 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:57.495812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1192/2378] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:50:57 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:50:57.500201 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cabfd-cf92-4d5c-8f2d-7a36f6314af8 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:57.512237 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cabfd-cf92-4d5c-8f2d-7a36f6314af8 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:57.518160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f256bb7-25cd-4979-93dd-9206d0d53e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:57.518820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f256bb7-25cd-4979-93dd-9206d0d53e29 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.519208 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f256bb7-25cd-4979-93dd-9206d0d53e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.519617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f256bb7-25cd-4979-93dd-9206d0d53e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.520449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f256bb7-25cd-4979-93dd-9206d0d53e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:57.522348 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f256bb7-25cd-4979-93dd-9206d0d53e29 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:57.534873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1187/2379] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:50:57.539088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f0689-f912-4dcf-a67d-15f21631b805 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:57.551302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f0689-f912-4dcf-a67d-15f21631b805 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:57.559155 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12741245-e1bf-4353-b04e-c1ee29849009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:57.559848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741245-e1bf-4353-b04e-c1ee29849009 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.560256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741245-e1bf-4353-b04e-c1ee29849009 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.560534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741245-e1bf-4353-b04e-c1ee29849009 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.561454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12741245-e1bf-4353-b04e-c1ee29849009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:57.563146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12741245-e1bf-4353-b04e-c1ee29849009 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:57.575453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1193/2380] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:50:57.583786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f256bb7-25cd-4979-93dd-9206d0d53e29 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:57.598848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f256bb7-25cd-4979-93dd-9206d0d53e29 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:57.603693 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bad4f-b499-4bd1-8009-fa0669f66b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:57.604373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bad4f-b499-4bd1-8009-fa0669f66b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.604830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bad4f-b499-4bd1-8009-fa0669f66b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.605131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bad4f-b499-4bd1-8009-fa0669f66b18 admin admin] PATH_INFO: `/v3/projects/54ecdb6091e84e3b9aa4572bd646a81d/users/64d620c90f2f4d6f8f3cf33d6e882669/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.631640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bad4f-b499-4bd1-8009-fa0669f66b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ecdb6091e84e3b9aa4572bd646a81d, user_id=64d620c90f2f4d6f8f3cf33d6e882669, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:57.635579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bad4f-b499-4bd1-8009-fa0669f66b18 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:57.650392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1188/2381] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:50:57 2022] PUT /identity/v3/projects/54ecdb6091e84e3b9aa4572bd646a81d/users/64d620c90f2f4d6f8f3cf33d6e882669/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:57.661123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5d1f-913f-4915-98db-9903b1d1adc5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.661454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5d1f-913f-4915-98db-9903b1d1adc5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.661743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5d1f-913f-4915-98db-9903b1d1adc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.692041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-066f5d1f-913f-4915-98db-9903b1d1adc5 None None] MFA Rules not processed for user `64d620c90f2f4d6f8f3cf33d6e882669`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:57.693264 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-066f5d1f-913f-4915-98db-9903b1d1adc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:57.758263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1194/2382] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:57.762961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bad4f-b499-4bd1-8009-fa0669f66b18 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:57.792662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:57.827406 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bad4f-b499-4bd1-8009-fa0669f66b18 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:57.833086 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77abaf-623b-4afa-a9b6-45d91d34ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:57.833797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77abaf-623b-4afa-a9b6-45d91d34ec7d admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.834005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77abaf-623b-4afa-a9b6-45d91d34ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.834273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77abaf-623b-4afa-a9b6-45d91d34ec7d admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.834914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77abaf-623b-4afa-a9b6-45d91d34ec7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:57.836880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77abaf-623b-4afa-a9b6-45d91d34ec7d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:57.867497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1189/2383] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:50:57 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:50:57.873256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5d1f-913f-4915-98db-9903b1d1adc5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:57.884294 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5d1f-913f-4915-98db-9903b1d1adc5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:57.892429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:57.944709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f10e05-0577-4053-a61c-899efc184671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:57.945354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f10e05-0577-4053-a61c-899efc184671 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.945620 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f10e05-0577-4053-a61c-899efc184671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.945888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f10e05-0577-4053-a61c-899efc184671 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.946572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f10e05-0577-4053-a61c-899efc184671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:57.948542 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f10e05-0577-4053-a61c-899efc184671 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:57.974745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1195/2384] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:50:57 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:50:57.976243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77abaf-623b-4afa-a9b6-45d91d34ec7d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:57.988462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77abaf-623b-4afa-a9b6-45d91d34ec7d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:57.995084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d5f94-de1d-4d61-a9be-90eb2f5efb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:57.995715 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d5f94-de1d-4d61-a9be-90eb2f5efb61 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:57.996047 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d5f94-de1d-4d61-a9be-90eb2f5efb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:57.996268 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d5f94-de1d-4d61-a9be-90eb2f5efb61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:57.997142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d5f94-de1d-4d61-a9be-90eb2f5efb61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:57.998999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d5f94-de1d-4d61-a9be-90eb2f5efb61 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:58.011986 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1190/2385] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:50:58.017318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f10e05-0577-4053-a61c-899efc184671 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:58.028267 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f10e05-0577-4053-a61c-899efc184671 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:58.034597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4051e-3b70-45e9-9b93-bd5f223d9da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:58.035255 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4051e-3b70-45e9-9b93-bd5f223d9da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:58.035870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4051e-3b70-45e9-9b93-bd5f223d9da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:58.036148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4051e-3b70-45e9-9b93-bd5f223d9da2 admin admin] PATH_INFO: `/v3/projects/8b16baaa2d844c63a70f95493ba7840e/users/82704324da8344bd8b71e5d5944b2a5a/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:58.055419 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4051e-3b70-45e9-9b93-bd5f223d9da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b16baaa2d844c63a70f95493ba7840e, user_id=82704324da8344bd8b71e5d5944b2a5a, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:58.058848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4051e-3b70-45e9-9b93-bd5f223d9da2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:58.073585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1196/2386] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:50:58 2022] PUT /identity/v3/projects/8b16baaa2d844c63a70f95493ba7840e/users/82704324da8344bd8b71e5d5944b2a5a/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:58.078037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d5f94-de1d-4d61-a9be-90eb2f5efb61 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:58.089124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d5f94-de1d-4d61-a9be-90eb2f5efb61 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:58.154141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4e64c-7d71-47bf-80f7-893245583883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:58.154828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4e64c-7d71-47bf-80f7-893245583883 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:58.155171 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4e64c-7d71-47bf-80f7-893245583883 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:58.155529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4e64c-7d71-47bf-80f7-893245583883 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:58.156603 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4e64c-7d71-47bf-80f7-893245583883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:58.159114 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4e64c-7d71-47bf-80f7-893245583883 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:58.171629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1191/2387] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:50:58.176036 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4051e-3b70-45e9-9b93-bd5f223d9da2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:58.187329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4051e-3b70-45e9-9b93-bd5f223d9da2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:58.193056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecbb91-73f6-4bca-a0d0-500666e86310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:58.193758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecbb91-73f6-4bca-a0d0-500666e86310 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:58.194163 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecbb91-73f6-4bca-a0d0-500666e86310 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:58.194425 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecbb91-73f6-4bca-a0d0-500666e86310 admin admin] PATH_INFO: `/v3/projects/8b16baaa2d844c63a70f95493ba7840e/users/82704324da8344bd8b71e5d5944b2a5a/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:58.196508 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecbb91-73f6-4bca-a0d0-500666e86310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b16baaa2d844c63a70f95493ba7840e, user_id=82704324da8344bd8b71e5d5944b2a5a, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:58.199273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecbb91-73f6-4bca-a0d0-500666e86310 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:58.211082 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1197/2388] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:50:58 2022] PUT /identity/v3/projects/8b16baaa2d844c63a70f95493ba7840e/users/82704324da8344bd8b71e5d5944b2a5a/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:50:58.222650 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7eb66-47fa-46eb-90c7-1d18031eb2b2 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:58.222929 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7eb66-47fa-46eb-90c7-1d18031eb2b2 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:58.223198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7eb66-47fa-46eb-90c7-1d18031eb2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:58.254968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-81b7eb66-47fa-46eb-90c7-1d18031eb2b2 None None] MFA Rules not processed for user `82704324da8344bd8b71e5d5944b2a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:50:58.256238 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-81b7eb66-47fa-46eb-90c7-1d18031eb2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:58.327896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1192/2389] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:50:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:50:58.340027 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecbb91-73f6-4bca-a0d0-500666e86310 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:58.342298 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-22ecbb91-73f6-4bca-a0d0-500666e86310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:58.400888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecbb91-73f6-4bca-a0d0-500666e86310 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:58.405035 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f533b8a-1c93-40c3-85ad-06849ac56369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:58.405679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f533b8a-1c93-40c3-85ad-06849ac56369 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:58.405956 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f533b8a-1c93-40c3-85ad-06849ac56369 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:58.406226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f533b8a-1c93-40c3-85ad-06849ac56369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:58.416263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f533b8a-1c93-40c3-85ad-06849ac56369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:58.417730 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f533b8a-1c93-40c3-85ad-06849ac56369 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:58.427601 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1198/2390] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:50:58.437482 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7eb66-47fa-46eb-90c7-1d18031eb2b2 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:58.439118 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-81b7eb66-47fa-46eb-90c7-1d18031eb2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:58.468254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:50:58.472903 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f533b8a-1c93-40c3-85ad-06849ac56369 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:50:58.475115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5f533b8a-1c93-40c3-85ad-06849ac56369 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:58.487597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f533b8a-1c93-40c3-85ad-06849ac56369 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:58.492029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da336e76-b756-408e-aa99-76ae8e3d2df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:58.492533 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da336e76-b756-408e-aa99-76ae8e3d2df5 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:58.492798 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da336e76-b756-408e-aa99-76ae8e3d2df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:58.493063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da336e76-b756-408e-aa99-76ae8e3d2df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:58.522821 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7eb66-47fa-46eb-90c7-1d18031eb2b2 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:50:58.529009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eaac14-269a-4b7c-a63c-34e417326ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:50:58.529702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaac14-269a-4b7c-a63c-34e417326ba2 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:50:58.529981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaac14-269a-4b7c-a63c-34e417326ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:50:58.530253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eaac14-269a-4b7c-a63c-34e417326ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:50:58.532244 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-58eaac14-269a-4b7c-a63c-34e417326ba2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:50:58.551885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da336e76-b756-408e-aa99-76ae8e3d2df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:58.553417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da336e76-b756-408e-aa99-76ae8e3d2df5 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:58.562528 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1199/2391] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:50:58.594483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eaac14-269a-4b7c-a63c-34e417326ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:50:58.596002 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eaac14-269a-4b7c-a63c-34e417326ba2 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:50:58.608242 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1193/2392] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:50:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:01.537811 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da336e76-b756-408e-aa99-76ae8e3d2df5 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:01.543605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:01.624923 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da336e76-b756-408e-aa99-76ae8e3d2df5 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:01.631912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:01.632858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:01.633773 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:01.634375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] PATH_INFO: `/v3/users/794dfa40236a4550a05423acd71986fd` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:01.636233 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=794dfa40236a4550a05423acd71986fd)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:01.637950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:01.703626 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794dfa40236a4550a05423acd71986fd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:01.714277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794dfa40236a4550a05423acd71986fd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:01.722509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794dfa40236a4550a05423acd71986fd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:01.723192 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794dfa40236a4550a05423acd71986fd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:01.735410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794dfa40236a4550a05423acd71986fd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:01.741499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1200/2393] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:01 2022] DELETE /identity/v3/users/794dfa40236a4550a05423acd71986fd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:01.746441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecef64d-e167-4b13-a1d7-4f381b45217e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:01.746916 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecef64d-e167-4b13-a1d7-4f381b45217e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:01.746916 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecef64d-e167-4b13-a1d7-4f381b45217e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:01.766294 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9ecef64d-e167-4b13-a1d7-4f381b45217e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:01.767460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9ecef64d-e167-4b13-a1d7-4f381b45217e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:01.827759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1194/2394] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:01.838256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:01.839683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:01.905372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37500-ea64-4386-b96e-a78816e97cfd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:01.909848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a9eb-fc14-40af-9b20-a8c7df883c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:01.910541 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a9eb-fc14-40af-9b20-a8c7df883c72 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:01.910826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a9eb-fc14-40af-9b20-a8c7df883c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:01.911109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a9eb-fc14-40af-9b20-a8c7df883c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:01.921586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095a9eb-fc14-40af-9b20-a8c7df883c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:01.923066 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095a9eb-fc14-40af-9b20-a8c7df883c72 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:01.935157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1201/2395] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:02.028957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecef64d-e167-4b13-a1d7-4f381b45217e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:02.030526 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9ecef64d-e167-4b13-a1d7-4f381b45217e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:02.182618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:02.214545 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecef64d-e167-4b13-a1d7-4f381b45217e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:02.229775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514113-dd7a-45c9-b239-d1e990a4eb7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:02.230427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514113-dd7a-45c9-b239-d1e990a4eb7c service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:02.230713 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514113-dd7a-45c9-b239-d1e990a4eb7c service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:02.231091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514113-dd7a-45c9-b239-d1e990a4eb7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:02.246756 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-18514113-dd7a-45c9-b239-d1e990a4eb7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:02.271221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18514113-dd7a-45c9-b239-d1e990a4eb7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:02.272448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18514113-dd7a-45c9-b239-d1e990a4eb7c service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:02.309724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1195/2396] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:02.446063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a9eb-fc14-40af-9b20-a8c7df883c72 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:02.447771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1095a9eb-fc14-40af-9b20-a8c7df883c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:02.466249 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a9eb-fc14-40af-9b20-a8c7df883c72 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:02.471544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:02.472359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:02.472644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:02.472919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] PATH_INFO: `/v3/projects/e1a8a20b3293425eb2771b0a83428262` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:02.474805 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a8a20b3293425eb2771b0a83428262)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:02.476750 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:02.517719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:02.557034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a8a20b3293425eb2771b0a83428262', 'request_id': 'req-c4145986-2d15-4bb5-815f-0ca9f4e765ca'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:02.570630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a8a20b3293425eb2771b0a83428262', 'request_id': 'req-c4145986-2d15-4bb5-815f-0ca9f4e765ca'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:02.580323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a8a20b3293425eb2771b0a83428262', 'request_id': 'req-c4145986-2d15-4bb5-815f-0ca9f4e765ca'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:02.596522 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] The token cache is being invalidate because project e1a8a20b3293425eb2771b0a83428262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:02.597121 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:02.598109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:02.600022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1202/2397] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:02 2022] DELETE /identity/v3/projects/e1a8a20b3293425eb2771b0a83428262 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:02.605067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514113-dd7a-45c9-b239-d1e990a4eb7c service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:02.624060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514113-dd7a-45c9-b239-d1e990a4eb7c service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:02.730365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:02.731020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:02.731351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:02.732039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] PATH_INFO: `/v3/users/64d620c90f2f4d6f8f3cf33d6e882669` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:02.733234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d620c90f2f4d6f8f3cf33d6e882669)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:02.735173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:02.788673 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d620c90f2f4d6f8f3cf33d6e882669'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:02.796276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d620c90f2f4d6f8f3cf33d6e882669'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:02.797061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d620c90f2f4d6f8f3cf33d6e882669'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:02.810405 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d620c90f2f4d6f8f3cf33d6e882669'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:02.811317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d620c90f2f4d6f8f3cf33d6e882669'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:02.832644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1196/2398] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:02 2022] DELETE /identity/v3/users/64d620c90f2f4d6f8f3cf33d6e882669 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:03.188813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:03.190640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:03.232531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4145986-2d15-4bb5-815f-0ca9f4e765ca admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:03.304091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:03.304737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:03.305024 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:03.305320 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] PATH_INFO: `/v3/projects/54ecdb6091e84e3b9aa4572bd646a81d` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:03.306530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ecdb6091e84e3b9aa4572bd646a81d)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:03.308507 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:03.358459 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ecdb6091e84e3b9aa4572bd646a81d', 'request_id': 'req-1ef72262-6fd1-47b5-8d51-7fed41f313c4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:03.366912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ecdb6091e84e3b9aa4572bd646a81d', 'request_id': 'req-1ef72262-6fd1-47b5-8d51-7fed41f313c4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:03.373029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ecdb6091e84e3b9aa4572bd646a81d', 'request_id': 'req-1ef72262-6fd1-47b5-8d51-7fed41f313c4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:03.385086 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] The token cache is being invalidate because project 54ecdb6091e84e3b9aa4572bd646a81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:03.385394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:03.386069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:03.387858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1203/2399] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:03 2022] DELETE /identity/v3/projects/54ecdb6091e84e3b9aa4572bd646a81d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:03.392084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:03.393558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:03.407704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb0d63-046f-405b-b0e5-f5a6d52f7360 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:03.463799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e41b3-c9a9-4408-9459-b5c42e5e461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:03.464594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e41b3-c9a9-4408-9459-b5c42e5e461b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:03.464872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e41b3-c9a9-4408-9459-b5c42e5e461b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:03.465169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e41b3-c9a9-4408-9459-b5c42e5e461b admin admin] PATH_INFO: `/v3/users/82704324da8344bd8b71e5d5944b2a5a` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:03.466367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e41b3-c9a9-4408-9459-b5c42e5e461b admin admin] RBAC: Authorizing `identity:delete_user(user_id=82704324da8344bd8b71e5d5944b2a5a)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:03.468341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e41b3-c9a9-4408-9459-b5c42e5e461b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:03.475692 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:03.526049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-578e41b3-c9a9-4408-9459-b5c42e5e461b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82704324da8344bd8b71e5d5944b2a5a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:03.533253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-578e41b3-c9a9-4408-9459-b5c42e5e461b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82704324da8344bd8b71e5d5944b2a5a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:03.533974 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-578e41b3-c9a9-4408-9459-b5c42e5e461b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82704324da8344bd8b71e5d5944b2a5a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:03.548917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-578e41b3-c9a9-4408-9459-b5c42e5e461b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82704324da8344bd8b71e5d5944b2a5a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:03.549662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-578e41b3-c9a9-4408-9459-b5c42e5e461b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82704324da8344bd8b71e5d5944b2a5a'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:03.567797 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1197/2400] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:03 2022] DELETE /identity/v3/users/82704324da8344bd8b71e5d5944b2a5a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:03.872674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:03.875677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:03.892498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef72262-6fd1-47b5-8d51-7fed41f313c4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:03.942996 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:03.964415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7d6d5-3379-45cf-90b0-7ae68af2e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:03.965075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7d6d5-3379-45cf-90b0-7ae68af2e826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:03.965415 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7d6d5-3379-45cf-90b0-7ae68af2e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:03.965691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7d6d5-3379-45cf-90b0-7ae68af2e826 admin admin] PATH_INFO: `/v3/projects/8b16baaa2d844c63a70f95493ba7840e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:03.966901 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7d6d5-3379-45cf-90b0-7ae68af2e826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b16baaa2d844c63a70f95493ba7840e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:03.969569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7d6d5-3379-45cf-90b0-7ae68af2e826 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:04.024513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-09a7d6d5-3379-45cf-90b0-7ae68af2e826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b16baaa2d844c63a70f95493ba7840e', 'request_id': 'req-09a7d6d5-3379-45cf-90b0-7ae68af2e826'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:04.032696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-09a7d6d5-3379-45cf-90b0-7ae68af2e826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b16baaa2d844c63a70f95493ba7840e', 'request_id': 'req-09a7d6d5-3379-45cf-90b0-7ae68af2e826'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:04.038537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-09a7d6d5-3379-45cf-90b0-7ae68af2e826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b16baaa2d844c63a70f95493ba7840e', 'request_id': 'req-09a7d6d5-3379-45cf-90b0-7ae68af2e826'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:04.050060 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-09a7d6d5-3379-45cf-90b0-7ae68af2e826 admin admin] The token cache is being invalidate because project 8b16baaa2d844c63a70f95493ba7840e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:04.050426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-09a7d6d5-3379-45cf-90b0-7ae68af2e826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:04.051436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-09a7d6d5-3379-45cf-90b0-7ae68af2e826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:04.053321 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1204/2401] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:03 2022] DELETE /identity/v3/projects/8b16baaa2d844c63a70f95493ba7840e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:04.059233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd41111-abca-4d35-8c4b-945e74e81316 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:04.059724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd41111-abca-4d35-8c4b-945e74e81316 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:04.059841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd41111-abca-4d35-8c4b-945e74e81316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:04.080383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1fd41111-abca-4d35-8c4b-945e74e81316 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:04.081806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1fd41111-abca-4d35-8c4b-945e74e81316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:04.144490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1198/2402] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:04.153404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9c32b-f76b-4077-8291-fc8bb2e57140 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:04.153714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9c32b-f76b-4077-8291-fc8bb2e57140 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:04.153979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9c32b-f76b-4077-8291-fc8bb2e57140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:04.175372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e8a9c32b-f76b-4077-8291-fc8bb2e57140 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:04.176600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e8a9c32b-f76b-4077-8291-fc8bb2e57140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:04.185743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1205/2403] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:04.190328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd41111-abca-4d35-8c4b-945e74e81316 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:04.200660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd41111-abca-4d35-8c4b-945e74e81316 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:04.205995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dc951-9304-4eec-b416-acb1f9cc24dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:04.206606 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc951-9304-4eec-b416-acb1f9cc24dc admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:04.206884 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc951-9304-4eec-b416-acb1f9cc24dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:04.207484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc951-9304-4eec-b416-acb1f9cc24dc admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:04.208222 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dc951-9304-4eec-b416-acb1f9cc24dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:04.208520 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dc951-9304-4eec-b416-acb1f9cc24dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:04.210383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dc951-9304-4eec-b416-acb1f9cc24dc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:04.223343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1199/2404] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:04.228133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9c32b-f76b-4077-8291-fc8bb2e57140 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:04.238600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9c32b-f76b-4077-8291-fc8bb2e57140 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:04.250900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fe526-936d-4033-8e34-d3b609ec3f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:04.251448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fe526-936d-4033-8e34-d3b609ec3f47 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:04.251726 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fe526-936d-4033-8e34-d3b609ec3f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:04.251994 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fe526-936d-4033-8e34-d3b609ec3f47 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:04.252660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fe526-936d-4033-8e34-d3b609ec3f47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:04.254663 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fe526-936d-4033-8e34-d3b609ec3f47 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:04.286655 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1206/2405] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:04 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:04.291197 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dc951-9304-4eec-b416-acb1f9cc24dc admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:04.301877 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dc951-9304-4eec-b416-acb1f9cc24dc admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:04.360294 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716db3f-915f-4044-b459-fbeee0f9e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:04.361830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716db3f-915f-4044-b459-fbeee0f9e201 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:04.362185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716db3f-915f-4044-b459-fbeee0f9e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:04.362582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716db3f-915f-4044-b459-fbeee0f9e201 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:04.363581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716db3f-915f-4044-b459-fbeee0f9e201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:04.366625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716db3f-915f-4044-b459-fbeee0f9e201 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:04.385404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:04.390911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1200/2406] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:04 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:04.395405 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fe526-936d-4033-8e34-d3b609ec3f47 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:04.405997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fe526-936d-4033-8e34-d3b609ec3f47 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:04.411180 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240cef9-3d4a-43b3-9719-a3d0d405735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:04.411790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240cef9-3d4a-43b3-9719-a3d0d405735b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:04.412073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240cef9-3d4a-43b3-9719-a3d0d405735b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:04.412344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240cef9-3d4a-43b3-9719-a3d0d405735b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:04.413044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240cef9-3d4a-43b3-9719-a3d0d405735b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:04.414692 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240cef9-3d4a-43b3-9719-a3d0d405735b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:04.425837 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1207/2407] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:04.429869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716db3f-915f-4044-b459-fbeee0f9e201 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:04.440569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716db3f-915f-4044-b459-fbeee0f9e201 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:04.446591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178a761-8d0a-4970-96a4-b6c7bb6e4c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:04.447211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178a761-8d0a-4970-96a4-b6c7bb6e4c80 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:04.447488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178a761-8d0a-4970-96a4-b6c7bb6e4c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:04.447759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178a761-8d0a-4970-96a4-b6c7bb6e4c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:04.448456 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178a761-8d0a-4970-96a4-b6c7bb6e4c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:04.450143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178a761-8d0a-4970-96a4-b6c7bb6e4c80 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:04.461524 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1201/2408] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:04.465755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240cef9-3d4a-43b3-9719-a3d0d405735b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:04.476322 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240cef9-3d4a-43b3-9719-a3d0d405735b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:04.481943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aac1fa-83a0-443d-ad87-3abd530f5b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:04.482598 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aac1fa-83a0-443d-ad87-3abd530f5b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:04.482882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aac1fa-83a0-443d-ad87-3abd530f5b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:04.483157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aac1fa-83a0-443d-ad87-3abd530f5b92 admin admin] PATH_INFO: `/v3/projects/d9737978525c403f9a2af9e932e6b1ee/users/343a491f3ee34c46b62bbb508b5e1f1d/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:04.497980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aac1fa-83a0-443d-ad87-3abd530f5b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9737978525c403f9a2af9e932e6b1ee, user_id=343a491f3ee34c46b62bbb508b5e1f1d, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:04.500643 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aac1fa-83a0-443d-ad87-3abd530f5b92 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:04.515499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1208/2409] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:04 2022] PUT /identity/v3/projects/d9737978525c403f9a2af9e932e6b1ee/users/343a491f3ee34c46b62bbb508b5e1f1d/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:04.527112 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151f01a-607b-437f-8e4e-65f959e9afa9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:04.527399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151f01a-607b-437f-8e4e-65f959e9afa9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:04.527672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151f01a-607b-437f-8e4e-65f959e9afa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:04.556636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a151f01a-607b-437f-8e4e-65f959e9afa9 None None] MFA Rules not processed for user `343a491f3ee34c46b62bbb508b5e1f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:04.557917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a151f01a-607b-437f-8e4e-65f959e9afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:04.623413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1202/2410] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:04.628106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aac1fa-83a0-443d-ad87-3abd530f5b92 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:04.693311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aac1fa-83a0-443d-ad87-3abd530f5b92 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:04.698521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672cab6-b9a4-401d-868a-2f5596f08178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:04.699150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672cab6-b9a4-401d-868a-2f5596f08178 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:04.699429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672cab6-b9a4-401d-868a-2f5596f08178 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:04.699705 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672cab6-b9a4-401d-868a-2f5596f08178 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:04.700395 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672cab6-b9a4-401d-868a-2f5596f08178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:04.702484 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672cab6-b9a4-401d-868a-2f5596f08178 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:04.714989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:04.737089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1209/2411] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:04 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:04.739228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151f01a-607b-437f-8e4e-65f959e9afa9 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:04.750827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151f01a-607b-437f-8e4e-65f959e9afa9 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:04.818536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e61a9e-a131-4e4e-919a-6029d0e04b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:04.819170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e61a9e-a131-4e4e-919a-6029d0e04b5b admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:04.819455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e61a9e-a131-4e4e-919a-6029d0e04b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:04.819730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e61a9e-a131-4e4e-919a-6029d0e04b5b admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:04.820413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e61a9e-a131-4e4e-919a-6029d0e04b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:04.822467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e61a9e-a131-4e4e-919a-6029d0e04b5b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:04.845505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1203/2412] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:04 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:04.849641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672cab6-b9a4-401d-868a-2f5596f08178 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:04.860226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672cab6-b9a4-401d-868a-2f5596f08178 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:04.865780 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2aa2f-f355-461b-b18c-78f52a2fc31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:04.866389 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2aa2f-f355-461b-b18c-78f52a2fc31b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:04.866709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2aa2f-f355-461b-b18c-78f52a2fc31b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:04.866977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2aa2f-f355-461b-b18c-78f52a2fc31b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:04.867668 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2aa2f-f355-461b-b18c-78f52a2fc31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:04.869351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2aa2f-f355-461b-b18c-78f52a2fc31b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:04.880454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1210/2413] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:04.884744 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e61a9e-a131-4e4e-919a-6029d0e04b5b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:04.895535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e61a9e-a131-4e4e-919a-6029d0e04b5b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:04.901191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fcd48-1681-4e59-b666-d6b7a450492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:04.901934 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fcd48-1681-4e59-b666-d6b7a450492b admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:04.902217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fcd48-1681-4e59-b666-d6b7a450492b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:04.902495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fcd48-1681-4e59-b666-d6b7a450492b admin admin] PATH_INFO: `/v3/projects/07de70cd919340088ceee901555c48ae/users/e82398fa467b46199bf24ec5f460649f/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:04.918908 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fcd48-1681-4e59-b666-d6b7a450492b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07de70cd919340088ceee901555c48ae, user_id=e82398fa467b46199bf24ec5f460649f, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:04.921971 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fcd48-1681-4e59-b666-d6b7a450492b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:04.937016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1204/2414] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:04 2022] PUT /identity/v3/projects/07de70cd919340088ceee901555c48ae/users/e82398fa467b46199bf24ec5f460649f/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:04.941026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2aa2f-f355-461b-b18c-78f52a2fc31b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:04.951893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2aa2f-f355-461b-b18c-78f52a2fc31b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:05.011631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647516f-e996-43df-afbc-5736f3f4b4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:05.012250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647516f-e996-43df-afbc-5736f3f4b4fc admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:05.012555 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647516f-e996-43df-afbc-5736f3f4b4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:05.012810 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647516f-e996-43df-afbc-5736f3f4b4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:05.013568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647516f-e996-43df-afbc-5736f3f4b4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:05.015193 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647516f-e996-43df-afbc-5736f3f4b4fc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:05.025412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1211/2415] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:05.029868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fcd48-1681-4e59-b666-d6b7a450492b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:05.041171 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fcd48-1681-4e59-b666-d6b7a450492b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:05.047177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c0dff-47e6-4fba-9954-ac6d27dc84f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:05.047842 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c0dff-47e6-4fba-9954-ac6d27dc84f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:05.048114 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c0dff-47e6-4fba-9954-ac6d27dc84f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:05.048383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c0dff-47e6-4fba-9954-ac6d27dc84f5 admin admin] PATH_INFO: `/v3/projects/07de70cd919340088ceee901555c48ae/users/e82398fa467b46199bf24ec5f460649f/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:05.050609 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c0dff-47e6-4fba-9954-ac6d27dc84f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07de70cd919340088ceee901555c48ae, user_id=e82398fa467b46199bf24ec5f460649f, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:05.053254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c0dff-47e6-4fba-9954-ac6d27dc84f5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:05.064183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1205/2416] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:05 2022] PUT /identity/v3/projects/07de70cd919340088ceee901555c48ae/users/e82398fa467b46199bf24ec5f460649f/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:05.135198 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32954f-c72e-4ebb-ad0a-24129b2742e4 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:05.135490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32954f-c72e-4ebb-ad0a-24129b2742e4 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:05.135734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32954f-c72e-4ebb-ad0a-24129b2742e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:05.165498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4e32954f-c72e-4ebb-ad0a-24129b2742e4 None None] MFA Rules not processed for user `e82398fa467b46199bf24ec5f460649f`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:05.166751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4e32954f-c72e-4ebb-ad0a-24129b2742e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:05.238678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1212/2417] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:05.250387 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c0dff-47e6-4fba-9954-ac6d27dc84f5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:05.252199 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-439c0dff-47e6-4fba-9954-ac6d27dc84f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:05.290758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:05.316540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c0dff-47e6-4fba-9954-ac6d27dc84f5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:05.320813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fece9c-ef62-46b2-a0c9-a3c4edcf75cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:05.321499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fece9c-ef62-46b2-a0c9-a3c4edcf75cd service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:05.321777 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fece9c-ef62-46b2-a0c9-a3c4edcf75cd service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:05.322046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fece9c-ef62-46b2-a0c9-a3c4edcf75cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:05.382370 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fece9c-ef62-46b2-a0c9-a3c4edcf75cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:05.383865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fece9c-ef62-46b2-a0c9-a3c4edcf75cd service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:05.393746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1206/2418] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:07.141754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32954f-c72e-4ebb-ad0a-24129b2742e4 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:07.143209 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4e32954f-c72e-4ebb-ad0a-24129b2742e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:07.204065 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32954f-c72e-4ebb-ad0a-24129b2742e4 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:07.208281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f329a-910c-477c-b860-886809bafb40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:07.208918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f329a-910c-477c-b860-886809bafb40 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:07.209187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f329a-910c-477c-b860-886809bafb40 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:07.209497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f329a-910c-477c-b860-886809bafb40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:07.211299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e08f329a-910c-477c-b860-886809bafb40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:07.225670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:07.277314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f329a-910c-477c-b860-886809bafb40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:07.278787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f329a-910c-477c-b860-886809bafb40 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:07.289114 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1213/2419] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:07.978318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fece9c-ef62-46b2-a0c9-a3c4edcf75cd service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:07.990028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fece9c-ef62-46b2-a0c9-a3c4edcf75cd service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:07.996009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:07.996762 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:07.997091 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:07.997398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] PATH_INFO: `/v3/users/343a491f3ee34c46b62bbb508b5e1f1d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:07.998673 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=343a491f3ee34c46b62bbb508b5e1f1d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:08.001217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:08.068781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '343a491f3ee34c46b62bbb508b5e1f1d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.076768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '343a491f3ee34c46b62bbb508b5e1f1d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.077852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '343a491f3ee34c46b62bbb508b5e1f1d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.091493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '343a491f3ee34c46b62bbb508b5e1f1d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.092210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '343a491f3ee34c46b62bbb508b5e1f1d'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.112066 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1207/2420] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:07 2022] DELETE /identity/v3/users/343a491f3ee34c46b62bbb508b5e1f1d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:08.116695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5b87-6126-4461-a9a3-889606a40029 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:08.116982 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5b87-6126-4461-a9a3-889606a40029 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:08.117259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c5b87-6126-4461-a9a3-889606a40029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:08.139225 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0d3c5b87-6126-4461-a9a3-889606a40029 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:08.140633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0d3c5b87-6126-4461-a9a3-889606a40029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:08.219198 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1214/2421] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:08.226320 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:08.228158 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:08.322264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce316d9-7123-4ce3-8bd1-c5b3ffbcbc56 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:08.326931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b72f3-af59-4b41-8104-a683952c3ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:08.327732 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b72f3-af59-4b41-8104-a683952c3ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:08.328115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b72f3-af59-4b41-8104-a683952c3ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:08.328489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b72f3-af59-4b41-8104-a683952c3ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:08.342672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b72f3-af59-4b41-8104-a683952c3ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:08.344380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b72f3-af59-4b41-8104-a683952c3ac9 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:08.354069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:08.363304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1208/2422] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:08.685043 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5b87-6126-4461-a9a3-889606a40029 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:08.686595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0d3c5b87-6126-4461-a9a3-889606a40029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:08.701953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c5b87-6126-4461-a9a3-889606a40029 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:08.707410 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:08.708114 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:08.708622 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:08.708941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] PATH_INFO: `/v3/projects/d9737978525c403f9a2af9e932e6b1ee` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:08.710932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9737978525c403f9a2af9e932e6b1ee)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:08.713372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:08.766179 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9737978525c403f9a2af9e932e6b1ee', 'request_id': 'req-669d0789-d62b-4714-be6a-ce86eed2b321'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.774809 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9737978525c403f9a2af9e932e6b1ee', 'request_id': 'req-669d0789-d62b-4714-be6a-ce86eed2b321'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.781357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9737978525c403f9a2af9e932e6b1ee', 'request_id': 'req-669d0789-d62b-4714-be6a-ce86eed2b321'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.793084 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] The token cache is being invalidate because project d9737978525c403f9a2af9e932e6b1ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:08.793375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.794559 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.796304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1215/2423] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:08 2022] DELETE /identity/v3/projects/d9737978525c403f9a2af9e932e6b1ee => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:08.800514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b72f3-af59-4b41-8104-a683952c3ac9 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:08.810690 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b72f3-af59-4b41-8104-a683952c3ac9 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:08.870989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef349bc-ede3-4e98-ab81-2b6fc0ef5c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:08.871640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef349bc-ede3-4e98-ab81-2b6fc0ef5c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:08.871920 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef349bc-ede3-4e98-ab81-2b6fc0ef5c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:08.872196 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef349bc-ede3-4e98-ab81-2b6fc0ef5c7a admin admin] PATH_INFO: `/v3/users/e82398fa467b46199bf24ec5f460649f` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:08.873523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef349bc-ede3-4e98-ab81-2b6fc0ef5c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82398fa467b46199bf24ec5f460649f)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:08.875490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef349bc-ede3-4e98-ab81-2b6fc0ef5c7a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:08.927215 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cef349bc-ede3-4e98-ab81-2b6fc0ef5c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82398fa467b46199bf24ec5f460649f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.937516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cef349bc-ede3-4e98-ab81-2b6fc0ef5c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82398fa467b46199bf24ec5f460649f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.938285 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cef349bc-ede3-4e98-ab81-2b6fc0ef5c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82398fa467b46199bf24ec5f460649f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.952399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cef349bc-ede3-4e98-ab81-2b6fc0ef5c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82398fa467b46199bf24ec5f460649f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.953149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cef349bc-ede3-4e98-ab81-2b6fc0ef5c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82398fa467b46199bf24ec5f460649f'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:08.975930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1209/2424] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:08 2022] DELETE /identity/v3/users/e82398fa467b46199bf24ec5f460649f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:09.358326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:09.359817 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:09.393991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d0789-d62b-4714-be6a-ce86eed2b321 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:09.440071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:09.486595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:09.487534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:09.487823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:09.488392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764 admin admin] PATH_INFO: `/v3/projects/07de70cd919340088ceee901555c48ae` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:09.489785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07de70cd919340088ceee901555c48ae)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:09.495171 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:09.568878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07de70cd919340088ceee901555c48ae', 'request_id': 'req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:09.577263 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07de70cd919340088ceee901555c48ae', 'request_id': 'req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:09.583648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07de70cd919340088ceee901555c48ae', 'request_id': 'req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:09.595490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764 admin admin] The token cache is being invalidate because project 07de70cd919340088ceee901555c48ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:09.595779 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:09.596566 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-f25ced7b-f32a-4f65-a8a1-9c28e45aa764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:09.598623 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1216/2425] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:09 2022] DELETE /identity/v3/projects/07de70cd919340088ceee901555c48ae => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:09.603858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b40f-fc7b-44cd-865e-62ce3221f060 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:09.604371 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b40f-fc7b-44cd-865e-62ce3221f060 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:09.604467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b40f-fc7b-44cd-865e-62ce3221f060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:09.627107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-aed2b40f-fc7b-44cd-865e-62ce3221f060 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:09.628904 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-aed2b40f-fc7b-44cd-865e-62ce3221f060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:09.700000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1210/2426] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:09.709019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4dae0-29a1-41fc-b10d-a47f7da162ec None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:09.709329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4dae0-29a1-41fc-b10d-a47f7da162ec None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:09.709602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4dae0-29a1-41fc-b10d-a47f7da162ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:09.732975 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c5e4dae0-29a1-41fc-b10d-a47f7da162ec None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:09.734374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c5e4dae0-29a1-41fc-b10d-a47f7da162ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:09.742656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1217/2427] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:09.747454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2b40f-fc7b-44cd-865e-62ce3221f060 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:09.758154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2b40f-fc7b-44cd-865e-62ce3221f060 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:09.762928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ecf64-5071-4e75-9da1-83d95da4920a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:09.763575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ecf64-5071-4e75-9da1-83d95da4920a admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:09.763858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ecf64-5071-4e75-9da1-83d95da4920a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:09.764132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ecf64-5071-4e75-9da1-83d95da4920a admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:09.764898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ecf64-5071-4e75-9da1-83d95da4920a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:09.765193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ecf64-5071-4e75-9da1-83d95da4920a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:09.767036 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ecf64-5071-4e75-9da1-83d95da4920a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:09.783905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1211/2428] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:09.785020 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4dae0-29a1-41fc-b10d-a47f7da162ec None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:09.795248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4dae0-29a1-41fc-b10d-a47f7da162ec None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:09.800088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1be19b-37d1-4756-afd1-a629908e2eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:09.800719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1be19b-37d1-4756-afd1-a629908e2eba admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:09.800994 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1be19b-37d1-4756-afd1-a629908e2eba admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:09.801267 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1be19b-37d1-4756-afd1-a629908e2eba admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:09.801986 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1be19b-37d1-4756-afd1-a629908e2eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:09.803918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1be19b-37d1-4756-afd1-a629908e2eba admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:09.842339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1218/2429] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:09 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:09.848518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ecf64-5071-4e75-9da1-83d95da4920a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:09.860176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ecf64-5071-4e75-9da1-83d95da4920a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:09.864609 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:09.942507 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782266f-dc49-4c4b-aba2-ec386dd9e531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:09.942999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782266f-dc49-4c4b-aba2-ec386dd9e531 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:09.943410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782266f-dc49-4c4b-aba2-ec386dd9e531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:09.943691 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782266f-dc49-4c4b-aba2-ec386dd9e531 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:09.944377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782266f-dc49-4c4b-aba2-ec386dd9e531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:09.946502 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782266f-dc49-4c4b-aba2-ec386dd9e531 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:09.972601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1212/2430] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:09 2022] POST /identity/v3/users => generated 285 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:09.976955 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1be19b-37d1-4756-afd1-a629908e2eba admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:09.987369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1be19b-37d1-4756-afd1-a629908e2eba admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:09.992050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5951234-8957-4f78-b4dc-eec9b5b41347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:09.992665 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5951234-8957-4f78-b4dc-eec9b5b41347 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:09.992941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5951234-8957-4f78-b4dc-eec9b5b41347 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:09.993250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5951234-8957-4f78-b4dc-eec9b5b41347 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:09.993981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5951234-8957-4f78-b4dc-eec9b5b41347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:09.995572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5951234-8957-4f78-b4dc-eec9b5b41347 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:10.010508 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1219/2431] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:10.011729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782266f-dc49-4c4b-aba2-ec386dd9e531 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:10.022022 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782266f-dc49-4c4b-aba2-ec386dd9e531 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:10.026669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989777e-e8b8-4184-b13a-1db5410c92cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:10.027288 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989777e-e8b8-4184-b13a-1db5410c92cf admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:10.027567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989777e-e8b8-4184-b13a-1db5410c92cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:10.027839 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989777e-e8b8-4184-b13a-1db5410c92cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:10.028548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989777e-e8b8-4184-b13a-1db5410c92cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:10.030216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989777e-e8b8-4184-b13a-1db5410c92cf admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:10.041831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1213/2432] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:10.046160 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5951234-8957-4f78-b4dc-eec9b5b41347 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:10.057033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5951234-8957-4f78-b4dc-eec9b5b41347 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:10.061976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b683483-39bb-43d1-bb11-296a580e45c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:10.062669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b683483-39bb-43d1-bb11-296a580e45c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:10.062943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b683483-39bb-43d1-bb11-296a580e45c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:10.063219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b683483-39bb-43d1-bb11-296a580e45c2 admin admin] PATH_INFO: `/v3/projects/0d18f4006ab3420d9cf4ef34c7880ac7/users/73974b9bff7f424fbab9f9c608e35c39/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:10.080370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b683483-39bb-43d1-bb11-296a580e45c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d18f4006ab3420d9cf4ef34c7880ac7, user_id=73974b9bff7f424fbab9f9c608e35c39, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:10.083498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b683483-39bb-43d1-bb11-296a580e45c2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:10.098667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1220/2433] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:10 2022] PUT /identity/v3/projects/0d18f4006ab3420d9cf4ef34c7880ac7/users/73974b9bff7f424fbab9f9c608e35c39/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:10.109493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf454e-1fe8-42ae-9bd6-e94949859956 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:10.109899 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf454e-1fe8-42ae-9bd6-e94949859956 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:10.110039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf454e-1fe8-42ae-9bd6-e94949859956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:10.138067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-62bf454e-1fe8-42ae-9bd6-e94949859956 None None] MFA Rules not processed for user `73974b9bff7f424fbab9f9c608e35c39`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:10.139318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-62bf454e-1fe8-42ae-9bd6-e94949859956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:10.210448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1214/2434] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:10.222751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b683483-39bb-43d1-bb11-296a580e45c2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:10.224578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2b683483-39bb-43d1-bb11-296a580e45c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:10.299207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b683483-39bb-43d1-bb11-296a580e45c2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:10.304887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15531c-9ce0-4875-8d28-f16d6cb811e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2402339784b34d98a4670db912617331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:10.305568 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15531c-9ce0-4875-8d28-f16d6cb811e5 service glance] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:10.305959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15531c-9ce0-4875-8d28-f16d6cb811e5 service glance] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:10.306238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15531c-9ce0-4875-8d28-f16d6cb811e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:10.316216 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15531c-9ce0-4875-8d28-f16d6cb811e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:10.317704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15531c-9ce0-4875-8d28-f16d6cb811e5 service glance] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:10.329000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1221/2435] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:11.199953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf454e-1fe8-42ae-9bd6-e94949859956 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:11.201745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-62bf454e-1fe8-42ae-9bd6-e94949859956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:11.270614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf454e-1fe8-42ae-9bd6-e94949859956 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:11.275310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8c978-8969-4514-91a7-2e149fea3079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:11.275967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8c978-8969-4514-91a7-2e149fea3079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:11.276305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8c978-8969-4514-91a7-2e149fea3079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:11.276582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8c978-8969-4514-91a7-2e149fea3079 admin admin] PATH_INFO: `/v3/users/8de4ea727e9543f285c86e649d36c760` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:11.277801 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8c978-8969-4514-91a7-2e149fea3079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8de4ea727e9543f285c86e649d36c760)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:11.279791 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8c978-8969-4514-91a7-2e149fea3079 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:11.296669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:11.336507 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7fd8c978-8969-4514-91a7-2e149fea3079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8de4ea727e9543f285c86e649d36c760'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:11.349264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7fd8c978-8969-4514-91a7-2e149fea3079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8de4ea727e9543f285c86e649d36c760'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:11.350168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7fd8c978-8969-4514-91a7-2e149fea3079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8de4ea727e9543f285c86e649d36c760'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:11.363637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7fd8c978-8969-4514-91a7-2e149fea3079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8de4ea727e9543f285c86e649d36c760'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:11.364350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7fd8c978-8969-4514-91a7-2e149fea3079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8de4ea727e9543f285c86e649d36c760'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:11.380250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1215/2436] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:11 2022] DELETE /identity/v3/users/8de4ea727e9543f285c86e649d36c760 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:11.566930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15531c-9ce0-4875-8d28-f16d6cb811e5 service glance] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:11.575194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:11.580612 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15531c-9ce0-4875-8d28-f16d6cb811e5 service glance] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:11.649241 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:11.649949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:11.650228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:11.650505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343 admin admin] PATH_INFO: `/v3/projects/d8dff10829d44fa4927e69cb144ed263` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:11.651711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8dff10829d44fa4927e69cb144ed263)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:11.653647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:11.704408 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8dff10829d44fa4927e69cb144ed263', 'request_id': 'req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:11.712081 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8dff10829d44fa4927e69cb144ed263', 'request_id': 'req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:11.717696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8dff10829d44fa4927e69cb144ed263', 'request_id': 'req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:11.728672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343 admin admin] The token cache is being invalidate because project d8dff10829d44fa4927e69cb144ed263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:11.728954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:11.729604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9dfa27ca-7416-42ce-af2f-6b0b5fc2c343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:11.731153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1222/2437] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:11 2022] DELETE /identity/v3/projects/d8dff10829d44fa4927e69cb144ed263 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:11.736135 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb730-413c-40c5-a101-13ce36ecac67 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:11.736422 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb730-413c-40c5-a101-13ce36ecac67 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:11.736698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb730-413c-40c5-a101-13ce36ecac67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:11.758168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-dc8cb730-413c-40c5-a101-13ce36ecac67 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:11.759452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-dc8cb730-413c-40c5-a101-13ce36ecac67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:11.826414 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1216/2438] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:11.835210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe64d7-b9a2-46a7-a30c-a6d3d464ad81 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:11.835494 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe64d7-b9a2-46a7-a30c-a6d3d464ad81 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:11.835769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe64d7-b9a2-46a7-a30c-a6d3d464ad81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:11.860776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-72fe64d7-b9a2-46a7-a30c-a6d3d464ad81 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:11.862036 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-72fe64d7-b9a2-46a7-a30c-a6d3d464ad81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:11.871581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1223/2439] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:11.876132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cb730-413c-40c5-a101-13ce36ecac67 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:11.886418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cb730-413c-40c5-a101-13ce36ecac67 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:11.891527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507146a-0e11-4f4f-adc2-82f08758715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:11.892122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507146a-0e11-4f4f-adc2-82f08758715f admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:11.892407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507146a-0e11-4f4f-adc2-82f08758715f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:11.892770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507146a-0e11-4f4f-adc2-82f08758715f admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:11.893578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507146a-0e11-4f4f-adc2-82f08758715f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:11.893882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507146a-0e11-4f4f-adc2-82f08758715f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:11.895499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507146a-0e11-4f4f-adc2-82f08758715f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:11.908001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1217/2440] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:11.912522 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe64d7-b9a2-46a7-a30c-a6d3d464ad81 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:11.922847 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe64d7-b9a2-46a7-a30c-a6d3d464ad81 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:11.928597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8321d4-3b32-4bd1-ba32-3f4d076bac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:11.929244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8321d4-3b32-4bd1-ba32-3f4d076bac58 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:11.929594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8321d4-3b32-4bd1-ba32-3f4d076bac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:11.929865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8321d4-3b32-4bd1-ba32-3f4d076bac58 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:11.930834 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8321d4-3b32-4bd1-ba32-3f4d076bac58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:11.932775 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8321d4-3b32-4bd1-ba32-3f4d076bac58 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:11.964617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1224/2441] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:11 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:11.968632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507146a-0e11-4f4f-adc2-82f08758715f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:11.979286 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507146a-0e11-4f4f-adc2-82f08758715f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:12.062866 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8321d4-3b32-4bd1-ba32-3f4d076bac58 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:12.064594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fa8321d4-3b32-4bd1-ba32-3f4d076bac58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:12.064938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e3932-2a25-4077-a1ee-c3095c7ddf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:12.066081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e3932-2a25-4077-a1ee-c3095c7ddf2b admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:12.066461 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e3932-2a25-4077-a1ee-c3095c7ddf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:12.067171 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e3932-2a25-4077-a1ee-c3095c7ddf2b admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:12.068092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e3932-2a25-4077-a1ee-c3095c7ddf2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:12.070535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e3932-2a25-4077-a1ee-c3095c7ddf2b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:12.111415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1218/2442] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:11 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:12.115712 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e3932-2a25-4077-a1ee-c3095c7ddf2b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:12.128476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e3932-2a25-4077-a1ee-c3095c7ddf2b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:12.133220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730dfcc-c763-453a-8fb4-d37d6e5a735b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:12.133960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730dfcc-c763-453a-8fb4-d37d6e5a735b admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:12.134243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730dfcc-c763-453a-8fb4-d37d6e5a735b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:12.134518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730dfcc-c763-453a-8fb4-d37d6e5a735b admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:12.135228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730dfcc-c763-453a-8fb4-d37d6e5a735b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:12.136936 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730dfcc-c763-453a-8fb4-d37d6e5a735b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:12.140600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8321d4-3b32-4bd1-ba32-3f4d076bac58 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:12.142594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:12.144682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a56df-f328-42c7-8e33-df100506f67a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:12.145397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a56df-f328-42c7-8e33-df100506f67a service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:12.145685 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a56df-f328-42c7-8e33-df100506f67a service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:12.146048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a56df-f328-42c7-8e33-df100506f67a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:12.147810 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b21a56df-f328-42c7-8e33-df100506f67a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:12.149116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1219/2443] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:12.153494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730dfcc-c763-453a-8fb4-d37d6e5a735b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:12.162123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a56df-f328-42c7-8e33-df100506f67a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:12.163778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730dfcc-c763-453a-8fb4-d37d6e5a735b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:12.163894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a56df-f328-42c7-8e33-df100506f67a service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:12.168860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9168f6-01a4-49cf-b330-eafbe46a0444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:12.169523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9168f6-01a4-49cf-b330-eafbe46a0444 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:12.169798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9168f6-01a4-49cf-b330-eafbe46a0444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:12.170071 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9168f6-01a4-49cf-b330-eafbe46a0444 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:12.170915 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9168f6-01a4-49cf-b330-eafbe46a0444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:12.172517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9168f6-01a4-49cf-b330-eafbe46a0444 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:12.174812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1225/2444] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:51:12.184476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1220/2445] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:12.188992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a56df-f328-42c7-8e33-df100506f67a service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:12.199098 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a56df-f328-42c7-8e33-df100506f67a service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:12.203894 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68fcb3-8321-4860-8c69-3c33abac8484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:12.204637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68fcb3-8321-4860-8c69-3c33abac8484 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:12.204981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68fcb3-8321-4860-8c69-3c33abac8484 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:12.205346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68fcb3-8321-4860-8c69-3c33abac8484 admin admin] PATH_INFO: `/v3/projects/78b5c854d5aa4f52a1e387be458313c7/users/f8c2978579a74318963f58d3daf81850/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:12.209021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:12.224895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68fcb3-8321-4860-8c69-3c33abac8484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b5c854d5aa4f52a1e387be458313c7, user_id=f8c2978579a74318963f58d3daf81850, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:12.227851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68fcb3-8321-4860-8c69-3c33abac8484 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:12.243382 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1226/2446] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:12 2022] PUT /identity/v3/projects/78b5c854d5aa4f52a1e387be458313c7/users/f8c2978579a74318963f58d3daf81850/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:12.254641 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28232-5b2b-448d-8576-11ba4f5068e7 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:12.255267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28232-5b2b-448d-8576-11ba4f5068e7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:12.255267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28232-5b2b-448d-8576-11ba4f5068e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:12.284622 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-76b28232-5b2b-448d-8576-11ba4f5068e7 None None] MFA Rules not processed for user `f8c2978579a74318963f58d3daf81850`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:12.285882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-76b28232-5b2b-448d-8576-11ba4f5068e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:12.357737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1221/2447] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:12.362464 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68fcb3-8321-4860-8c69-3c33abac8484 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:12.430322 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68fcb3-8321-4860-8c69-3c33abac8484 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:12.435048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1ee3b-25d1-4842-9571-76110e4b6dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:12.435666 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1ee3b-25d1-4842-9571-76110e4b6dcc admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:12.435978 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1ee3b-25d1-4842-9571-76110e4b6dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:12.436212 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1ee3b-25d1-4842-9571-76110e4b6dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:12.436887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1ee3b-25d1-4842-9571-76110e4b6dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:12.438843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1ee3b-25d1-4842-9571-76110e4b6dcc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:12.467786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1227/2448] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:12 2022] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:12.472021 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b28232-5b2b-448d-8576-11ba4f5068e7 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:12.484255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b28232-5b2b-448d-8576-11ba4f5068e7 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:12.547857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b0cb1-eab8-46ec-9564-5451a4b5dd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:12.548561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b0cb1-eab8-46ec-9564-5451a4b5dd9a admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:12.548814 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b0cb1-eab8-46ec-9564-5451a4b5dd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:12.549085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b0cb1-eab8-46ec-9564-5451a4b5dd9a admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:12.549807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b0cb1-eab8-46ec-9564-5451a4b5dd9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:12.551747 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b0cb1-eab8-46ec-9564-5451a4b5dd9a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:12.577671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1222/2449] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:12 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:12.579150 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1ee3b-25d1-4842-9571-76110e4b6dcc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:12.590246 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1ee3b-25d1-4842-9571-76110e4b6dcc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:12.594928 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dfa6e-5b86-4f55-8721-6d0f1926c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:12.595564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dfa6e-5b86-4f55-8721-6d0f1926c82c admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:12.595844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dfa6e-5b86-4f55-8721-6d0f1926c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:12.596243 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dfa6e-5b86-4f55-8721-6d0f1926c82c admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:12.597009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dfa6e-5b86-4f55-8721-6d0f1926c82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:12.598869 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dfa6e-5b86-4f55-8721-6d0f1926c82c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:12.621467 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1228/2450] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:12.625949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b0cb1-eab8-46ec-9564-5451a4b5dd9a admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:12.637410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b0cb1-eab8-46ec-9564-5451a4b5dd9a admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:12.642537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160c466-1c93-4b1f-b0e2-7e54c23aecf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:12.643217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c466-1c93-4b1f-b0e2-7e54c23aecf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:12.643498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c466-1c93-4b1f-b0e2-7e54c23aecf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:12.643774 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c466-1c93-4b1f-b0e2-7e54c23aecf6 admin admin] PATH_INFO: `/v3/projects/8951ae98b24e42b6b74dcbf4802fa302/users/381393ea9bba4646b4c636f479ae6443/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:12.660001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160c466-1c93-4b1f-b0e2-7e54c23aecf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8951ae98b24e42b6b74dcbf4802fa302, user_id=381393ea9bba4646b4c636f479ae6443, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:12.663119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160c466-1c93-4b1f-b0e2-7e54c23aecf6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:12.682015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1223/2451] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:12 2022] PUT /identity/v3/projects/8951ae98b24e42b6b74dcbf4802fa302/users/381393ea9bba4646b4c636f479ae6443/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:12.686141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dfa6e-5b86-4f55-8721-6d0f1926c82c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:12.696860 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dfa6e-5b86-4f55-8721-6d0f1926c82c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:12.760173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11704370-9647-461a-8be6-1a918ca16b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:12.760836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11704370-9647-461a-8be6-1a918ca16b46 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:12.761090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11704370-9647-461a-8be6-1a918ca16b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:12.761390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11704370-9647-461a-8be6-1a918ca16b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:12.762095 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11704370-9647-461a-8be6-1a918ca16b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:12.763934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11704370-9647-461a-8be6-1a918ca16b46 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:12.774608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1229/2452] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:12.778985 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160c466-1c93-4b1f-b0e2-7e54c23aecf6 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:12.790642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160c466-1c93-4b1f-b0e2-7e54c23aecf6 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:12.795811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cf6bb-641f-4595-bafd-ea51efdd100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:12.796496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cf6bb-641f-4595-bafd-ea51efdd100d admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:12.796776 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cf6bb-641f-4595-bafd-ea51efdd100d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:12.797047 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cf6bb-641f-4595-bafd-ea51efdd100d admin admin] PATH_INFO: `/v3/projects/8951ae98b24e42b6b74dcbf4802fa302/users/381393ea9bba4646b4c636f479ae6443/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:12.799246 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101cf6bb-641f-4595-bafd-ea51efdd100d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8951ae98b24e42b6b74dcbf4802fa302, user_id=381393ea9bba4646b4c636f479ae6443, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:12.801971 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101cf6bb-641f-4595-bafd-ea51efdd100d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:12.813663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1224/2453] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:12 2022] PUT /identity/v3/projects/8951ae98b24e42b6b74dcbf4802fa302/users/381393ea9bba4646b4c636f479ae6443/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:12.825790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd29e4-8749-4852-ab60-48931b4b1975 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:12.826167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd29e4-8749-4852-ab60-48931b4b1975 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:12.826512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd29e4-8749-4852-ab60-48931b4b1975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:12.856461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-4dbd29e4-8749-4852-ab60-48931b4b1975 None None] MFA Rules not processed for user `381393ea9bba4646b4c636f479ae6443`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:12.857752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4dbd29e4-8749-4852-ab60-48931b4b1975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:12.905985 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:12.933748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1230/2454] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:12 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:12.945529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cf6bb-641f-4595-bafd-ea51efdd100d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:12.947529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-101cf6bb-641f-4595-bafd-ea51efdd100d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:12.984718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:13.011590 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cf6bb-641f-4595-bafd-ea51efdd100d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:13.015191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b4765-894f-4d7c-bbba-5a4cf38ca1ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:13.015811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b4765-894f-4d7c-bbba-5a4cf38ca1ad service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:13.016088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b4765-894f-4d7c-bbba-5a4cf38ca1ad service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:13.016353 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b4765-894f-4d7c-bbba-5a4cf38ca1ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:13.027459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b4765-894f-4d7c-bbba-5a4cf38ca1ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:13.029250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b4765-894f-4d7c-bbba-5a4cf38ca1ad service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:13.040917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1225/2455] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:13.127994 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd29e4-8749-4852-ab60-48931b4b1975 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:13.129948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4dbd29e4-8749-4852-ab60-48931b4b1975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:13.145701 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd29e4-8749-4852-ab60-48931b4b1975 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:13.151017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487a03b-71d2-4ab1-84c2-4ebc6a147969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:13.152269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487a03b-71d2-4ab1-84c2-4ebc6a147969 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:13.152653 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487a03b-71d2-4ab1-84c2-4ebc6a147969 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:13.153028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487a03b-71d2-4ab1-84c2-4ebc6a147969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:13.222576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487a03b-71d2-4ab1-84c2-4ebc6a147969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:13.224055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487a03b-71d2-4ab1-84c2-4ebc6a147969 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:13.234523 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1231/2456] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:15.240531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b4765-894f-4d7c-bbba-5a4cf38ca1ad service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:15.242401 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-815b4765-894f-4d7c-bbba-5a4cf38ca1ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:15.315961 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487a03b-71d2-4ab1-84c2-4ebc6a147969 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:15.317519 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5487a03b-71d2-4ab1-84c2-4ebc6a147969 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:15.331100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b4765-894f-4d7c-bbba-5a4cf38ca1ad service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:15.336591 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb3f13-62b1-4b1f-8278-510cf3a74817 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629b38364f6a414aa14123c0749ba164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:15.337276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb3f13-62b1-4b1f-8278-510cf3a74817 service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:15.337577 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb3f13-62b1-4b1f-8278-510cf3a74817 service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:15.337846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb3f13-62b1-4b1f-8278-510cf3a74817 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:15.339617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-72bb3f13-62b1-4b1f-8278-510cf3a74817 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:15.356032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb3f13-62b1-4b1f-8278-510cf3a74817 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:15.357709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb3f13-62b1-4b1f-8278-510cf3a74817 service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:15.368958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1226/2457] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:15.395444 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487a03b-71d2-4ab1-84c2-4ebc6a147969 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:15.400197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febd2e8-4961-49d2-9148-85daafad807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:15.400942 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febd2e8-4961-49d2-9148-85daafad807f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:15.401220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febd2e8-4961-49d2-9148-85daafad807f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:15.403922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febd2e8-4961-49d2-9148-85daafad807f admin admin] PATH_INFO: `/v3/users/69246ce0e0544e72a928af58b65930bd` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:15.403922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febd2e8-4961-49d2-9148-85daafad807f admin admin] RBAC: Authorizing `identity:delete_user(user_id=69246ce0e0544e72a928af58b65930bd)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:15.404621 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febd2e8-4961-49d2-9148-85daafad807f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:15.453203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9febd2e8-4961-49d2-9148-85daafad807f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69246ce0e0544e72a928af58b65930bd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:15.460559 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9febd2e8-4961-49d2-9148-85daafad807f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69246ce0e0544e72a928af58b65930bd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:15.469316 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9febd2e8-4961-49d2-9148-85daafad807f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69246ce0e0544e72a928af58b65930bd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:15.470035 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9febd2e8-4961-49d2-9148-85daafad807f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69246ce0e0544e72a928af58b65930bd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:15.483348 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9febd2e8-4961-49d2-9148-85daafad807f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69246ce0e0544e72a928af58b65930bd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:15.484836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:15.491295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1232/2458] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:15 2022] DELETE /identity/v3/users/69246ce0e0544e72a928af58b65930bd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:15.678814 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb3f13-62b1-4b1f-8278-510cf3a74817 service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:15.700138 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb3f13-62b1-4b1f-8278-510cf3a74817 service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:15.762611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef20d10-4c91-4815-8e34-dd7f3d688480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:15.763281 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef20d10-4c91-4815-8e34-dd7f3d688480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:15.763557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef20d10-4c91-4815-8e34-dd7f3d688480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:15.763826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef20d10-4c91-4815-8e34-dd7f3d688480 admin admin] PATH_INFO: `/v3/projects/7b979e4c7b8847c0972091a1607bb25d` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:15.765084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef20d10-4c91-4815-8e34-dd7f3d688480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b979e4c7b8847c0972091a1607bb25d)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:15.767056 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef20d10-4c91-4815-8e34-dd7f3d688480 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:15.816185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8ef20d10-4c91-4815-8e34-dd7f3d688480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b979e4c7b8847c0972091a1607bb25d', 'request_id': 'req-8ef20d10-4c91-4815-8e34-dd7f3d688480'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:15.822665 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8ef20d10-4c91-4815-8e34-dd7f3d688480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b979e4c7b8847c0972091a1607bb25d', 'request_id': 'req-8ef20d10-4c91-4815-8e34-dd7f3d688480'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:15.831119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8ef20d10-4c91-4815-8e34-dd7f3d688480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b979e4c7b8847c0972091a1607bb25d', 'request_id': 'req-8ef20d10-4c91-4815-8e34-dd7f3d688480'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:15.835720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:15.844772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8ef20d10-4c91-4815-8e34-dd7f3d688480 admin admin] The token cache is being invalidate because project 7b979e4c7b8847c0972091a1607bb25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:15.845106 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8ef20d10-4c91-4815-8e34-dd7f3d688480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:15.846152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-8ef20d10-4c91-4815-8e34-dd7f3d688480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:15.847915 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1227/2459] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:15 2022] DELETE /identity/v3/projects/7b979e4c7b8847c0972091a1607bb25d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:15.853002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99841a0-15e3-4631-94f5-0d0dd173988e None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:15.853309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99841a0-15e3-4631-94f5-0d0dd173988e None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:15.853608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99841a0-15e3-4631-94f5-0d0dd173988e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:15.873874 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d99841a0-15e3-4631-94f5-0d0dd173988e None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:15.874996 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d99841a0-15e3-4631-94f5-0d0dd173988e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:15.939510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1233/2460] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:15.948383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b9a28-7c4d-4070-8056-29b920510f79 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:15.948688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b9a28-7c4d-4070-8056-29b920510f79 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:15.948958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b9a28-7c4d-4070-8056-29b920510f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:15.970103 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-756b9a28-7c4d-4070-8056-29b920510f79 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:15.971333 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-756b9a28-7c4d-4070-8056-29b920510f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:15.983088 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1228/2461] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:15.984432 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99841a0-15e3-4631-94f5-0d0dd173988e None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:16.000207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99841a0-15e3-4631-94f5-0d0dd173988e None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:16.005556 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8987f6-3754-4861-9dde-57f521ae8151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:16.006426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8987f6-3754-4861-9dde-57f521ae8151 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.006988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8987f6-3754-4861-9dde-57f521ae8151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.007340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8987f6-3754-4861-9dde-57f521ae8151 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.008121 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8987f6-3754-4861-9dde-57f521ae8151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:16.008458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8987f6-3754-4861-9dde-57f521ae8151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:16.010162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8987f6-3754-4861-9dde-57f521ae8151 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:16.027299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1234/2462] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:51:16.027851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b9a28-7c4d-4070-8056-29b920510f79 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:16.041365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b9a28-7c4d-4070-8056-29b920510f79 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:16.043787 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4c84b-4ade-4dfb-9cf7-950d1bbb186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:16.044427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4c84b-4ade-4dfb-9cf7-950d1bbb186b admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.044709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4c84b-4ade-4dfb-9cf7-950d1bbb186b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.044982 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4c84b-4ade-4dfb-9cf7-950d1bbb186b admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.045694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4c84b-4ade-4dfb-9cf7-950d1bbb186b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:16.047775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4c84b-4ade-4dfb-9cf7-950d1bbb186b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:16.078501 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1229/2463] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:16 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:16.083114 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8987f6-3754-4861-9dde-57f521ae8151 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:16.094576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8987f6-3754-4861-9dde-57f521ae8151 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:16.162828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b103c42-d5f1-46e5-8289-2cd94e34a436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:16.163610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b103c42-d5f1-46e5-8289-2cd94e34a436 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.164024 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b103c42-d5f1-46e5-8289-2cd94e34a436 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.164362 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b103c42-d5f1-46e5-8289-2cd94e34a436 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.165116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b103c42-d5f1-46e5-8289-2cd94e34a436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:16.167147 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b103c42-d5f1-46e5-8289-2cd94e34a436 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:16.193832 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1235/2464] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:16 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:16.197824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4c84b-4ade-4dfb-9cf7-950d1bbb186b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:16.209166 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4c84b-4ade-4dfb-9cf7-950d1bbb186b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:16.214623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595305a5-f788-4f57-a234-4f53f6bd1047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:16.215325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595305a5-f788-4f57-a234-4f53f6bd1047 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.215663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595305a5-f788-4f57-a234-4f53f6bd1047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.215876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595305a5-f788-4f57-a234-4f53f6bd1047 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.216636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595305a5-f788-4f57-a234-4f53f6bd1047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:16.219046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595305a5-f788-4f57-a234-4f53f6bd1047 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:16.230030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1230/2465] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:16.234162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b103c42-d5f1-46e5-8289-2cd94e34a436 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:16.244855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b103c42-d5f1-46e5-8289-2cd94e34a436 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:16.249735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28495682-b4d1-4897-95e6-39562427f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:16.250359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28495682-b4d1-4897-95e6-39562427f3ec admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.250641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28495682-b4d1-4897-95e6-39562427f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.250911 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28495682-b4d1-4897-95e6-39562427f3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.251600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28495682-b4d1-4897-95e6-39562427f3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:16.253235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28495682-b4d1-4897-95e6-39562427f3ec admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:16.265424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1236/2466] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:16.269715 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595305a5-f788-4f57-a234-4f53f6bd1047 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:16.279760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595305a5-f788-4f57-a234-4f53f6bd1047 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:16.284368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4465830-510f-4900-af7e-8509c3d5ca11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:16.285039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4465830-510f-4900-af7e-8509c3d5ca11 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.285355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4465830-510f-4900-af7e-8509c3d5ca11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.285630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4465830-510f-4900-af7e-8509c3d5ca11 admin admin] PATH_INFO: `/v3/projects/618e994499cc40a29a14dc9471148176/users/6c1542fd11b94dfab340668a8bebfe37/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.308694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4465830-510f-4900-af7e-8509c3d5ca11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618e994499cc40a29a14dc9471148176, user_id=6c1542fd11b94dfab340668a8bebfe37, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:16.311495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4465830-510f-4900-af7e-8509c3d5ca11 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:16.328037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1231/2467] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:16 2022] PUT /identity/v3/projects/618e994499cc40a29a14dc9471148176/users/6c1542fd11b94dfab340668a8bebfe37/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:16.339278 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c6521-7b4a-4fc9-9638-c84b0d86833d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.339897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c6521-7b4a-4fc9-9638-c84b0d86833d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.339897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c6521-7b4a-4fc9-9638-c84b0d86833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.370917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3c8c6521-7b4a-4fc9-9638-c84b0d86833d None None] MFA Rules not processed for user `6c1542fd11b94dfab340668a8bebfe37`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:16.372152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3c8c6521-7b4a-4fc9-9638-c84b0d86833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:16.437230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:16.447981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1237/2468] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:16.452602 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4465830-510f-4900-af7e-8509c3d5ca11 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:16.526601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4465830-510f-4900-af7e-8509c3d5ca11 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:16.531938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b944c3-c330-42b5-964a-2bd43142f943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:16.532636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b944c3-c330-42b5-964a-2bd43142f943 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.532981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b944c3-c330-42b5-964a-2bd43142f943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.533360 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b944c3-c330-42b5-964a-2bd43142f943 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.534115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b944c3-c330-42b5-964a-2bd43142f943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:16.536040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b944c3-c330-42b5-964a-2bd43142f943 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:16.569435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1232/2469] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:16 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:16.574230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c6521-7b4a-4fc9-9638-c84b0d86833d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:16.587181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c6521-7b4a-4fc9-9638-c84b0d86833d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:16.659762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36015339-098e-4569-922c-d90dbd8265a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:16.660386 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36015339-098e-4569-922c-d90dbd8265a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.660778 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36015339-098e-4569-922c-d90dbd8265a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.661047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36015339-098e-4569-922c-d90dbd8265a0 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.661739 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36015339-098e-4569-922c-d90dbd8265a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:16.663638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36015339-098e-4569-922c-d90dbd8265a0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:16.694963 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1238/2470] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:16 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:16.695390 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b944c3-c330-42b5-964a-2bd43142f943 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:16.704917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b944c3-c330-42b5-964a-2bd43142f943 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:16.710421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b93697-adcc-4b75-aa7f-693ab6e91e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:16.711047 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b93697-adcc-4b75-aa7f-693ab6e91e9c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.711334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b93697-adcc-4b75-aa7f-693ab6e91e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.711605 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b93697-adcc-4b75-aa7f-693ab6e91e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.712339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b93697-adcc-4b75-aa7f-693ab6e91e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:16.713980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b93697-adcc-4b75-aa7f-693ab6e91e9c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:16.724825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1233/2471] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:16.729487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36015339-098e-4569-922c-d90dbd8265a0 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:16.739824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36015339-098e-4569-922c-d90dbd8265a0 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:16.744766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ada8-8aa7-4bad-bf4d-cb0b91ab0f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:16.745602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ada8-8aa7-4bad-bf4d-cb0b91ab0f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.745945 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ada8-8aa7-4bad-bf4d-cb0b91ab0f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.746248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2ada8-8aa7-4bad-bf4d-cb0b91ab0f29 admin admin] PATH_INFO: `/v3/projects/a0e45074d306426f932fe761466c3623/users/43ad42c7f57a45b59f486891ae32d2d1/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.767318 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2ada8-8aa7-4bad-bf4d-cb0b91ab0f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e45074d306426f932fe761466c3623, user_id=43ad42c7f57a45b59f486891ae32d2d1, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:16.770024 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2ada8-8aa7-4bad-bf4d-cb0b91ab0f29 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:16.786693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1239/2472] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:16 2022] PUT /identity/v3/projects/a0e45074d306426f932fe761466c3623/users/43ad42c7f57a45b59f486891ae32d2d1/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:16.788324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b93697-adcc-4b75-aa7f-693ab6e91e9c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:16.798287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b93697-adcc-4b75-aa7f-693ab6e91e9c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:16.863758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292a375-b225-4dcd-9c9b-17df4242719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:16.864385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a375-b225-4dcd-9c9b-17df4242719e admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.864661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a375-b225-4dcd-9c9b-17df4242719e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.864930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a375-b225-4dcd-9c9b-17df4242719e admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.865654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292a375-b225-4dcd-9c9b-17df4242719e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:16.867250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292a375-b225-4dcd-9c9b-17df4242719e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:16.872684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:16.881991 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1234/2473] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:16.883572 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ada8-8aa7-4bad-bf4d-cb0b91ab0f29 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:16.897446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2ada8-8aa7-4bad-bf4d-cb0b91ab0f29 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:16.904341 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b9bce-8b93-467c-96c8-4f53ce17eeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:16.904341 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b9bce-8b93-467c-96c8-4f53ce17eeb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.904341 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b9bce-8b93-467c-96c8-4f53ce17eeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.904341 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b9bce-8b93-467c-96c8-4f53ce17eeb8 admin admin] PATH_INFO: `/v3/projects/a0e45074d306426f932fe761466c3623/users/43ad42c7f57a45b59f486891ae32d2d1/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.906799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b9bce-8b93-467c-96c8-4f53ce17eeb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e45074d306426f932fe761466c3623, user_id=43ad42c7f57a45b59f486891ae32d2d1, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:16.909861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b9bce-8b93-467c-96c8-4f53ce17eeb8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:16.923118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1240/2474] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:16 2022] PUT /identity/v3/projects/a0e45074d306426f932fe761466c3623/users/43ad42c7f57a45b59f486891ae32d2d1/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:16.933990 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5a5b5-852f-4552-9815-1c740774bbd2 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:16.934280 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5a5b5-852f-4552-9815-1c740774bbd2 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:16.934553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d5a5b5-852f-4552-9815-1c740774bbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:16.965930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-04d5a5b5-852f-4552-9815-1c740774bbd2 None None] MFA Rules not processed for user `43ad42c7f57a45b59f486891ae32d2d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:16.967170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-04d5a5b5-852f-4552-9815-1c740774bbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:17.040684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1235/2475] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:17.052298 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b9bce-8b93-467c-96c8-4f53ce17eeb8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:17.054087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8d0b9bce-8b93-467c-96c8-4f53ce17eeb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:17.113689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b9bce-8b93-467c-96c8-4f53ce17eeb8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:17.117336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc204c-dcbb-4e6b-a799-88ed9bf95f45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:17.117952 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc204c-dcbb-4e6b-a799-88ed9bf95f45 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:17.118336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc204c-dcbb-4e6b-a799-88ed9bf95f45 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:17.118742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc204c-dcbb-4e6b-a799-88ed9bf95f45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:17.127755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc204c-dcbb-4e6b-a799-88ed9bf95f45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:17.129181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc204c-dcbb-4e6b-a799-88ed9bf95f45 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:17.138399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1241/2476] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:17.170644 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5a5b5-852f-4552-9815-1c740774bbd2 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:17.238113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d5a5b5-852f-4552-9815-1c740774bbd2 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:17.243942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:17.244789 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:17.245064 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:17.245351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] PATH_INFO: `/v3/users/6c1542fd11b94dfab340668a8bebfe37` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:17.246557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c1542fd11b94dfab340668a8bebfe37)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:17.248504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:17.306341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c1542fd11b94dfab340668a8bebfe37'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:17.314228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c1542fd11b94dfab340668a8bebfe37'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:17.314995 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c1542fd11b94dfab340668a8bebfe37'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:17.327239 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c1542fd11b94dfab340668a8bebfe37'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:17.327887 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c1542fd11b94dfab340668a8bebfe37'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:17.342827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1236/2477] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:17 2022] DELETE /identity/v3/users/6c1542fd11b94dfab340668a8bebfe37 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:17.347660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a529ea-a8f0-45cd-bf31-dcef99446149 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:17.348152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a529ea-a8f0-45cd-bf31-dcef99446149 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:17.348264 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a529ea-a8f0-45cd-bf31-dcef99446149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:17.368469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e3a529ea-a8f0-45cd-bf31-dcef99446149 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:17.369716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e3a529ea-a8f0-45cd-bf31-dcef99446149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:17.420269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:17.437045 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1242/2478] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:17.447019 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:17.448443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:17.455283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:17.509602 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6d2c6-0e9c-4f02-8588-8f722709a1d8 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:17.513498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111080-c1bc-49f3-a70b-8754cd51fd5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:17.514117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111080-c1bc-49f3-a70b-8754cd51fd5f service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:17.514397 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111080-c1bc-49f3-a70b-8754cd51fd5f service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:17.514668 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111080-c1bc-49f3-a70b-8754cd51fd5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:17.523710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd111080-c1bc-49f3-a70b-8754cd51fd5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:17.525219 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd111080-c1bc-49f3-a70b-8754cd51fd5f service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:17.534655 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1237/2479] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:17.823307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a529ea-a8f0-45cd-bf31-dcef99446149 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:17.824828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e3a529ea-a8f0-45cd-bf31-dcef99446149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:17.838094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a529ea-a8f0-45cd-bf31-dcef99446149 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:17.843506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:17.844174 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:17.844454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:17.844727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] PATH_INFO: `/v3/projects/618e994499cc40a29a14dc9471148176` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:17.845941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=618e994499cc40a29a14dc9471148176)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:17.847887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:17.901676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618e994499cc40a29a14dc9471148176', 'request_id': 'req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:17.910985 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618e994499cc40a29a14dc9471148176', 'request_id': 'req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:17.917575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618e994499cc40a29a14dc9471148176', 'request_id': 'req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:17.929642 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] The token cache is being invalidate because project 618e994499cc40a29a14dc9471148176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:17.929930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:17.933047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:17.933047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1243/2480] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:17 2022] DELETE /identity/v3/projects/618e994499cc40a29a14dc9471148176 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:17.937666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111080-c1bc-49f3-a70b-8754cd51fd5f service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:17.949396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111080-c1bc-49f3-a70b-8754cd51fd5f service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:18.016105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8ff3f-2863-47b3-aec4-296395b6436f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:18.016793 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ff3f-2863-47b3-aec4-296395b6436f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:18.017203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ff3f-2863-47b3-aec4-296395b6436f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:18.017512 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ff3f-2863-47b3-aec4-296395b6436f admin admin] PATH_INFO: `/v3/users/43ad42c7f57a45b59f486891ae32d2d1` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:18.019098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8ff3f-2863-47b3-aec4-296395b6436f admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ad42c7f57a45b59f486891ae32d2d1)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:18.021204 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8ff3f-2863-47b3-aec4-296395b6436f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:18.079425 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-22f8ff3f-2863-47b3-aec4-296395b6436f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ad42c7f57a45b59f486891ae32d2d1'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:18.089037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-22f8ff3f-2863-47b3-aec4-296395b6436f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ad42c7f57a45b59f486891ae32d2d1'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:18.089919 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-22f8ff3f-2863-47b3-aec4-296395b6436f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ad42c7f57a45b59f486891ae32d2d1'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:18.104231 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-22f8ff3f-2863-47b3-aec4-296395b6436f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ad42c7f57a45b59f486891ae32d2d1'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:18.105015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-22f8ff3f-2863-47b3-aec4-296395b6436f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ad42c7f57a45b59f486891ae32d2d1'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:18.120780 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1238/2481] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:17 2022] DELETE /identity/v3/users/43ad42c7f57a45b59f486891ae32d2d1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:18.424226 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:18.428137 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:18.441151 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4bb96-f09d-4f70-bf03-484a2a7f6bbe admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:18.509868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:18.510544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:18.510844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:18.511186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77 admin admin] PATH_INFO: `/v3/projects/a0e45074d306426f932fe761466c3623` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:18.512678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e45074d306426f932fe761466c3623)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:18.514852 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:18.568156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e45074d306426f932fe761466c3623', 'request_id': 'req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:18.576929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e45074d306426f932fe761466c3623', 'request_id': 'req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:18.583615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e45074d306426f932fe761466c3623', 'request_id': 'req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:18.595633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77 admin admin] The token cache is being invalidate because project a0e45074d306426f932fe761466c3623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:18.595925 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:18.596674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1e501fe4-a717-4ebb-b2b3-3c665ecf3a77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:18.598395 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1244/2482] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:18 2022] DELETE /identity/v3/projects/a0e45074d306426f932fe761466c3623 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:18.603566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b604-1d9a-41d5-9fae-049acfd7d605 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:18.604089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b604-1d9a-41d5-9fae-049acfd7d605 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:18.604089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6b604-1d9a-41d5-9fae-049acfd7d605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:18.625255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cda6b604-1d9a-41d5-9fae-049acfd7d605 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:18.626559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cda6b604-1d9a-41d5-9fae-049acfd7d605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:18.648022 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:18.700098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1239/2483] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:18.711406 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a0600-8462-41c5-a7cc-f40ce7aba704 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:18.712121 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a0600-8462-41c5-a7cc-f40ce7aba704 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:18.712760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a0600-8462-41c5-a7cc-f40ce7aba704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:18.724109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:18.748388 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5e3a0600-8462-41c5-a7cc-f40ce7aba704 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:18.750118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5e3a0600-8462-41c5-a7cc-f40ce7aba704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:18.759809 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1245/2484] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:18.764722 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6b604-1d9a-41d5-9fae-049acfd7d605 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:18.779431 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6b604-1d9a-41d5-9fae-049acfd7d605 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:18.784711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9776d43-870a-498a-9892-a58013ffc20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:18.785394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776d43-870a-498a-9892-a58013ffc20e admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:18.785659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776d43-870a-498a-9892-a58013ffc20e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:18.785953 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9776d43-870a-498a-9892-a58013ffc20e admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:18.786667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9776d43-870a-498a-9892-a58013ffc20e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:18.786969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9776d43-870a-498a-9892-a58013ffc20e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:18.788660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9776d43-870a-498a-9892-a58013ffc20e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:18.802500 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1240/2485] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:18.807417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a0600-8462-41c5-a7cc-f40ce7aba704 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:18.817897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a0600-8462-41c5-a7cc-f40ce7aba704 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:18.823349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff7d91-92dd-4657-bfb1-c275946a084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:18.823989 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff7d91-92dd-4657-bfb1-c275946a084e admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:18.824264 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff7d91-92dd-4657-bfb1-c275946a084e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:18.824618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff7d91-92dd-4657-bfb1-c275946a084e admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:18.825363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff7d91-92dd-4657-bfb1-c275946a084e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:18.827306 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff7d91-92dd-4657-bfb1-c275946a084e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:18.861487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1246/2486] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:18 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:18.863082 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9776d43-870a-498a-9892-a58013ffc20e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:18.874714 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9776d43-870a-498a-9892-a58013ffc20e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:18.937581 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c700058-0147-46b0-9ad8-8759206bfd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:18.938997 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c700058-0147-46b0-9ad8-8759206bfd46 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:18.939324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c700058-0147-46b0-9ad8-8759206bfd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:18.939653 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c700058-0147-46b0-9ad8-8759206bfd46 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:18.940529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c700058-0147-46b0-9ad8-8759206bfd46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:18.942815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c700058-0147-46b0-9ad8-8759206bfd46 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:18.970108 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1241/2487] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:18 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:18.974481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff7d91-92dd-4657-bfb1-c275946a084e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:18.985008 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff7d91-92dd-4657-bfb1-c275946a084e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:18.989748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b0a77-cd67-4112-9a3e-12a29ae09f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:18.990379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b0a77-cd67-4112-9a3e-12a29ae09f98 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:18.990662 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b0a77-cd67-4112-9a3e-12a29ae09f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:18.990934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b0a77-cd67-4112-9a3e-12a29ae09f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:18.991632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b0a77-cd67-4112-9a3e-12a29ae09f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:18.993303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b0a77-cd67-4112-9a3e-12a29ae09f98 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:19.004289 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1247/2488] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:19.008635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c700058-0147-46b0-9ad8-8759206bfd46 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:19.019494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c700058-0147-46b0-9ad8-8759206bfd46 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:19.024415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468efae2-dd0e-4418-a613-0ef994c0ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:19.025061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468efae2-dd0e-4418-a613-0ef994c0ace8 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.025383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468efae2-dd0e-4418-a613-0ef994c0ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.025662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468efae2-dd0e-4418-a613-0ef994c0ace8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.026378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468efae2-dd0e-4418-a613-0ef994c0ace8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:19.028041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468efae2-dd0e-4418-a613-0ef994c0ace8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:19.042453 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1242/2489] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:19.046913 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b0a77-cd67-4112-9a3e-12a29ae09f98 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:19.058071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b0a77-cd67-4112-9a3e-12a29ae09f98 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:19.063808 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8901-8ca6-4b47-946a-6af072ba73a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:19.064486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8901-8ca6-4b47-946a-6af072ba73a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.064769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8901-8ca6-4b47-946a-6af072ba73a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.065027 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8901-8ca6-4b47-946a-6af072ba73a1 admin admin] PATH_INFO: `/v3/projects/cfc79a7ef3dd47a6a5900655cce665bf/users/37321397de854f64b36752285f5cc875/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.081062 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e8901-8ca6-4b47-946a-6af072ba73a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc79a7ef3dd47a6a5900655cce665bf, user_id=37321397de854f64b36752285f5cc875, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:19.084107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e8901-8ca6-4b47-946a-6af072ba73a1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:19.098700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1248/2490] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:19 2022] PUT /identity/v3/projects/cfc79a7ef3dd47a6a5900655cce665bf/users/37321397de854f64b36752285f5cc875/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:19.109706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b526-c922-46c5-99c8-6323e9f40645 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.109972 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b526-c922-46c5-99c8-6323e9f40645 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.110251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b526-c922-46c5-99c8-6323e9f40645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.140476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-90c6b526-c922-46c5-99c8-6323e9f40645 None None] MFA Rules not processed for user `37321397de854f64b36752285f5cc875`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:19.141756 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-90c6b526-c922-46c5-99c8-6323e9f40645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:19.205044 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1243/2491] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:19.209762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8901-8ca6-4b47-946a-6af072ba73a1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:19.275216 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8901-8ca6-4b47-946a-6af072ba73a1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:19.279873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b3e23-bdb3-49a0-b04c-172b8ec839af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:19.280489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b3e23-bdb3-49a0-b04c-172b8ec839af admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.280763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b3e23-bdb3-49a0-b04c-172b8ec839af admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.281032 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b3e23-bdb3-49a0-b04c-172b8ec839af admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.281745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b3e23-bdb3-49a0-b04c-172b8ec839af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:19.283646 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b3e23-bdb3-49a0-b04c-172b8ec839af admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:19.319613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1249/2492] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:19 2022] POST /identity/v3/projects => generated 393 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:19.323766 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6b526-c922-46c5-99c8-6323e9f40645 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:19.335476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6b526-c922-46c5-99c8-6323e9f40645 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:19.355328 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:19.406555 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e424f9-6636-4bcf-8e6e-15daf84c1f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:19.407279 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e424f9-6636-4bcf-8e6e-15daf84c1f57 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.407564 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e424f9-6636-4bcf-8e6e-15daf84c1f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.407838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e424f9-6636-4bcf-8e6e-15daf84c1f57 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.408509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e424f9-6636-4bcf-8e6e-15daf84c1f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:19.410498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e424f9-6636-4bcf-8e6e-15daf84c1f57 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:19.437923 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1244/2493] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:19 2022] POST /identity/v3/users => generated 303 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:19.439299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b3e23-bdb3-49a0-b04c-172b8ec839af admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:19.453336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b3e23-bdb3-49a0-b04c-172b8ec839af admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:19.458603 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a51b4b-bd65-41b1-9d4a-8356226b65ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:19.459291 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a51b4b-bd65-41b1-9d4a-8356226b65ec admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.459640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a51b4b-bd65-41b1-9d4a-8356226b65ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.459979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a51b4b-bd65-41b1-9d4a-8356226b65ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.460750 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a51b4b-bd65-41b1-9d4a-8356226b65ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:19.462516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a51b4b-bd65-41b1-9d4a-8356226b65ec admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:19.479463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1250/2494] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:19.482575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e424f9-6636-4bcf-8e6e-15daf84c1f57 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:19.494887 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e424f9-6636-4bcf-8e6e-15daf84c1f57 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:19.500870 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1d673-b491-4890-a033-52cb30b9899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:19.501682 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1d673-b491-4890-a033-52cb30b9899b admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.502041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1d673-b491-4890-a033-52cb30b9899b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.502373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1d673-b491-4890-a033-52cb30b9899b admin admin] PATH_INFO: `/v3/projects/ef763fe2c063472d9ff8da6682ac941e/users/8f5dc6eb2ad74564bd2a22861eca78d7/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.523950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1d673-b491-4890-a033-52cb30b9899b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef763fe2c063472d9ff8da6682ac941e, user_id=8f5dc6eb2ad74564bd2a22861eca78d7, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:19.524434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1d673-b491-4890-a033-52cb30b9899b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:19.525159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a51b4b-bd65-41b1-9d4a-8356226b65ec admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:19.526960 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d0a51b4b-bd65-41b1-9d4a-8356226b65ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:19.540093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a51b4b-bd65-41b1-9d4a-8356226b65ec admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:19.541894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1245/2495] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:19 2022] PUT /identity/v3/projects/ef763fe2c063472d9ff8da6682ac941e/users/8f5dc6eb2ad74564bd2a22861eca78d7/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:19.545674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1d673-b491-4890-a033-52cb30b9899b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:19.621626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1d673-b491-4890-a033-52cb30b9899b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:19.622476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c17ee-5b32-4a4e-a5a5-22f430705e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:19.622662 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c17ee-5b32-4a4e-a5a5-22f430705e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.623020 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c17ee-5b32-4a4e-a5a5-22f430705e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.623329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c17ee-5b32-4a4e-a5a5-22f430705e12 admin admin] PATH_INFO: `/v3/users/f8c2978579a74318963f58d3daf81850` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.624671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c17ee-5b32-4a4e-a5a5-22f430705e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c2978579a74318963f58d3daf81850)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:19.627075 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c17ee-5b32-4a4e-a5a5-22f430705e12 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:19.627243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea3cc-cee1-44ef-9ded-d47922f2d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:19.633687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea3cc-cee1-44ef-9ded-d47922f2d6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.633687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea3cc-cee1-44ef-9ded-d47922f2d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.633687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea3cc-cee1-44ef-9ded-d47922f2d6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.633687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ea3cc-cee1-44ef-9ded-d47922f2d6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:19.633687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ea3cc-cee1-44ef-9ded-d47922f2d6a9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:19.642904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:19.649366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1246/2496] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:19.653473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea3cc-cee1-44ef-9ded-d47922f2d6a9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:19.663537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea3cc-cee1-44ef-9ded-d47922f2d6a9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:19.668593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed817fdd-9490-4a14-8ee1-ee58e2d06e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:19.669235 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed817fdd-9490-4a14-8ee1-ee58e2d06e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.669568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed817fdd-9490-4a14-8ee1-ee58e2d06e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.669816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed817fdd-9490-4a14-8ee1-ee58e2d06e66 admin admin] PATH_INFO: `/v3/projects/ef763fe2c063472d9ff8da6682ac941e/users/8f5dc6eb2ad74564bd2a22861eca78d7/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.671911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed817fdd-9490-4a14-8ee1-ee58e2d06e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef763fe2c063472d9ff8da6682ac941e, user_id=8f5dc6eb2ad74564bd2a22861eca78d7, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:19.674677 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed817fdd-9490-4a14-8ee1-ee58e2d06e66 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:19.681605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ba5c17ee-5b32-4a4e-a5a5-22f430705e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c2978579a74318963f58d3daf81850'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:19.685558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1247/2497] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:19 2022] PUT /identity/v3/projects/ef763fe2c063472d9ff8da6682ac941e/users/8f5dc6eb2ad74564bd2a22861eca78d7/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:19.692718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ba5c17ee-5b32-4a4e-a5a5-22f430705e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c2978579a74318963f58d3daf81850'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:19.697596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade07654-7a36-4159-b5aa-735667cc7467 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.697852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade07654-7a36-4159-b5aa-735667cc7467 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.698123 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade07654-7a36-4159-b5aa-735667cc7467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.704342 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ba5c17ee-5b32-4a4e-a5a5-22f430705e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c2978579a74318963f58d3daf81850'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:19.705173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ba5c17ee-5b32-4a4e-a5a5-22f430705e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c2978579a74318963f58d3daf81850'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:19.720170 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ba5c17ee-5b32-4a4e-a5a5-22f430705e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c2978579a74318963f58d3daf81850'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:19.728074 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1251/2498] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:19 2022] DELETE /identity/v3/users/f8c2978579a74318963f58d3daf81850 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:19.732791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06e3f7-ce69-46f3-9a35-8d327796744d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.733091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06e3f7-ce69-46f3-9a35-8d327796744d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.733571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06e3f7-ce69-46f3-9a35-8d327796744d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.736341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ade07654-7a36-4159-b5aa-735667cc7467 None None] MFA Rules not processed for user `8f5dc6eb2ad74564bd2a22861eca78d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:19.737813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ade07654-7a36-4159-b5aa-735667cc7467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:19.754025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8f06e3f7-ce69-46f3-9a35-8d327796744d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:19.755337 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8f06e3f7-ce69-46f3-9a35-8d327796744d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:19.803361 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:19.813834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1248/2499] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:19.817477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1252/2500] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:19.825427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade07654-7a36-4159-b5aa-735667cc7467 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:19.827935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06e3f7-ce69-46f3-9a35-8d327796744d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:19.834648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8f06e3f7-ce69-46f3-9a35-8d327796744d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:19.836305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ade07654-7a36-4159-b5aa-735667cc7467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:19.891919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06e3f7-ce69-46f3-9a35-8d327796744d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:19.893668 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade07654-7a36-4159-b5aa-735667cc7467 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:19.895861 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72635667-f80e-4bc2-8fdb-41327254e169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:19.896491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72635667-f80e-4bc2-8fdb-41327254e169 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.896770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72635667-f80e-4bc2-8fdb-41327254e169 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.897023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72635667-f80e-4bc2-8fdb-41327254e169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.897408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ed9e1-16f0-4289-be29-bc859da602a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:19.898035 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ed9e1-16f0-4289-be29-bc859da602a5 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.898317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ed9e1-16f0-4289-be29-bc859da602a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.898587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ed9e1-16f0-4289-be29-bc859da602a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.907434 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72635667-f80e-4bc2-8fdb-41327254e169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:19.908077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ed9e1-16f0-4289-be29-bc859da602a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:19.908902 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72635667-f80e-4bc2-8fdb-41327254e169 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:19.909572 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ed9e1-16f0-4289-be29-bc859da602a5 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:19.919616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1249/2501] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:19.920413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1253/2502] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:51:19.972623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ed9e1-16f0-4289-be29-bc859da602a5 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:19.974118 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f63ed9e1-16f0-4289-be29-bc859da602a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:19.985818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ed9e1-16f0-4289-be29-bc859da602a5 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:19.989824 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55587c6a-4203-49b1-a6e1-7d4efda6071d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:19.990451 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55587c6a-4203-49b1-a6e1-7d4efda6071d service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:19.990795 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55587c6a-4203-49b1-a6e1-7d4efda6071d service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:19.991107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55587c6a-4203-49b1-a6e1-7d4efda6071d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:19.993199 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-55587c6a-4203-49b1-a6e1-7d4efda6071d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:20.060127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55587c6a-4203-49b1-a6e1-7d4efda6071d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:20.061541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55587c6a-4203-49b1-a6e1-7d4efda6071d service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:20.071283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1250/2503] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:20.231995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72635667-f80e-4bc2-8fdb-41327254e169 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:20.233674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-72635667-f80e-4bc2-8fdb-41327254e169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:20.269122 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72635667-f80e-4bc2-8fdb-41327254e169 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:20.274647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:20.275391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:20.275815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:20.276137 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] PATH_INFO: `/v3/projects/78b5c854d5aa4f52a1e387be458313c7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:20.277648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b5c854d5aa4f52a1e387be458313c7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:20.279416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:20.317488 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:20.334142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b5c854d5aa4f52a1e387be458313c7', 'request_id': 'req-3ec35be4-bc97-4449-9d49-e4c90b5895b3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:20.354769 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b5c854d5aa4f52a1e387be458313c7', 'request_id': 'req-3ec35be4-bc97-4449-9d49-e4c90b5895b3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:20.366905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b5c854d5aa4f52a1e387be458313c7', 'request_id': 'req-3ec35be4-bc97-4449-9d49-e4c90b5895b3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:20.382147 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] The token cache is being invalidate because project 78b5c854d5aa4f52a1e387be458313c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:20.382446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:20.383106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:20.384947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1254/2504] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:20 2022] DELETE /identity/v3/projects/78b5c854d5aa4f52a1e387be458313c7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:20.389090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55587c6a-4203-49b1-a6e1-7d4efda6071d service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:20.401035 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55587c6a-4203-49b1-a6e1-7d4efda6071d service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:20.466427 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d942b-ae80-4a4d-96e3-91d4e1dcce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:20.467076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d942b-ae80-4a4d-96e3-91d4e1dcce40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:20.467350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d942b-ae80-4a4d-96e3-91d4e1dcce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:20.467617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d942b-ae80-4a4d-96e3-91d4e1dcce40 admin admin] PATH_INFO: `/v3/users/381393ea9bba4646b4c636f479ae6443` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:20.468834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d942b-ae80-4a4d-96e3-91d4e1dcce40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381393ea9bba4646b4c636f479ae6443)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:20.470881 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d942b-ae80-4a4d-96e3-91d4e1dcce40 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:20.519407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:20.528961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-811d942b-ae80-4a4d-96e3-91d4e1dcce40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381393ea9bba4646b4c636f479ae6443'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:20.538324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-811d942b-ae80-4a4d-96e3-91d4e1dcce40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381393ea9bba4646b4c636f479ae6443'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:20.539120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-811d942b-ae80-4a4d-96e3-91d4e1dcce40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381393ea9bba4646b4c636f479ae6443'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:20.552392 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-811d942b-ae80-4a4d-96e3-91d4e1dcce40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381393ea9bba4646b4c636f479ae6443'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:20.553178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-811d942b-ae80-4a4d-96e3-91d4e1dcce40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381393ea9bba4646b4c636f479ae6443'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:20.568077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1251/2505] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:20 2022] DELETE /identity/v3/users/381393ea9bba4646b4c636f479ae6443 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:20.883761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:20.885480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:20.899599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec35be4-bc97-4449-9d49-e4c90b5895b3 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:20.963504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0943-62e1-40b8-bac1-5f0fed784c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:20.964153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0943-62e1-40b8-bac1-5f0fed784c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:20.964431 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0943-62e1-40b8-bac1-5f0fed784c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:20.964700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0943-62e1-40b8-bac1-5f0fed784c7f admin admin] PATH_INFO: `/v3/projects/8951ae98b24e42b6b74dcbf4802fa302` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:20.965898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b0943-62e1-40b8-bac1-5f0fed784c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8951ae98b24e42b6b74dcbf4802fa302)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:20.967818 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b0943-62e1-40b8-bac1-5f0fed784c7f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:21.026575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-042b0943-62e1-40b8-bac1-5f0fed784c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8951ae98b24e42b6b74dcbf4802fa302', 'request_id': 'req-042b0943-62e1-40b8-bac1-5f0fed784c7f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:21.034661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-042b0943-62e1-40b8-bac1-5f0fed784c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8951ae98b24e42b6b74dcbf4802fa302', 'request_id': 'req-042b0943-62e1-40b8-bac1-5f0fed784c7f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:21.040346 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-042b0943-62e1-40b8-bac1-5f0fed784c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8951ae98b24e42b6b74dcbf4802fa302', 'request_id': 'req-042b0943-62e1-40b8-bac1-5f0fed784c7f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:21.051698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-042b0943-62e1-40b8-bac1-5f0fed784c7f admin admin] The token cache is being invalidate because project 8951ae98b24e42b6b74dcbf4802fa302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:21.051977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-042b0943-62e1-40b8-bac1-5f0fed784c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:21.052641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-042b0943-62e1-40b8-bac1-5f0fed784c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:21.054211 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1255/2506] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:20 2022] DELETE /identity/v3/projects/8951ae98b24e42b6b74dcbf4802fa302 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:21.059466 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cb5bc-8d75-4eaa-92bd-5a7eae048745 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:21.059976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cb5bc-8d75-4eaa-92bd-5a7eae048745 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:21.060086 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cb5bc-8d75-4eaa-92bd-5a7eae048745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:21.082838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-226cb5bc-8d75-4eaa-92bd-5a7eae048745 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:21.084372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-226cb5bc-8d75-4eaa-92bd-5a7eae048745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:21.146489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1252/2507] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:21.154983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0da31e-8e9f-47e2-b184-72cb1312c787 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:21.155361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0da31e-8e9f-47e2-b184-72cb1312c787 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:21.155640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0da31e-8e9f-47e2-b184-72cb1312c787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:21.310194 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-3c0da31e-8e9f-47e2-b184-72cb1312c787 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:21.311417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3c0da31e-8e9f-47e2-b184-72cb1312c787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:21.319937 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1256/2508] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:21.324752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cb5bc-8d75-4eaa-92bd-5a7eae048745 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:21.337324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cb5bc-8d75-4eaa-92bd-5a7eae048745 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:21.345686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186baf8a-0633-4337-9fdb-76d944d71fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:21.346662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186baf8a-0633-4337-9fdb-76d944d71fce admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:21.347005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186baf8a-0633-4337-9fdb-76d944d71fce admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:21.347440 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186baf8a-0633-4337-9fdb-76d944d71fce admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:21.348630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186baf8a-0633-4337-9fdb-76d944d71fce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:21.349106 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186baf8a-0633-4337-9fdb-76d944d71fce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:21.351615 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186baf8a-0633-4337-9fdb-76d944d71fce admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:21.364928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1253/2509] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:21.369718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0da31e-8e9f-47e2-b184-72cb1312c787 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:21.379380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0da31e-8e9f-47e2-b184-72cb1312c787 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:21.384855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418d519-8ec9-4679-a119-50f1c78930ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:21.385518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418d519-8ec9-4679-a119-50f1c78930ed admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:21.385820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418d519-8ec9-4679-a119-50f1c78930ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:21.386090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418d519-8ec9-4679-a119-50f1c78930ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:21.386763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418d519-8ec9-4679-a119-50f1c78930ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:21.388739 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418d519-8ec9-4679-a119-50f1c78930ed admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:21.420477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1257/2510] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:21 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:21.424781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186baf8a-0633-4337-9fdb-76d944d71fce admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:21.437159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186baf8a-0633-4337-9fdb-76d944d71fce admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:21.502527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c57b5-9eff-482f-b446-2b78112bedbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:21.503150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c57b5-9eff-482f-b446-2b78112bedbc admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:21.503426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c57b5-9eff-482f-b446-2b78112bedbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:21.503695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c57b5-9eff-482f-b446-2b78112bedbc admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:21.504372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c57b5-9eff-482f-b446-2b78112bedbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:21.506365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c57b5-9eff-482f-b446-2b78112bedbc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:21.528807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1254/2511] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:21 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:21.533259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418d519-8ec9-4679-a119-50f1c78930ed admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:21.545061 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418d519-8ec9-4679-a119-50f1c78930ed admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:21.549897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194ffee-b108-4100-8f04-ac25c2ec2010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:21.550558 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194ffee-b108-4100-8f04-ac25c2ec2010 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:21.550840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194ffee-b108-4100-8f04-ac25c2ec2010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:21.551115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194ffee-b108-4100-8f04-ac25c2ec2010 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:21.551821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194ffee-b108-4100-8f04-ac25c2ec2010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:21.553463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194ffee-b108-4100-8f04-ac25c2ec2010 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:21.569896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1258/2512] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:21.570310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c57b5-9eff-482f-b446-2b78112bedbc admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:21.578311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c57b5-9eff-482f-b446-2b78112bedbc admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:21.585196 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4bede-9da3-4eef-89c6-0be7b96dbf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:21.585876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4bede-9da3-4eef-89c6-0be7b96dbf07 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:21.586159 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4bede-9da3-4eef-89c6-0be7b96dbf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:21.586446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4bede-9da3-4eef-89c6-0be7b96dbf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:21.587227 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4bede-9da3-4eef-89c6-0be7b96dbf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:21.588910 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4bede-9da3-4eef-89c6-0be7b96dbf07 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:21.603098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1255/2513] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:21.611134 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194ffee-b108-4100-8f04-ac25c2ec2010 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:21.622499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194ffee-b108-4100-8f04-ac25c2ec2010 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:21.627303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e283545-b9b2-47fc-a7ac-b27098cbb204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:21.628578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e283545-b9b2-47fc-a7ac-b27098cbb204 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:21.628918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e283545-b9b2-47fc-a7ac-b27098cbb204 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:21.629248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e283545-b9b2-47fc-a7ac-b27098cbb204 admin admin] PATH_INFO: `/v3/projects/05c178ec368f404fa5361024f43ddb52/users/431174dacf0545908fdac93657459829/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:21.638512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:21.657331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e283545-b9b2-47fc-a7ac-b27098cbb204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05c178ec368f404fa5361024f43ddb52, user_id=431174dacf0545908fdac93657459829, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:21.660588 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e283545-b9b2-47fc-a7ac-b27098cbb204 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:21.677954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1259/2514] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:21 2022] PUT /identity/v3/projects/05c178ec368f404fa5361024f43ddb52/users/431174dacf0545908fdac93657459829/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:21.690283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe852e3-7d6c-438b-89dc-c460863193ee None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:21.690571 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe852e3-7d6c-438b-89dc-c460863193ee None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:21.690849 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe852e3-7d6c-438b-89dc-c460863193ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:21.719504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-dfe852e3-7d6c-438b-89dc-c460863193ee None None] MFA Rules not processed for user `431174dacf0545908fdac93657459829`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:21.720722 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-dfe852e3-7d6c-438b-89dc-c460863193ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:21.730145 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:21.793830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1256/2515] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:21.798670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e283545-b9b2-47fc-a7ac-b27098cbb204 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:21.865525 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e283545-b9b2-47fc-a7ac-b27098cbb204 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:21.870305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cb5e7-2327-4083-a026-91c59eef1b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:21.870910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cb5e7-2327-4083-a026-91c59eef1b9d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:21.871299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cb5e7-2327-4083-a026-91c59eef1b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:21.871453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cb5e7-2327-4083-a026-91c59eef1b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:21.872124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cb5e7-2327-4083-a026-91c59eef1b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:21.874073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157cb5e7-2327-4083-a026-91c59eef1b9d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:21.904220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1260/2516] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:21 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:21.908624 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe852e3-7d6c-438b-89dc-c460863193ee None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:21.920857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe852e3-7d6c-438b-89dc-c460863193ee None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:21.984450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9eeacc-1258-4e4a-a4b6-4d6daff2dcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:21.985213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eeacc-1258-4e4a-a4b6-4d6daff2dcf1 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:21.985530 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eeacc-1258-4e4a-a4b6-4d6daff2dcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:21.985802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9eeacc-1258-4e4a-a4b6-4d6daff2dcf1 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:21.986478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9eeacc-1258-4e4a-a4b6-4d6daff2dcf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:21.988415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9eeacc-1258-4e4a-a4b6-4d6daff2dcf1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:22.013778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1257/2517] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:21 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:22.017708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cb5e7-2327-4083-a026-91c59eef1b9d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:22.029033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157cb5e7-2327-4083-a026-91c59eef1b9d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:22.035864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4468b9-bbee-49a7-a284-4eaaf8a61cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:22.036130 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4468b9-bbee-49a7-a284-4eaaf8a61cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:22.036404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4468b9-bbee-49a7-a284-4eaaf8a61cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:22.036670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4468b9-bbee-49a7-a284-4eaaf8a61cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:22.037411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4468b9-bbee-49a7-a284-4eaaf8a61cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:22.038991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4468b9-bbee-49a7-a284-4eaaf8a61cc7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:22.050416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1261/2518] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:22.060569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9eeacc-1258-4e4a-a4b6-4d6daff2dcf1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:22.077715 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9eeacc-1258-4e4a-a4b6-4d6daff2dcf1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:22.084185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8173e65-d589-44f5-8d14-888d8e2195ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:22.084868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8173e65-d589-44f5-8d14-888d8e2195ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:22.085149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8173e65-d589-44f5-8d14-888d8e2195ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:22.085486 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8173e65-d589-44f5-8d14-888d8e2195ce admin admin] PATH_INFO: `/v3/projects/36bc23149067449a822174d1d588f7d7/users/954ece258bd9420f8ac098371b9a5cb7/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:22.103792 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8173e65-d589-44f5-8d14-888d8e2195ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bc23149067449a822174d1d588f7d7, user_id=954ece258bd9420f8ac098371b9a5cb7, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:22.106707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8173e65-d589-44f5-8d14-888d8e2195ce admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:22.122229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1258/2519] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:22 2022] PUT /identity/v3/projects/36bc23149067449a822174d1d588f7d7/users/954ece258bd9420f8ac098371b9a5cb7/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:22.126504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4468b9-bbee-49a7-a284-4eaaf8a61cc7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:22.138471 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4468b9-bbee-49a7-a284-4eaaf8a61cc7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:22.199407 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8d5a8-4384-4ea8-9626-8e4ec2c62d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:22.200035 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8d5a8-4384-4ea8-9626-8e4ec2c62d8c admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:22.200312 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8d5a8-4384-4ea8-9626-8e4ec2c62d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:22.200585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8d5a8-4384-4ea8-9626-8e4ec2c62d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:22.201299 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8d5a8-4384-4ea8-9626-8e4ec2c62d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:22.202949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8d5a8-4384-4ea8-9626-8e4ec2c62d8c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:22.217438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1262/2520] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:22.219136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8173e65-d589-44f5-8d14-888d8e2195ce admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:22.231298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8173e65-d589-44f5-8d14-888d8e2195ce admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:22.236175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8064a-10a1-4106-b635-94b4e3d4951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:22.236855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8064a-10a1-4106-b635-94b4e3d4951e admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:22.237132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8064a-10a1-4106-b635-94b4e3d4951e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:22.237443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8064a-10a1-4106-b635-94b4e3d4951e admin admin] PATH_INFO: `/v3/projects/36bc23149067449a822174d1d588f7d7/users/954ece258bd9420f8ac098371b9a5cb7/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:22.239474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8064a-10a1-4106-b635-94b4e3d4951e admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bc23149067449a822174d1d588f7d7, user_id=954ece258bd9420f8ac098371b9a5cb7, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:22.242133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8064a-10a1-4106-b635-94b4e3d4951e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:22.252680 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1259/2521] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:22 2022] PUT /identity/v3/projects/36bc23149067449a822174d1d588f7d7/users/954ece258bd9420f8ac098371b9a5cb7/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:22.263631 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c4549-668c-41fe-bd0e-3c8c5a499c8a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:22.263912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c4549-668c-41fe-bd0e-3c8c5a499c8a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:22.264177 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c4549-668c-41fe-bd0e-3c8c5a499c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:22.294334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8a8c4549-668c-41fe-bd0e-3c8c5a499c8a None None] MFA Rules not processed for user `954ece258bd9420f8ac098371b9a5cb7`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:22.295551 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8a8c4549-668c-41fe-bd0e-3c8c5a499c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:22.343412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:22.369785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1263/2522] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:22.381601 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8064a-10a1-4106-b635-94b4e3d4951e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:22.383558 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2eb8064a-10a1-4106-b635-94b4e3d4951e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:22.447030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8064a-10a1-4106-b635-94b4e3d4951e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:22.451333 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ceca92-bb91-4b43-8400-96b4f1138ccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:22.451969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceca92-bb91-4b43-8400-96b4f1138ccd service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:22.452254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceca92-bb91-4b43-8400-96b4f1138ccd service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:22.452562 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ceca92-bb91-4b43-8400-96b4f1138ccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:22.463168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ceca92-bb91-4b43-8400-96b4f1138ccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:22.464620 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ceca92-bb91-4b43-8400-96b4f1138ccd service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:22.474365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1260/2523] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:22.545301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c4549-668c-41fe-bd0e-3c8c5a499c8a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:22.615250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c4549-668c-41fe-bd0e-3c8c5a499c8a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:22.620139 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:22.620730 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:22.621009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:22.621319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] PATH_INFO: `/v3/users/431174dacf0545908fdac93657459829` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:22.622545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=431174dacf0545908fdac93657459829)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:22.624463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:22.685623 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431174dacf0545908fdac93657459829'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:22.693071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431174dacf0545908fdac93657459829'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:22.702550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431174dacf0545908fdac93657459829'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:22.703181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431174dacf0545908fdac93657459829'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:22.721923 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431174dacf0545908fdac93657459829'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:22.728069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1264/2524] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:22 2022] DELETE /identity/v3/users/431174dacf0545908fdac93657459829 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:22.732651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3413b3-a015-4043-afcf-63e0e456ac7a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:22.732963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3413b3-a015-4043-afcf-63e0e456ac7a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:22.733253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3413b3-a015-4043-afcf-63e0e456ac7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:22.747106 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:22.753773 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-fa3413b3-a015-4043-afcf-63e0e456ac7a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:22.755504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fa3413b3-a015-4043-afcf-63e0e456ac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:22.814480 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1261/2525] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:22.824637 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:22.826403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:22.890241 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a1d7-07fd-4625-83e0-8eecfa473922 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:22.894236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbfc03-0f7f-498b-a44f-b0ec74af0808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:22.894854 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbfc03-0f7f-498b-a44f-b0ec74af0808 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:22.895133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbfc03-0f7f-498b-a44f-b0ec74af0808 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:22.895383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbfc03-0f7f-498b-a44f-b0ec74af0808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:22.905100 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbfc03-0f7f-498b-a44f-b0ec74af0808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:22.906585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dbfc03-0f7f-498b-a44f-b0ec74af0808 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:22.916768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1265/2526] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:23.214338 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3413b3-a015-4043-afcf-63e0e456ac7a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:23.215849 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fa3413b3-a015-4043-afcf-63e0e456ac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:23.228624 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3413b3-a015-4043-afcf-63e0e456ac7a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:23.234637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:23.235305 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:23.235585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:23.235857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] PATH_INFO: `/v3/projects/05c178ec368f404fa5361024f43ddb52` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:23.237624 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05c178ec368f404fa5361024f43ddb52)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:23.240843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:23.295649 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05c178ec368f404fa5361024f43ddb52', 'request_id': 'req-9dbc7168-9549-4f73-93a4-d81e630ba687'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.304981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05c178ec368f404fa5361024f43ddb52', 'request_id': 'req-9dbc7168-9549-4f73-93a4-d81e630ba687'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.315081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05c178ec368f404fa5361024f43ddb52', 'request_id': 'req-9dbc7168-9549-4f73-93a4-d81e630ba687'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.330171 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] The token cache is being invalidate because project 05c178ec368f404fa5361024f43ddb52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:23.330483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.331173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.336938 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1262/2527] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:23 2022] DELETE /identity/v3/projects/05c178ec368f404fa5361024f43ddb52 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:23.338814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbfc03-0f7f-498b-a44f-b0ec74af0808 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:23.344788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:23.351641 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbfc03-0f7f-498b-a44f-b0ec74af0808 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:23.422725 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935bc995-4055-437c-b704-bc04b904485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:23.423298 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bc995-4055-437c-b704-bc04b904485d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:23.423602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bc995-4055-437c-b704-bc04b904485d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:23.423868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935bc995-4055-437c-b704-bc04b904485d admin admin] PATH_INFO: `/v3/users/954ece258bd9420f8ac098371b9a5cb7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:23.425147 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bc995-4055-437c-b704-bc04b904485d admin admin] RBAC: Authorizing `identity:delete_user(user_id=954ece258bd9420f8ac098371b9a5cb7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:23.427136 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935bc995-4055-437c-b704-bc04b904485d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:23.490134 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-935bc995-4055-437c-b704-bc04b904485d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954ece258bd9420f8ac098371b9a5cb7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.498225 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-935bc995-4055-437c-b704-bc04b904485d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954ece258bd9420f8ac098371b9a5cb7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.507060 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-935bc995-4055-437c-b704-bc04b904485d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954ece258bd9420f8ac098371b9a5cb7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.507835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-935bc995-4055-437c-b704-bc04b904485d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954ece258bd9420f8ac098371b9a5cb7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.520289 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-935bc995-4055-437c-b704-bc04b904485d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954ece258bd9420f8ac098371b9a5cb7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.527474 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1266/2528] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:23 2022] DELETE /identity/v3/users/954ece258bd9420f8ac098371b9a5cb7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:23.530480 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:23.532411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:23.545760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc7168-9549-4f73-93a4-d81e630ba687 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:23.624443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:23.625139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:23.625470 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:23.625739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] PATH_INFO: `/v3/users/37321397de854f64b36752285f5cc875` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:23.627046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] RBAC: Authorizing `identity:delete_user(user_id=37321397de854f64b36752285f5cc875)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:23.629073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:23.670589 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:23.693624 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37321397de854f64b36752285f5cc875'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.703175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37321397de854f64b36752285f5cc875'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.704015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37321397de854f64b36752285f5cc875'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.719046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37321397de854f64b36752285f5cc875'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.719786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37321397de854f64b36752285f5cc875'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.746421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1263/2529] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:23 2022] DELETE /identity/v3/users/37321397de854f64b36752285f5cc875 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:23.752028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26913927-bafc-40ca-99cb-7e633800e99a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:23.752545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26913927-bafc-40ca-99cb-7e633800e99a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:23.753930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26913927-bafc-40ca-99cb-7e633800e99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:23.779370 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-26913927-bafc-40ca-99cb-7e633800e99a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:23.780911 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-26913927-bafc-40ca-99cb-7e633800e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:23.829318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:23.830946 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:23.853431 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1267/2530] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:23.862692 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26913927-bafc-40ca-99cb-7e633800e99a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:23.864188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-26913927-bafc-40ca-99cb-7e633800e99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:23.891865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:23.906404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f4431-83b1-4a0d-aebd-1a2c7d82405d admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:23.911076 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae04127-2856-46ec-9f81-9bab46d30884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:23.911724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae04127-2856-46ec-9f81-9bab46d30884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:23.911999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae04127-2856-46ec-9f81-9bab46d30884 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:23.912267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae04127-2856-46ec-9f81-9bab46d30884 admin admin] PATH_INFO: `/v3/projects/36bc23149067449a822174d1d588f7d7` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:23.913463 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae04127-2856-46ec-9f81-9bab46d30884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36bc23149067449a822174d1d588f7d7)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:23.915418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae04127-2856-46ec-9f81-9bab46d30884 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:23.925512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26913927-bafc-40ca-99cb-7e633800e99a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:23.929185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a901065-42d4-4990-9e65-52205264fb99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:23.929831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a901065-42d4-4990-9e65-52205264fb99 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:23.930114 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a901065-42d4-4990-9e65-52205264fb99 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:23.930450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a901065-42d4-4990-9e65-52205264fb99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:23.940011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a901065-42d4-4990-9e65-52205264fb99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:23.941396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a901065-42d4-4990-9e65-52205264fb99 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:23.951773 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1268/2531] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:23.969858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9ae04127-2856-46ec-9f81-9bab46d30884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36bc23149067449a822174d1d588f7d7', 'request_id': 'req-9ae04127-2856-46ec-9f81-9bab46d30884'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.976379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9ae04127-2856-46ec-9f81-9bab46d30884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36bc23149067449a822174d1d588f7d7', 'request_id': 'req-9ae04127-2856-46ec-9f81-9bab46d30884'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:23.988290 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9ae04127-2856-46ec-9f81-9bab46d30884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36bc23149067449a822174d1d588f7d7', 'request_id': 'req-9ae04127-2856-46ec-9f81-9bab46d30884'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:24.003632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9ae04127-2856-46ec-9f81-9bab46d30884 admin admin] The token cache is being invalidate because project 36bc23149067449a822174d1d588f7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:24.004226 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9ae04127-2856-46ec-9f81-9bab46d30884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:24.005100 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-9ae04127-2856-46ec-9f81-9bab46d30884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:24.007141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1264/2532] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:23 2022] DELETE /identity/v3/projects/36bc23149067449a822174d1d588f7d7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:24.019505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aa61b-192b-4b1e-b1a5-9a7e71fb15f3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:24.019790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aa61b-192b-4b1e-b1a5-9a7e71fb15f3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:24.020087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aa61b-192b-4b1e-b1a5-9a7e71fb15f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:24.043259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e23aa61b-192b-4b1e-b1a5-9a7e71fb15f3 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:24.044516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e23aa61b-192b-4b1e-b1a5-9a7e71fb15f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:24.156722 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1269/2533] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:24.165983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0bae2-4d80-4e44-836c-55d3443602ef None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:24.166266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0bae2-4d80-4e44-836c-55d3443602ef None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:24.166542 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0bae2-4d80-4e44-836c-55d3443602ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:24.186801 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e8b0bae2-4d80-4e44-836c-55d3443602ef None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:24.188018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e8b0bae2-4d80-4e44-836c-55d3443602ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:24.196555 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1265/2534] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:24.200719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aa61b-192b-4b1e-b1a5-9a7e71fb15f3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:24.211093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aa61b-192b-4b1e-b1a5-9a7e71fb15f3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:24.215896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260f8e8-1621-418e-b82e-35212efd3e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:24.216548 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260f8e8-1621-418e-b82e-35212efd3e1e admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:24.216806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260f8e8-1621-418e-b82e-35212efd3e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:24.217095 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260f8e8-1621-418e-b82e-35212efd3e1e admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:24.218477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260f8e8-1621-418e-b82e-35212efd3e1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:24.218792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260f8e8-1621-418e-b82e-35212efd3e1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:24.220399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260f8e8-1621-418e-b82e-35212efd3e1e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:24.233772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1270/2535] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:24.238237 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0bae2-4d80-4e44-836c-55d3443602ef None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:24.248060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0bae2-4d80-4e44-836c-55d3443602ef None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:24.253428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48e23-0d8a-412e-910a-e045cf9c9cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:24.254149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48e23-0d8a-412e-910a-e045cf9c9cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:24.254428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48e23-0d8a-412e-910a-e045cf9c9cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:24.254697 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d48e23-0d8a-412e-910a-e045cf9c9cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:24.255383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d48e23-0d8a-412e-910a-e045cf9c9cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:24.257556 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d48e23-0d8a-412e-910a-e045cf9c9cd5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:24.265944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260f8e8-1621-418e-b82e-35212efd3e1e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:24.267763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9260f8e8-1621-418e-b82e-35212efd3e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:24.281200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260f8e8-1621-418e-b82e-35212efd3e1e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:24.286409 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:24.287196 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:24.287542 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:24.287910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] PATH_INFO: `/v3/projects/cfc79a7ef3dd47a6a5900655cce665bf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:24.289179 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc79a7ef3dd47a6a5900655cce665bf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:24.290562 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1266/2536] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:24 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:24.291324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:24.296015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48e23-0d8a-412e-910a-e045cf9c9cd5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:24.317887 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:24.343274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc79a7ef3dd47a6a5900655cce665bf', 'request_id': 'req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:24.352057 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc79a7ef3dd47a6a5900655cce665bf', 'request_id': 'req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:24.358720 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc79a7ef3dd47a6a5900655cce665bf', 'request_id': 'req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:24.373981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] The token cache is being invalidate because project cfc79a7ef3dd47a6a5900655cce665bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:24.374286 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:24.375028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:24.376774 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1271/2537] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:24 2022] DELETE /identity/v3/projects/cfc79a7ef3dd47a6a5900655cce665bf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:24.380687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d48e23-0d8a-412e-910a-e045cf9c9cd5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:24.382185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:24.383636 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:24.423667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:24.445575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fd865-28ef-488e-9921-b4f394773e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:24.446256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fd865-28ef-488e-9921-b4f394773e83 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:24.446532 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fd865-28ef-488e-9921-b4f394773e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:24.446851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fd865-28ef-488e-9921-b4f394773e83 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:24.447475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fd865-28ef-488e-9921-b4f394773e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:24.449447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fd865-28ef-488e-9921-b4f394773e83 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:24.459407 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87e74a-a1f8-4fab-bdc3-3fc17ae95c4a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:24.465551 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb90d3-7dcd-4c91-9632-0e4d8f134a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:24.466212 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb90d3-7dcd-4c91-9632-0e4d8f134a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:24.466491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb90d3-7dcd-4c91-9632-0e4d8f134a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:24.466768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb90d3-7dcd-4c91-9632-0e4d8f134a69 admin admin] PATH_INFO: `/v3/users/8f5dc6eb2ad74564bd2a22861eca78d7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:24.468055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb90d3-7dcd-4c91-9632-0e4d8f134a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f5dc6eb2ad74564bd2a22861eca78d7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:24.470033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb90d3-7dcd-4c91-9632-0e4d8f134a69 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:24.473178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1267/2538] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:24 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:24.478177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fd865-28ef-488e-9921-b4f394773e83 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:24.480324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ae7fd865-28ef-488e-9921-b4f394773e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:24.493311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fd865-28ef-488e-9921-b4f394773e83 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:24.498879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c539d6e-071b-4aa8-afb6-d3e81f8910a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:24.499571 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c539d6e-071b-4aa8-afb6-d3e81f8910a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:24.499889 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c539d6e-071b-4aa8-afb6-d3e81f8910a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:24.500163 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c539d6e-071b-4aa8-afb6-d3e81f8910a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:24.500865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c539d6e-071b-4aa8-afb6-d3e81f8910a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:24.502580 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c539d6e-071b-4aa8-afb6-d3e81f8910a2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:24.513437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1268/2539] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:24.517608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c539d6e-071b-4aa8-afb6-d3e81f8910a2 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:24.519815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-81fb90d3-7dcd-4c91-9632-0e4d8f134a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f5dc6eb2ad74564bd2a22861eca78d7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:24.527855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c539d6e-071b-4aa8-afb6-d3e81f8910a2 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:24.528272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-81fb90d3-7dcd-4c91-9632-0e4d8f134a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f5dc6eb2ad74564bd2a22861eca78d7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:24.532576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d021f8-72ed-4da9-84b7-a0552576880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:24.533349 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d021f8-72ed-4da9-84b7-a0552576880f admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:24.533688 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d021f8-72ed-4da9-84b7-a0552576880f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:24.534149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d021f8-72ed-4da9-84b7-a0552576880f admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:24.534841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d021f8-72ed-4da9-84b7-a0552576880f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:24.536425 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-81fb90d3-7dcd-4c91-9632-0e4d8f134a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f5dc6eb2ad74564bd2a22861eca78d7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:24.536576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d021f8-72ed-4da9-84b7-a0552576880f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:24.537086 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-81fb90d3-7dcd-4c91-9632-0e4d8f134a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f5dc6eb2ad74564bd2a22861eca78d7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:24.551217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1269/2540] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:24.551438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-81fb90d3-7dcd-4c91-9632-0e4d8f134a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f5dc6eb2ad74564bd2a22861eca78d7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:24.552399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d021f8-72ed-4da9-84b7-a0552576880f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:24.554109 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a6d021f8-72ed-4da9-84b7-a0552576880f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:24.555877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1272/2541] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:24 2022] DELETE /identity/v3/users/8f5dc6eb2ad74564bd2a22861eca78d7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:24.567523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d021f8-72ed-4da9-84b7-a0552576880f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:24.636406 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f5782-a74e-419f-8bb8-a31979743012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:24.636635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f5782-a74e-419f-8bb8-a31979743012 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:24.636911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f5782-a74e-419f-8bb8-a31979743012 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:24.637230 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f5782-a74e-419f-8bb8-a31979743012 admin admin] PATH_INFO: `/v3/projects/1f01fb1365974e509620dd21c150e4ab/users/f6233bece9dc42ee92b7d6ff12822e74/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:24.652711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f5782-a74e-419f-8bb8-a31979743012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f01fb1365974e509620dd21c150e4ab, user_id=f6233bece9dc42ee92b7d6ff12822e74, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:24.655528 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f5782-a74e-419f-8bb8-a31979743012 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:24.669689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1270/2542] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:24 2022] PUT /identity/v3/projects/1f01fb1365974e509620dd21c150e4ab/users/f6233bece9dc42ee92b7d6ff12822e74/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:24.681317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141516b-dd03-4c49-a6bf-5de21015b29b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:24.681744 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141516b-dd03-4c49-a6bf-5de21015b29b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:24.682029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141516b-dd03-4c49-a6bf-5de21015b29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:24.732840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0141516b-dd03-4c49-a6bf-5de21015b29b None None] MFA Rules not processed for user `f6233bece9dc42ee92b7d6ff12822e74`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:24.732840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0141516b-dd03-4c49-a6bf-5de21015b29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:24.816288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1273/2543] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:24.821603 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f5782-a74e-419f-8bb8-a31979743012 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:24.832976 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:24.871534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141516b-dd03-4c49-a6bf-5de21015b29b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:24.873103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0141516b-dd03-4c49-a6bf-5de21015b29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:24.918218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f5782-a74e-419f-8bb8-a31979743012 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:24.923190 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf20b3-a5fe-4e7c-8ccf-d0902f4707f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:24.923963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf20b3-a5fe-4e7c-8ccf-d0902f4707f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:24.924702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf20b3-a5fe-4e7c-8ccf-d0902f4707f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:24.924702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf20b3-a5fe-4e7c-8ccf-d0902f4707f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:24.925472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf20b3-a5fe-4e7c-8ccf-d0902f4707f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:24.927526 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf20b3-a5fe-4e7c-8ccf-d0902f4707f8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:24.938692 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:24.960004 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1271/2544] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:24 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:24.965029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf20b3-a5fe-4e7c-8ccf-d0902f4707f8 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:24.970380 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141516b-dd03-4c49-a6bf-5de21015b29b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.035625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf20b3-a5fe-4e7c-8ccf-d0902f4707f8 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.040602 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986f147-3d08-44f5-b2c5-5b85aaf9b68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.041197 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986f147-3d08-44f5-b2c5-5b85aaf9b68e admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.041509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986f147-3d08-44f5-b2c5-5b85aaf9b68e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.041782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986f147-3d08-44f5-b2c5-5b85aaf9b68e admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.042044 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b8743-7152-4d37-a47d-97678d9e46c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.042462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986f147-3d08-44f5-b2c5-5b85aaf9b68e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.042933 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b8743-7152-4d37-a47d-97678d9e46c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.043302 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b8743-7152-4d37-a47d-97678d9e46c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.043673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b8743-7152-4d37-a47d-97678d9e46c4 admin admin] PATH_INFO: `/v3/projects/ef763fe2c063472d9ff8da6682ac941e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.044569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986f147-3d08-44f5-b2c5-5b85aaf9b68e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.045158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b8743-7152-4d37-a47d-97678d9e46c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef763fe2c063472d9ff8da6682ac941e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.047227 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b8743-7152-4d37-a47d-97678d9e46c4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.068274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1272/2545] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:24 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:25.072740 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986f147-3d08-44f5-b2c5-5b85aaf9b68e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.083608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986f147-3d08-44f5-b2c5-5b85aaf9b68e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.088808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4a3e7-625c-462b-9f55-845f4942a96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.089474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4a3e7-625c-462b-9f55-845f4942a96c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.089785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4a3e7-625c-462b-9f55-845f4942a96c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.090185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4a3e7-625c-462b-9f55-845f4942a96c admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.090914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4a3e7-625c-462b-9f55-845f4942a96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.092769 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4a3e7-625c-462b-9f55-845f4942a96c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.108126 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1273/2546] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:25.109008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4a3e7-625c-462b-9f55-845f4942a96c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.119347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4a3e7-625c-462b-9f55-845f4942a96c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.127683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-728b8743-7152-4d37-a47d-97678d9e46c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef763fe2c063472d9ff8da6682ac941e', 'request_id': 'req-728b8743-7152-4d37-a47d-97678d9e46c4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:25.139704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-728b8743-7152-4d37-a47d-97678d9e46c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef763fe2c063472d9ff8da6682ac941e', 'request_id': 'req-728b8743-7152-4d37-a47d-97678d9e46c4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:25.148736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-728b8743-7152-4d37-a47d-97678d9e46c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef763fe2c063472d9ff8da6682ac941e', 'request_id': 'req-728b8743-7152-4d37-a47d-97678d9e46c4'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:25.167424 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-728b8743-7152-4d37-a47d-97678d9e46c4 admin admin] The token cache is being invalidate because project ef763fe2c063472d9ff8da6682ac941e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:25.167768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-728b8743-7152-4d37-a47d-97678d9e46c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:25.168469 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-728b8743-7152-4d37-a47d-97678d9e46c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:25.170712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1274/2547] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:24 2022] DELETE /identity/v3/projects/ef763fe2c063472d9ff8da6682ac941e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:25.175959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49eddf3-550d-432d-944e-e99c4288b520 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.175959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49eddf3-550d-432d-944e-e99c4288b520 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.176313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49eddf3-550d-432d-944e-e99c4288b520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.204991 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22287bff-d87d-43d5-81d0-64bd73642136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.206459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22287bff-d87d-43d5-81d0-64bd73642136 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.207178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22287bff-d87d-43d5-81d0-64bd73642136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.207452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22287bff-d87d-43d5-81d0-64bd73642136 admin admin] PATH_INFO: `/v3/projects/38420fffe47d4b9e8bce38333c9fb4b8/users/ec759a307ad94e908203ea6f095e99b1/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.210596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f49eddf3-550d-432d-944e-e99c4288b520 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:25.211859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f49eddf3-550d-432d-944e-e99c4288b520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:25.220607 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1275/2548] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:25.226175 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22287bff-d87d-43d5-81d0-64bd73642136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38420fffe47d4b9e8bce38333c9fb4b8, user_id=ec759a307ad94e908203ea6f095e99b1, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.228885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844908-6f29-4dcc-85f6-d64646d8839b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.229033 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22287bff-d87d-43d5-81d0-64bd73642136 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.229577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844908-6f29-4dcc-85f6-d64646d8839b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.230111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d844908-6f29-4dcc-85f6-d64646d8839b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.232545 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:25.246216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1274/2549] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:25 2022] PUT /identity/v3/projects/38420fffe47d4b9e8bce38333c9fb4b8/users/ec759a307ad94e908203ea6f095e99b1/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:25.250488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22287bff-d87d-43d5-81d0-64bd73642136 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.252258 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-22287bff-d87d-43d5-81d0-64bd73642136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:25.253567 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5d844908-6f29-4dcc-85f6-d64646d8839b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:25.254910 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5d844908-6f29-4dcc-85f6-d64646d8839b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:25.313472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1276/2550] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:25.315656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22287bff-d87d-43d5-81d0-64bd73642136 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.317845 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d844908-6f29-4dcc-85f6-d64646d8839b None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.320450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836e666-9b0a-4c28-a193-e0a4adabfb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.321163 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e666-9b0a-4c28-a193-e0a4adabfb8b admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.321467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e666-9b0a-4c28-a193-e0a4adabfb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.321742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e666-9b0a-4c28-a193-e0a4adabfb8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.322465 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836e666-9b0a-4c28-a193-e0a4adabfb8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.324262 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836e666-9b0a-4c28-a193-e0a4adabfb8b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.327893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d844908-6f29-4dcc-85f6-d64646d8839b None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.333159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e913a40-d87e-4860-926a-42890ce3eced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.333842 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e913a40-d87e-4860-926a-42890ce3eced admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.334123 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e913a40-d87e-4860-926a-42890ce3eced admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.334394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e913a40-d87e-4860-926a-42890ce3eced admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.335018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1275/2551] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:25.335161 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e913a40-d87e-4860-926a-42890ce3eced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:25.335379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e913a40-d87e-4860-926a-42890ce3eced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.337092 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e913a40-d87e-4860-926a-42890ce3eced admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.339298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836e666-9b0a-4c28-a193-e0a4adabfb8b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.349192 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1277/2552] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:25.349454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836e666-9b0a-4c28-a193-e0a4adabfb8b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.353690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e913a40-d87e-4860-926a-42890ce3eced admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.358400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef6b9b-c1d4-44ee-bac2-214a033d47f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.358885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:25.359158 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef6b9b-c1d4-44ee-bac2-214a033d47f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.359447 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef6b9b-c1d4-44ee-bac2-214a033d47f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.359727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef6b9b-c1d4-44ee-bac2-214a033d47f7 admin admin] PATH_INFO: `/v3/projects/38420fffe47d4b9e8bce38333c9fb4b8/users/ec759a307ad94e908203ea6f095e99b1/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.361856 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef6b9b-c1d4-44ee-bac2-214a033d47f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38420fffe47d4b9e8bce38333c9fb4b8, user_id=ec759a307ad94e908203ea6f095e99b1, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.364736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e913a40-d87e-4860-926a-42890ce3eced admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.364881 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef6b9b-c1d4-44ee-bac2-214a033d47f7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.371215 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b7000-2617-4650-ac25-f9fe769ec666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.371835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b7000-2617-4650-ac25-f9fe769ec666 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.372115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b7000-2617-4650-ac25-f9fe769ec666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.372385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b7000-2617-4650-ac25-f9fe769ec666 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.373085 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b7000-2617-4650-ac25-f9fe769ec666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.375450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b7000-2617-4650-ac25-f9fe769ec666 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.377057 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1276/2553] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:25 2022] PUT /identity/v3/projects/38420fffe47d4b9e8bce38333c9fb4b8/users/ec759a307ad94e908203ea6f095e99b1/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:25.387339 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a242c41-b0ff-421f-9c42-d0c9cc8ada26 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.387626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a242c41-b0ff-421f-9c42-d0c9cc8ada26 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.387902 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a242c41-b0ff-421f-9c42-d0c9cc8ada26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.405664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1278/2554] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:25 2022] POST /identity/v3/projects => generated 407 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:25.409916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b7000-2617-4650-ac25-f9fe769ec666 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.420127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7a242c41-b0ff-421f-9c42-d0c9cc8ada26 None None] MFA Rules not processed for user `ec759a307ad94e908203ea6f095e99b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:25.421383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7a242c41-b0ff-421f-9c42-d0c9cc8ada26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:25.489766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b7000-2617-4650-ac25-f9fe769ec666 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.490495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886eb0a-6c94-4416-8bfe-385da63ee845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.491293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886eb0a-6c94-4416-8bfe-385da63ee845 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.491788 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886eb0a-6c94-4416-8bfe-385da63ee845 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.491941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886eb0a-6c94-4416-8bfe-385da63ee845 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.492702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886eb0a-6c94-4416-8bfe-385da63ee845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.495104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886eb0a-6c94-4416-8bfe-385da63ee845 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.507920 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1277/2555] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:25.520600 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1279/2556] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:25 2022] POST /identity/v3/users => generated 304 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:25.521023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a242c41-b0ff-421f-9c42-d0c9cc8ada26 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.524575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886eb0a-6c94-4416-8bfe-385da63ee845 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.524929 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7a242c41-b0ff-421f-9c42-d0c9cc8ada26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:25.535081 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886eb0a-6c94-4416-8bfe-385da63ee845 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.539745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299cc9f-e912-475d-abe4-abdb5fea6cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.540329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299cc9f-e912-475d-abe4-abdb5fea6cda admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.540656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299cc9f-e912-475d-abe4-abdb5fea6cda admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.540932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299cc9f-e912-475d-abe4-abdb5fea6cda admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.541660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299cc9f-e912-475d-abe4-abdb5fea6cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.543291 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299cc9f-e912-475d-abe4-abdb5fea6cda admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.553848 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1280/2557] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:25.558077 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299cc9f-e912-475d-abe4-abdb5fea6cda admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.568153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299cc9f-e912-475d-abe4-abdb5fea6cda admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.574717 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd57b3f-3f79-4f2e-99e5-24cd0b71bf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.575988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd57b3f-3f79-4f2e-99e5-24cd0b71bf17 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.576268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd57b3f-3f79-4f2e-99e5-24cd0b71bf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.576540 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd57b3f-3f79-4f2e-99e5-24cd0b71bf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.577236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd57b3f-3f79-4f2e-99e5-24cd0b71bf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.579520 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd57b3f-3f79-4f2e-99e5-24cd0b71bf17 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.591652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1281/2558] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:25.595371 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd57b3f-3f79-4f2e-99e5-24cd0b71bf17 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.595862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a242c41-b0ff-421f-9c42-d0c9cc8ada26 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.599821 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c671e-7240-4bd0-9c21-7322a0c69699 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.600817 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c671e-7240-4bd0-9c21-7322a0c69699 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.601162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c671e-7240-4bd0-9c21-7322a0c69699 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.602426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c671e-7240-4bd0-9c21-7322a0c69699 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.605314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd57b3f-3f79-4f2e-99e5-24cd0b71bf17 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.609891 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbaf1a-5292-4070-989f-07962d745b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.610563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbaf1a-5292-4070-989f-07962d745b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.610839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbaf1a-5292-4070-989f-07962d745b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.611563 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbaf1a-5292-4070-989f-07962d745b12 admin admin] PATH_INFO: `/v3/projects/a2497d1705ad4309b9eda5db8a4a8bce/users/999d8e89a5d24b8ab268d8b6c6dd5e06/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.615391 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c671e-7240-4bd0-9c21-7322a0c69699 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.616850 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c671e-7240-4bd0-9c21-7322a0c69699 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.627217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbaf1a-5292-4070-989f-07962d745b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2497d1705ad4309b9eda5db8a4a8bce, user_id=999d8e89a5d24b8ab268d8b6c6dd5e06, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.629490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1278/2559] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:51:25.629905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbaf1a-5292-4070-989f-07962d745b12 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.649369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1282/2560] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:25 2022] PUT /identity/v3/projects/a2497d1705ad4309b9eda5db8a4a8bce/users/999d8e89a5d24b8ab268d8b6c6dd5e06/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:25.657939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bb10e-868d-41eb-bca5-45c375f73244 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.658399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bb10e-868d-41eb-bca5-45c375f73244 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.658873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bb10e-868d-41eb-bca5-45c375f73244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.673056 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:25.692633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-874bb10e-868d-41eb-bca5-45c375f73244 None None] MFA Rules not processed for user `999d8e89a5d24b8ab268d8b6c6dd5e06`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:25.693892 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-874bb10e-868d-41eb-bca5-45c375f73244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:25.724630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbaf1a-5292-4070-989f-07962d745b12 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.779578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1279/2561] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:25.784170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bb10e-868d-41eb-bca5-45c375f73244 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.794476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbaf1a-5292-4070-989f-07962d745b12 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.798498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1a82-3158-4ce7-8b95-30d1c82fb645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.799124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1a82-3158-4ce7-8b95-30d1c82fb645 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.799402 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1a82-3158-4ce7-8b95-30d1c82fb645 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.799669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1a82-3158-4ce7-8b95-30d1c82fb645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.802096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-504f1a82-3158-4ce7-8b95-30d1c82fb645 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:25.858529 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:25.867276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bb10e-868d-41eb-bca5-45c375f73244 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.873815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c446f22-5ffd-4863-9b16-0c3d7d8855ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.874483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c446f22-5ffd-4863-9b16-0c3d7d8855ad admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.874816 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c446f22-5ffd-4863-9b16-0c3d7d8855ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.875090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c446f22-5ffd-4863-9b16-0c3d7d8855ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.875836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c446f22-5ffd-4863-9b16-0c3d7d8855ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.877983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c446f22-5ffd-4863-9b16-0c3d7d8855ad admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.883827 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f1a82-3158-4ce7-8b95-30d1c82fb645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.885260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f1a82-3158-4ce7-8b95-30d1c82fb645 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:25.894502 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1283/2562] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:51:25.907807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1280/2563] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:25 2022] POST /identity/v3/projects => generated 409 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:25.911997 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1a82-3158-4ce7-8b95-30d1c82fb645 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:25.922832 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1a82-3158-4ce7-8b95-30d1c82fb645 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:25.983966 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb94c00-be71-4eaa-8d0d-70115794e21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:25.984689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb94c00-be71-4eaa-8d0d-70115794e21c admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:25.984849 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb94c00-be71-4eaa-8d0d-70115794e21c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:25.985114 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb94c00-be71-4eaa-8d0d-70115794e21c admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:25.985811 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb94c00-be71-4eaa-8d0d-70115794e21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:25.987735 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb94c00-be71-4eaa-8d0d-70115794e21c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:26.011847 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1284/2564] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:25 2022] POST /identity/v3/users => generated 311 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:26.015758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c446f22-5ffd-4863-9b16-0c3d7d8855ad admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:26.027891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c446f22-5ffd-4863-9b16-0c3d7d8855ad admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:26.033449 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1ca3b-1de5-46a6-b3b6-d7c109a3ae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:26.034096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1ca3b-1de5-46a6-b3b6-d7c109a3ae3f admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:26.034383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1ca3b-1de5-46a6-b3b6-d7c109a3ae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:26.034657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1ca3b-1de5-46a6-b3b6-d7c109a3ae3f admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:26.035521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1ca3b-1de5-46a6-b3b6-d7c109a3ae3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:26.037246 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1ca3b-1de5-46a6-b3b6-d7c109a3ae3f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:26.048861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1281/2565] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:26.053937 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb94c00-be71-4eaa-8d0d-70115794e21c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:26.064487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb94c00-be71-4eaa-8d0d-70115794e21c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:26.069621 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66748842-6012-4acb-a599-c5fe2a8bdec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:26.070387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66748842-6012-4acb-a599-c5fe2a8bdec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:26.070695 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66748842-6012-4acb-a599-c5fe2a8bdec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:26.071053 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66748842-6012-4acb-a599-c5fe2a8bdec7 admin admin] PATH_INFO: `/v3/projects/7f61bad660654701976e985a98914d8e/users/3ba00f67eeb44dbb811d68e050019168/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:26.087234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66748842-6012-4acb-a599-c5fe2a8bdec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f61bad660654701976e985a98914d8e, user_id=3ba00f67eeb44dbb811d68e050019168, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:26.089895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66748842-6012-4acb-a599-c5fe2a8bdec7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:26.108543 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1285/2566] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:26 2022] PUT /identity/v3/projects/7f61bad660654701976e985a98914d8e/users/3ba00f67eeb44dbb811d68e050019168/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:26.114537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1ca3b-1de5-46a6-b3b6-d7c109a3ae3f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:26.129197 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1ca3b-1de5-46a6-b3b6-d7c109a3ae3f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:26.209459 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac995dd-90ae-4026-87cb-c28309f315cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:26.210105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac995dd-90ae-4026-87cb-c28309f315cc admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:26.210384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac995dd-90ae-4026-87cb-c28309f315cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:26.210654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac995dd-90ae-4026-87cb-c28309f315cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:26.211379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac995dd-90ae-4026-87cb-c28309f315cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:26.214663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac995dd-90ae-4026-87cb-c28309f315cc admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:26.230301 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1282/2567] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:26.231483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66748842-6012-4acb-a599-c5fe2a8bdec7 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:26.244221 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66748842-6012-4acb-a599-c5fe2a8bdec7 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:26.250824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b00e-3e82-4d78-839d-b09019c567cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:26.251508 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b00e-3e82-4d78-839d-b09019c567cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:26.251768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b00e-3e82-4d78-839d-b09019c567cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:26.252034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813b00e-3e82-4d78-839d-b09019c567cc admin admin] PATH_INFO: `/v3/projects/7f61bad660654701976e985a98914d8e/users/3ba00f67eeb44dbb811d68e050019168/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:26.255118 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813b00e-3e82-4d78-839d-b09019c567cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f61bad660654701976e985a98914d8e, user_id=3ba00f67eeb44dbb811d68e050019168, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:26.257832 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813b00e-3e82-4d78-839d-b09019c567cc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:26.270955 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1286/2568] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:26 2022] PUT /identity/v3/projects/7f61bad660654701976e985a98914d8e/users/3ba00f67eeb44dbb811d68e050019168/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:26.283802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5598d6f-827d-4166-ad21-0879a80c1a13 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:26.283802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5598d6f-827d-4166-ad21-0879a80c1a13 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:26.283802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5598d6f-827d-4166-ad21-0879a80c1a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:26.299363 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:26.317506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b5598d6f-827d-4166-ad21-0879a80c1a13 None None] MFA Rules not processed for user `3ba00f67eeb44dbb811d68e050019168`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:26.317614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b5598d6f-827d-4166-ad21-0879a80c1a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:26.404686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1283/2569] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:26 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:26.415737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b00e-3e82-4d78-839d-b09019c567cc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:26.418337 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3813b00e-3e82-4d78-839d-b09019c567cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:26.482807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813b00e-3e82-4d78-839d-b09019c567cc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:26.488418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f56e6-88de-4cbe-8335-d3519110b342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:26.489087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f56e6-88de-4cbe-8335-d3519110b342 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:26.489413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f56e6-88de-4cbe-8335-d3519110b342 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:26.489669 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f56e6-88de-4cbe-8335-d3519110b342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:26.500207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f56e6-88de-4cbe-8335-d3519110b342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:26.501704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f56e6-88de-4cbe-8335-d3519110b342 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:26.511303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1287/2570] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:26 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:26.720161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5598d6f-827d-4166-ad21-0879a80c1a13 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:26.730490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5598d6f-827d-4166-ad21-0879a80c1a13 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:26.734386 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f724e9-db38-41e2-a3d2-214def4ee13b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:26.735164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f724e9-db38-41e2-a3d2-214def4ee13b service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:26.735560 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f724e9-db38-41e2-a3d2-214def4ee13b service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:26.735985 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f724e9-db38-41e2-a3d2-214def4ee13b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:26.800023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f724e9-db38-41e2-a3d2-214def4ee13b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:26.801451 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f724e9-db38-41e2-a3d2-214def4ee13b service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:26.812060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1284/2571] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:30.778919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f56e6-88de-4cbe-8335-d3519110b342 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:30.815504 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:30.847513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f56e6-88de-4cbe-8335-d3519110b342 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:30.852794 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:30.853596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:30.853873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:30.854213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] PATH_INFO: `/v3/users/f6233bece9dc42ee92b7d6ff12822e74` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:30.855456 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6233bece9dc42ee92b7d6ff12822e74)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:30.857440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:30.913682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6233bece9dc42ee92b7d6ff12822e74'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:30.921850 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6233bece9dc42ee92b7d6ff12822e74'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:30.933492 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6233bece9dc42ee92b7d6ff12822e74'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:30.934010 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6233bece9dc42ee92b7d6ff12822e74'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:30.949340 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6233bece9dc42ee92b7d6ff12822e74'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:30.959823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1288/2572] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:30 2022] DELETE /identity/v3/users/f6233bece9dc42ee92b7d6ff12822e74 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:30.961740 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0d638-a017-4970-bd4d-075ff2690c96 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:30.962228 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0d638-a017-4970-bd4d-075ff2690c96 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:30.962554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0d638-a017-4970-bd4d-075ff2690c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:30.986469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-86e0d638-a017-4970-bd4d-075ff2690c96 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:30.987859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-86e0d638-a017-4970-bd4d-075ff2690c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:31.049277 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1285/2573] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:31.059634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:31.061104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:31.122496 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd716f45-9be0-47f4-8a36-cda1ff4e22e5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:31.127112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbb440-6ef9-4939-837a-9cafdf541d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:31.127796 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbb440-6ef9-4939-837a-9cafdf541d04 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:31.128078 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbb440-6ef9-4939-837a-9cafdf541d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:31.128376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbb440-6ef9-4939-837a-9cafdf541d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:31.138806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbb440-6ef9-4939-837a-9cafdf541d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:31.140244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbb440-6ef9-4939-837a-9cafdf541d04 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:31.150635 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1289/2574] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:31.444906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0d638-a017-4970-bd4d-075ff2690c96 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:31.446510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-86e0d638-a017-4970-bd4d-075ff2690c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:31.464101 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0d638-a017-4970-bd4d-075ff2690c96 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:31.469694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:31.470361 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:31.470639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:31.470907 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] PATH_INFO: `/v3/projects/1f01fb1365974e509620dd21c150e4ab` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:31.472393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f01fb1365974e509620dd21c150e4ab)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:31.474409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:31.509957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:31.527171 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f01fb1365974e509620dd21c150e4ab', 'request_id': 'req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:31.533929 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f01fb1365974e509620dd21c150e4ab', 'request_id': 'req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:31.541957 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f01fb1365974e509620dd21c150e4ab', 'request_id': 'req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:31.552547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] The token cache is being invalidate because project 1f01fb1365974e509620dd21c150e4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:31.552745 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:31.553409 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:31.554968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1286/2575] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:31 2022] DELETE /identity/v3/projects/1f01fb1365974e509620dd21c150e4ab => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:31.559117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbb440-6ef9-4939-837a-9cafdf541d04 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:31.568734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbb440-6ef9-4939-837a-9cafdf541d04 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:31.622367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:31.630665 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:31.631386 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:31.631715 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:31.632004 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] PATH_INFO: `/v3/users/ec759a307ad94e908203ea6f095e99b1` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:31.633257 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec759a307ad94e908203ea6f095e99b1)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:31.635775 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:31.688088 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec759a307ad94e908203ea6f095e99b1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:31.695862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec759a307ad94e908203ea6f095e99b1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:31.704711 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec759a307ad94e908203ea6f095e99b1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:31.705379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec759a307ad94e908203ea6f095e99b1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:31.718954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec759a307ad94e908203ea6f095e99b1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:31.724931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1290/2576] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:31 2022] DELETE /identity/v3/users/ec759a307ad94e908203ea6f095e99b1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:32.014367 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:32.015852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:32.031575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc2ec2-4b69-40fd-b43b-5a9201d2bbb2 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:32.103191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69257a90-2cb9-4f95-8081-45209c901d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:32.103765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69257a90-2cb9-4f95-8081-45209c901d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.104047 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69257a90-2cb9-4f95-8081-45209c901d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.104322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69257a90-2cb9-4f95-8081-45209c901d1e admin admin] PATH_INFO: `/v3/projects/38420fffe47d4b9e8bce38333c9fb4b8` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.105557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69257a90-2cb9-4f95-8081-45209c901d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=38420fffe47d4b9e8bce38333c9fb4b8)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:32.107552 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69257a90-2cb9-4f95-8081-45209c901d1e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:32.160177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-69257a90-2cb9-4f95-8081-45209c901d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38420fffe47d4b9e8bce38333c9fb4b8', 'request_id': 'req-69257a90-2cb9-4f95-8081-45209c901d1e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:32.167964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-69257a90-2cb9-4f95-8081-45209c901d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38420fffe47d4b9e8bce38333c9fb4b8', 'request_id': 'req-69257a90-2cb9-4f95-8081-45209c901d1e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:32.176642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-69257a90-2cb9-4f95-8081-45209c901d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38420fffe47d4b9e8bce38333c9fb4b8', 'request_id': 'req-69257a90-2cb9-4f95-8081-45209c901d1e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:32.180927 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:32.182399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:32.187889 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-69257a90-2cb9-4f95-8081-45209c901d1e admin admin] The token cache is being invalidate because project 38420fffe47d4b9e8bce38333c9fb4b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:32.188174 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-69257a90-2cb9-4f95-8081-45209c901d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:32.188804 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-69257a90-2cb9-4f95-8081-45209c901d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:32.190369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1287/2577] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:32 2022] DELETE /identity/v3/projects/38420fffe47d4b9e8bce38333c9fb4b8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:32.195515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c1314-eb18-4514-a66b-7cf8f3410f59 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:32.196696 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982fa09-2387-47c2-8b28-701e35725a81 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.196985 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982fa09-2387-47c2-8b28-701e35725a81 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.197257 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982fa09-2387-47c2-8b28-701e35725a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.217606 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b982fa09-2387-47c2-8b28-701e35725a81 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:32.218910 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b982fa09-2387-47c2-8b28-701e35725a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:32.253707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d137d-f705-487d-aa2f-5164be0cc8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:32.254367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d137d-f705-487d-aa2f-5164be0cc8e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.254632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d137d-f705-487d-aa2f-5164be0cc8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.254921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d137d-f705-487d-aa2f-5164be0cc8e3 admin admin] PATH_INFO: `/v3/users/999d8e89a5d24b8ab268d8b6c6dd5e06` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.256097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d137d-f705-487d-aa2f-5164be0cc8e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999d8e89a5d24b8ab268d8b6c6dd5e06)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:32.258063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d137d-f705-487d-aa2f-5164be0cc8e3 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:32.260725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:32.281896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1288/2578] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:32.290939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e2a1-2055-4a30-bd5b-57a1261da950 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.291264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e2a1-2055-4a30-bd5b-57a1261da950 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.291618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e2a1-2055-4a30-bd5b-57a1261da950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.307359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-518d137d-f705-487d-aa2f-5164be0cc8e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999d8e89a5d24b8ab268d8b6c6dd5e06'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:32.312192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b454e2a1-2055-4a30-bd5b-57a1261da950 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:32.313499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b454e2a1-2055-4a30-bd5b-57a1261da950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:32.314396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-518d137d-f705-487d-aa2f-5164be0cc8e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999d8e89a5d24b8ab268d8b6c6dd5e06'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:32.322453 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1289/2579] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:32.323236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-518d137d-f705-487d-aa2f-5164be0cc8e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999d8e89a5d24b8ab268d8b6c6dd5e06'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:32.323845 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-518d137d-f705-487d-aa2f-5164be0cc8e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999d8e89a5d24b8ab268d8b6c6dd5e06'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:32.327038 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454e2a1-2055-4a30-bd5b-57a1261da950 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:32.334934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:32.337599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-518d137d-f705-487d-aa2f-5164be0cc8e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999d8e89a5d24b8ab268d8b6c6dd5e06'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:32.338039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454e2a1-2055-4a30-bd5b-57a1261da950 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:32.343314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59d423-1d0e-4e0c-a852-13bc0f1a8992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:32.343986 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59d423-1d0e-4e0c-a852-13bc0f1a8992 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.344263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59d423-1d0e-4e0c-a852-13bc0f1a8992 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.344547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59d423-1d0e-4e0c-a852-13bc0f1a8992 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.345237 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59d423-1d0e-4e0c-a852-13bc0f1a8992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:32.345569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59d423-1d0e-4e0c-a852-13bc0f1a8992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:32.346234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1291/2580] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:32 2022] DELETE /identity/v3/users/999d8e89a5d24b8ab268d8b6c6dd5e06 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:32.347261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59d423-1d0e-4e0c-a852-13bc0f1a8992 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:32.350668 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70e0be-4999-4034-bf9a-44ef4b11faef None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.350988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70e0be-4999-4034-bf9a-44ef4b11faef None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.351264 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70e0be-4999-4034-bf9a-44ef4b11faef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.359696 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1290/2581] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:51:32.364002 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59d423-1d0e-4e0c-a852-13bc0f1a8992 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:32.365687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-da59d423-1d0e-4e0c-a852-13bc0f1a8992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:32.373925 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-7b70e0be-4999-4034-bf9a-44ef4b11faef None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:32.375126 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7b70e0be-4999-4034-bf9a-44ef4b11faef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:32.378303 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59d423-1d0e-4e0c-a852-13bc0f1a8992 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:32.434424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cafa6-c3d3-4f9e-8c97-915794f891b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:32.434802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1292/2582] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:32.437872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cafa6-c3d3-4f9e-8c97-915794f891b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.438767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cafa6-c3d3-4f9e-8c97-915794f891b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.438767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cafa6-c3d3-4f9e-8c97-915794f891b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.439342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cafa6-c3d3-4f9e-8c97-915794f891b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:32.441398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cafa6-c3d3-4f9e-8c97-915794f891b9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:32.444965 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70e0be-4999-4034-bf9a-44ef4b11faef None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:32.446394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-7b70e0be-4999-4034-bf9a-44ef4b11faef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:32.472111 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1291/2583] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:32 2022] POST /identity/v3/projects => generated 361 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:32.476664 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cafa6-c3d3-4f9e-8c97-915794f891b9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:32.508936 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70e0be-4999-4034-bf9a-44ef4b11faef None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:32.546948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cafa6-c3d3-4f9e-8c97-915794f891b9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:32.553000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911407b-dfd3-44b5-b896-14a4d81676f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:32.554616 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911407b-dfd3-44b5-b896-14a4d81676f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.555108 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911407b-dfd3-44b5-b896-14a4d81676f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.555517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911407b-dfd3-44b5-b896-14a4d81676f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.556264 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911407b-dfd3-44b5-b896-14a4d81676f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:32.558800 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911407b-dfd3-44b5-b896-14a4d81676f4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:32.561943 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b08aa7-6cc0-4882-b171-d1ba774c22bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:32.562575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b08aa7-6cc0-4882-b171-d1ba774c22bb service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.562864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b08aa7-6cc0-4882-b171-d1ba774c22bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.563294 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b08aa7-6cc0-4882-b171-d1ba774c22bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.574496 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b08aa7-6cc0-4882-b171-d1ba774c22bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:32.576335 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b08aa7-6cc0-4882-b171-d1ba774c22bb service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:32.583603 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1292/2584] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:32 2022] POST /identity/v3/users => generated 281 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:32.587981 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911407b-dfd3-44b5-b896-14a4d81676f4 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:32.591259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1293/2585] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:51:32.599321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911407b-dfd3-44b5-b896-14a4d81676f4 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:32.605527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265ea18-545c-4df1-846f-30354c220b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:32.606674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265ea18-545c-4df1-846f-30354c220b02 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.607114 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265ea18-545c-4df1-846f-30354c220b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.607716 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6265ea18-545c-4df1-846f-30354c220b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.608770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265ea18-545c-4df1-846f-30354c220b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:32.610893 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6265ea18-545c-4df1-846f-30354c220b02 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:32.627061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1293/2586] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:32.628334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b08aa7-6cc0-4882-b171-d1ba774c22bb service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:32.640879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b08aa7-6cc0-4882-b171-d1ba774c22bb service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:32.646423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca1dd7-f268-48b2-b7ab-00c0e43c4eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:32.647166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca1dd7-f268-48b2-b7ab-00c0e43c4eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.647514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca1dd7-f268-48b2-b7ab-00c0e43c4eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.647905 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca1dd7-f268-48b2-b7ab-00c0e43c4eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.648757 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca1dd7-f268-48b2-b7ab-00c0e43c4eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:32.650593 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca1dd7-f268-48b2-b7ab-00c0e43c4eb2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:32.665485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1294/2587] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:32.667424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265ea18-545c-4df1-846f-30354c220b02 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:32.681309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6265ea18-545c-4df1-846f-30354c220b02 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:32.687229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07352c-20b4-40e8-b950-ae12f3b34368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:32.688102 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07352c-20b4-40e8-b950-ae12f3b34368 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.688383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07352c-20b4-40e8-b950-ae12f3b34368 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.688830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07352c-20b4-40e8-b950-ae12f3b34368 admin admin] PATH_INFO: `/v3/projects/667ca43b6ace4f02965928b7760e68f9/users/63131a8461e4461e8dceca56db65b0e9/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.705855 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07352c-20b4-40e8-b950-ae12f3b34368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=667ca43b6ace4f02965928b7760e68f9, user_id=63131a8461e4461e8dceca56db65b0e9, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:32.708930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07352c-20b4-40e8-b950-ae12f3b34368 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:32.725366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1294/2588] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:32 2022] PUT /identity/v3/projects/667ca43b6ace4f02965928b7760e68f9/users/63131a8461e4461e8dceca56db65b0e9/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:32.739465 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746aba-4d2a-409d-8d83-68f49a124265 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.739886 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746aba-4d2a-409d-8d83-68f49a124265 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.740164 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746aba-4d2a-409d-8d83-68f49a124265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.768928 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-54746aba-4d2a-409d-8d83-68f49a124265 None None] MFA Rules not processed for user `63131a8461e4461e8dceca56db65b0e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:32.770219 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-54746aba-4d2a-409d-8d83-68f49a124265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:32.805552 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:32.843934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1295/2589] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:32.881876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07352c-20b4-40e8-b950-ae12f3b34368 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:32.883979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fc07352c-20b4-40e8-b950-ae12f3b34368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:32.892006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:32.912671 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54746aba-4d2a-409d-8d83-68f49a124265 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:32.914634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-54746aba-4d2a-409d-8d83-68f49a124265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:32.956693 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07352c-20b4-40e8-b950-ae12f3b34368 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:32.960408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5255c-7111-4de4-bb28-4955a12ef6cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:32.961045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5255c-7111-4de4-bb28-4955a12ef6cb service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:32.961426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5255c-7111-4de4-bb28-4955a12ef6cb service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:32.961700 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5255c-7111-4de4-bb28-4955a12ef6cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:32.970550 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5255c-7111-4de4-bb28-4955a12ef6cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:32.972060 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5255c-7111-4de4-bb28-4955a12ef6cb service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:32.981419 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1295/2590] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:32.995647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54746aba-4d2a-409d-8d83-68f49a124265 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:32.996853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5255c-7111-4de4-bb28-4955a12ef6cb service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:33.000248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:33.000921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:33.001202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:33.001512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] PATH_INFO: `/v3/projects/a2497d1705ad4309b9eda5db8a4a8bce` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:33.003031 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2497d1705ad4309b9eda5db8a4a8bce)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:33.004944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:33.007699 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5255c-7111-4de4-bb28-4955a12ef6cb service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:33.012319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f548f-3722-4335-8e6e-bdfb24f21d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:33.012962 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f548f-3722-4335-8e6e-bdfb24f21d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:33.013239 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f548f-3722-4335-8e6e-bdfb24f21d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:33.013541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f548f-3722-4335-8e6e-bdfb24f21d74 admin admin] PATH_INFO: `/v3/users/63131a8461e4461e8dceca56db65b0e9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:33.014820 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f548f-3722-4335-8e6e-bdfb24f21d74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63131a8461e4461e8dceca56db65b0e9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:33.016736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f548f-3722-4335-8e6e-bdfb24f21d74 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:33.062696 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2497d1705ad4309b9eda5db8a4a8bce', 'request_id': 'req-051adbe2-2136-4097-9e51-2ddab3339580'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.067312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-762f548f-3722-4335-8e6e-bdfb24f21d74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63131a8461e4461e8dceca56db65b0e9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.071124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2497d1705ad4309b9eda5db8a4a8bce', 'request_id': 'req-051adbe2-2136-4097-9e51-2ddab3339580'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.075334 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-762f548f-3722-4335-8e6e-bdfb24f21d74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63131a8461e4461e8dceca56db65b0e9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.076052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-762f548f-3722-4335-8e6e-bdfb24f21d74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63131a8461e4461e8dceca56db65b0e9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.077772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2497d1705ad4309b9eda5db8a4a8bce', 'request_id': 'req-051adbe2-2136-4097-9e51-2ddab3339580'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.088903 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-762f548f-3722-4335-8e6e-bdfb24f21d74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63131a8461e4461e8dceca56db65b0e9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.089671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-762f548f-3722-4335-8e6e-bdfb24f21d74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63131a8461e4461e8dceca56db65b0e9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.092792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] The token cache is being invalidate because project a2497d1705ad4309b9eda5db8a4a8bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:33.093158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.093919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.096089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1296/2591] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:32 2022] DELETE /identity/v3/projects/a2497d1705ad4309b9eda5db8a4a8bce => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:33.100310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:33.101919 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:33.106117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1296/2592] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:32 2022] DELETE /identity/v3/users/63131a8461e4461e8dceca56db65b0e9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:33.110428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed563e8-4a7d-4683-ab1d-887306706f0c None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:33.110790 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed563e8-4a7d-4683-ab1d-887306706f0c None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:33.111149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed563e8-4a7d-4683-ab1d-887306706f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:33.131417 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9ed563e8-4a7d-4683-ab1d-887306706f0c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:33.132631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9ed563e8-4a7d-4683-ab1d-887306706f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:33.168232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051adbe2-2136-4097-9e51-2ddab3339580 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:33.173057 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:33.199562 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1297/2593] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:33.209831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed563e8-4a7d-4683-ab1d-887306706f0c None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:33.211240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9ed563e8-4a7d-4683-ab1d-887306706f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:33.231870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:33.232665 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:33.232803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:33.232948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:33.233216 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] PATH_INFO: `/v3/users/3ba00f67eeb44dbb811d68e050019168` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:33.234499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba00f67eeb44dbb811d68e050019168)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:33.236440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:33.271783 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed563e8-4a7d-4683-ab1d-887306706f0c None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:33.275759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff039bf-a54c-42a0-97ab-612b28c6638e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:33.276356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff039bf-a54c-42a0-97ab-612b28c6638e service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:33.276660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff039bf-a54c-42a0-97ab-612b28c6638e service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:33.276903 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff039bf-a54c-42a0-97ab-612b28c6638e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:33.286677 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff039bf-a54c-42a0-97ab-612b28c6638e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:33.288557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff039bf-a54c-42a0-97ab-612b28c6638e service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:33.288734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba00f67eeb44dbb811d68e050019168'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.295656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba00f67eeb44dbb811d68e050019168'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.298866 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1298/2594] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:51:33.303949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba00f67eeb44dbb811d68e050019168'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.304597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba00f67eeb44dbb811d68e050019168'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.317479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba00f67eeb44dbb811d68e050019168'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.324057 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1297/2595] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:33 2022] DELETE /identity/v3/users/3ba00f67eeb44dbb811d68e050019168 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:33.695804 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff039bf-a54c-42a0-97ab-612b28c6638e service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:33.697979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6ff039bf-a54c-42a0-97ab-612b28c6638e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:33.713711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff039bf-a54c-42a0-97ab-612b28c6638e service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:33.741442 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:33.743220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:33.793970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:33.794667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:33.794943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:33.795216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] PATH_INFO: `/v3/users/73974b9bff7f424fbab9f9c608e35c39` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:33.796603 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73974b9bff7f424fbab9f9c608e35c39)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:33.798620 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:33.834789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9466ea-5ea6-462f-a8b4-812e001d6599 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:33.841718 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7d557-b73a-4920-9e61-c81d65ca23fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:33.842531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7d557-b73a-4920-9e61-c81d65ca23fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:33.842699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7d557-b73a-4920-9e61-c81d65ca23fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:33.842940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7d557-b73a-4920-9e61-c81d65ca23fb admin admin] PATH_INFO: `/v3/projects/667ca43b6ace4f02965928b7760e68f9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:33.844115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7d557-b73a-4920-9e61-c81d65ca23fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=667ca43b6ace4f02965928b7760e68f9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:33.846344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7d557-b73a-4920-9e61-c81d65ca23fb admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:33.864318 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73974b9bff7f424fbab9f9c608e35c39'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.871474 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73974b9bff7f424fbab9f9c608e35c39'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.872167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73974b9bff7f424fbab9f9c608e35c39'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.882440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:33.885815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73974b9bff7f424fbab9f9c608e35c39'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.886505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73974b9bff7f424fbab9f9c608e35c39'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.897968 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5ec7d557-b73a-4920-9e61-c81d65ca23fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667ca43b6ace4f02965928b7760e68f9', 'request_id': 'req-5ec7d557-b73a-4920-9e61-c81d65ca23fb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.901143 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1299/2596] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:33 2022] DELETE /identity/v3/users/73974b9bff7f424fbab9f9c608e35c39 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:33.902028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:33.903504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:33.906621 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5ec7d557-b73a-4920-9e61-c81d65ca23fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667ca43b6ace4f02965928b7760e68f9', 'request_id': 'req-5ec7d557-b73a-4920-9e61-c81d65ca23fb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.913336 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5ec7d557-b73a-4920-9e61-c81d65ca23fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667ca43b6ace4f02965928b7760e68f9', 'request_id': 'req-5ec7d557-b73a-4920-9e61-c81d65ca23fb'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.925877 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5ec7d557-b73a-4920-9e61-c81d65ca23fb admin admin] The token cache is being invalidate because project 667ca43b6ace4f02965928b7760e68f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:33.926162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5ec7d557-b73a-4920-9e61-c81d65ca23fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.926817 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5ec7d557-b73a-4920-9e61-c81d65ca23fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:33.928351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1298/2597] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:33 2022] DELETE /identity/v3/projects/667ca43b6ace4f02965928b7760e68f9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:33.929662 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f8822-ac3c-4e4c-a78e-3912ecf4cb7c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:33.929984 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f8822-ac3c-4e4c-a78e-3912ecf4cb7c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:33.930256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f8822-ac3c-4e4c-a78e-3912ecf4cb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:33.950198 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e17f8822-ac3c-4e4c-a78e-3912ecf4cb7c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:33.951324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e17f8822-ac3c-4e4c-a78e-3912ecf4cb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:33.952605 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:33.977164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66757c13-1657-47e5-a217-edd64d44b980 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:33.985198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:33.986694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:33.987229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:33.988271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] PATH_INFO: `/v3/projects/7f61bad660654701976e985a98914d8e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:33.990835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f61bad660654701976e985a98914d8e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:33.993780 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.019200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1299/2598] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:34.022612 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eb6e1-b043-45e9-93b3-19377bc29344 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.022612 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eb6e1-b043-45e9-93b3-19377bc29344 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.022612 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eb6e1-b043-45e9-93b3-19377bc29344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.042240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-c70eb6e1-b043-45e9-93b3-19377bc29344 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:34.043466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-c70eb6e1-b043-45e9-93b3-19377bc29344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:34.056625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f61bad660654701976e985a98914d8e', 'request_id': 'req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:34.065667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f61bad660654701976e985a98914d8e', 'request_id': 'req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:34.074746 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f61bad660654701976e985a98914d8e', 'request_id': 'req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:34.087146 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] The token cache is being invalidate because project 7f61bad660654701976e985a98914d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:34.087452 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:34.088105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:34.093250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1300/2599] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:33 2022] DELETE /identity/v3/projects/7f61bad660654701976e985a98914d8e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:34.093250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.094728 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:34.106868 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1300/2600] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:34.108216 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e227159-b7fb-428e-9160-0f5db9ef0a4c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.108500 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e227159-b7fb-428e-9160-0f5db9ef0a4c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.108802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e227159-b7fb-428e-9160-0f5db9ef0a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.130676 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-9e227159-b7fb-428e-9160-0f5db9ef0a4c None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:34.131871 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-9e227159-b7fb-428e-9160-0f5db9ef0a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:34.140457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1301/2601] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:34.141821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ecdd6-0192-425b-8ba5-db7a548e1ab2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.142105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ecdd6-0192-425b-8ba5-db7a548e1ab2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.142371 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ecdd6-0192-425b-8ba5-db7a548e1ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.162278 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-0a5ecdd6-0192-425b-8ba5-db7a548e1ab2 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:34.162767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d2afe-0529-4472-88a0-abbe7f3e9b78 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.163468 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-0a5ecdd6-0192-425b-8ba5-db7a548e1ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:34.166626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d687-73f1-4005-bd6d-41b23a9160ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.167253 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d687-73f1-4005-bd6d-41b23a9160ce service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.167535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d687-73f1-4005-bd6d-41b23a9160ce service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.167808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d687-73f1-4005-bd6d-41b23a9160ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.169613 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8a80d687-73f1-4005-bd6d-41b23a9160ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:34.172623 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1302/2602] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:34.173890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbceb1b-441e-4776-9086-0ccb2609e0e3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.174170 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbceb1b-441e-4776-9086-0ccb2609e0e3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.174441 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbceb1b-441e-4776-9086-0ccb2609e0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.186712 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80d687-73f1-4005-bd6d-41b23a9160ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.188196 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80d687-73f1-4005-bd6d-41b23a9160ce service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.194351 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-8fbceb1b-441e-4776-9086-0ccb2609e0e3 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:34.195584 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8fbceb1b-441e-4776-9086-0ccb2609e0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:34.198961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1301/2603] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:34.199790 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d687-73f1-4005-bd6d-41b23a9160ce service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.203732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1303/2604] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:34.208051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbceb1b-441e-4776-9086-0ccb2609e0e3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.210759 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d687-73f1-4005-bd6d-41b23a9160ce service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.215865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a54e0-1e8c-4ce9-bb61-447c673d5de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.216428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a54e0-1e8c-4ce9-bb61-447c673d5de5 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.216708 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a54e0-1e8c-4ce9-bb61-447c673d5de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.216977 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a54e0-1e8c-4ce9-bb61-447c673d5de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.217705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a54e0-1e8c-4ce9-bb61-447c673d5de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:34.218405 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a54e0-1e8c-4ce9-bb61-447c673d5de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.218534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbceb1b-441e-4776-9086-0ccb2609e0e3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.219606 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a54e0-1e8c-4ce9-bb61-447c673d5de5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.223096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bded945-1fa4-4011-ad5f-af9467d0a0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.223720 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bded945-1fa4-4011-ad5f-af9467d0a0bd admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.224006 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bded945-1fa4-4011-ad5f-af9467d0a0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.224273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bded945-1fa4-4011-ad5f-af9467d0a0bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.224964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bded945-1fa4-4011-ad5f-af9467d0a0bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:34.225267 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bded945-1fa4-4011-ad5f-af9467d0a0bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.227199 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bded945-1fa4-4011-ad5f-af9467d0a0bd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.235725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1302/2605] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:34.237626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a54e0-1e8c-4ce9-bb61-447c673d5de5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.240262 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1304/2606] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:51:34.244512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bded945-1fa4-4011-ad5f-af9467d0a0bd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.250457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a54e0-1e8c-4ce9-bb61-447c673d5de5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.254829 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bded945-1fa4-4011-ad5f-af9467d0a0bd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.256200 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a9fac-595f-47f8-8fa4-6363819013ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.256927 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a9fac-595f-47f8-8fa4-6363819013ef admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.257219 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a9fac-595f-47f8-8fa4-6363819013ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.257521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a9fac-595f-47f8-8fa4-6363819013ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.258233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a9fac-595f-47f8-8fa4-6363819013ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.260183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a9fac-595f-47f8-8fa4-6363819013ef admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.261632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30447eaf-8c3f-40a3-9bdc-f56619874a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.262476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30447eaf-8c3f-40a3-9bdc-f56619874a77 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.262934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30447eaf-8c3f-40a3-9bdc-f56619874a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.263411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30447eaf-8c3f-40a3-9bdc-f56619874a77 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.264249 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30447eaf-8c3f-40a3-9bdc-f56619874a77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.266369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30447eaf-8c3f-40a3-9bdc-f56619874a77 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.292135 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1303/2607] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:34 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:34.296382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a9fac-595f-47f8-8fa4-6363819013ef admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.300273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1305/2608] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:34 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:34.301581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30447eaf-8c3f-40a3-9bdc-f56619874a77 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.307308 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:34.356477 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:34.389368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30447eaf-8c3f-40a3-9bdc-f56619874a77 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.391433 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a9fac-595f-47f8-8fa4-6363819013ef admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.396000 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdd498-6ffc-409c-91a4-ce266e9c10b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.396576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60d885-0553-480f-a330-09a9f3361542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.396739 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdd498-6ffc-409c-91a4-ce266e9c10b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.397117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdd498-6ffc-409c-91a4-ce266e9c10b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.397257 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60d885-0553-480f-a330-09a9f3361542 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.397559 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdd498-6ffc-409c-91a4-ce266e9c10b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.397672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60d885-0553-480f-a330-09a9f3361542 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.397833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60d885-0553-480f-a330-09a9f3361542 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.398392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdd498-6ffc-409c-91a4-ce266e9c10b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.398488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60d885-0553-480f-a330-09a9f3361542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.400541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60d885-0553-480f-a330-09a9f3361542 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.400652 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdd498-6ffc-409c-91a4-ce266e9c10b8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.430015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1306/2609] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:34 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:34.433341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1304/2610] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:34 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:34.435304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdd498-6ffc-409c-91a4-ce266e9c10b8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.436154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60d885-0553-480f-a330-09a9f3361542 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.445878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdd498-6ffc-409c-91a4-ce266e9c10b8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.451359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72516ed2-69ea-4917-8192-d0a6470f1582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.451639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60d885-0553-480f-a330-09a9f3361542 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.453151 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72516ed2-69ea-4917-8192-d0a6470f1582 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.453498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72516ed2-69ea-4917-8192-d0a6470f1582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.453794 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72516ed2-69ea-4917-8192-d0a6470f1582 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.454863 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72516ed2-69ea-4917-8192-d0a6470f1582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.457390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72516ed2-69ea-4917-8192-d0a6470f1582 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.457655 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907424d9-feec-48b7-9505-a28912194122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.458265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907424d9-feec-48b7-9505-a28912194122 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.458552 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907424d9-feec-48b7-9505-a28912194122 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.458806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907424d9-feec-48b7-9505-a28912194122 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.459521 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907424d9-feec-48b7-9505-a28912194122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.461128 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907424d9-feec-48b7-9505-a28912194122 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.470888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1307/2611] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:34.471850 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1305/2612] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:34.476509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72516ed2-69ea-4917-8192-d0a6470f1582 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.478324 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907424d9-feec-48b7-9505-a28912194122 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.490727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907424d9-feec-48b7-9505-a28912194122 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.491103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72516ed2-69ea-4917-8192-d0a6470f1582 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.496449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2224a2-3e3d-496a-9945-c856057ce4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.497259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2224a2-3e3d-496a-9945-c856057ce4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.497577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2224a2-3e3d-496a-9945-c856057ce4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.497855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2224a2-3e3d-496a-9945-c856057ce4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.498566 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2224a2-3e3d-496a-9945-c856057ce4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.499158 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2f93-63cd-43b8-ae55-eb3825423e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.500181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2224a2-3e3d-496a-9945-c856057ce4f5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.501811 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2f93-63cd-43b8-ae55-eb3825423e76 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.502283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2f93-63cd-43b8-ae55-eb3825423e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.503553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b2f93-63cd-43b8-ae55-eb3825423e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.503553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b2f93-63cd-43b8-ae55-eb3825423e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.504897 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b2f93-63cd-43b8-ae55-eb3825423e76 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.514949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1308/2613] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:34.523081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1306/2614] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:34.523236 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2224a2-3e3d-496a-9945-c856057ce4f5 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.524177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2f93-63cd-43b8-ae55-eb3825423e76 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.532532 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2224a2-3e3d-496a-9945-c856057ce4f5 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.534653 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b2f93-63cd-43b8-ae55-eb3825423e76 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.537634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454e7d6-0895-4cc3-b494-d26741a38e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.538391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454e7d6-0895-4cc3-b494-d26741a38e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.538808 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454e7d6-0895-4cc3-b494-d26741a38e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.539092 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454e7d6-0895-4cc3-b494-d26741a38e0d admin admin] PATH_INFO: `/v3/projects/16ec15b102a34cbbae8089cc3e8e09ed/users/d577e1385cfd46e2ad71c99a7fd25ca4/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.540007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb4504-e212-4d0c-99db-066ae624618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.540958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb4504-e212-4d0c-99db-066ae624618c admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.541394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb4504-e212-4d0c-99db-066ae624618c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.542218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb4504-e212-4d0c-99db-066ae624618c admin admin] PATH_INFO: `/v3/projects/8f75f3a52a9e40b2b4153add23e05cfb/users/83fb4f13c76d4ef49f59dded0c95a65a/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.557398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454e7d6-0895-4cc3-b494-d26741a38e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ec15b102a34cbbae8089cc3e8e09ed, user_id=d577e1385cfd46e2ad71c99a7fd25ca4, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.560448 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454e7d6-0895-4cc3-b494-d26741a38e0d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.572343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb4504-e212-4d0c-99db-066ae624618c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f75f3a52a9e40b2b4153add23e05cfb, user_id=83fb4f13c76d4ef49f59dded0c95a65a, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.576870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1309/2615] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:34 2022] PUT /identity/v3/projects/16ec15b102a34cbbae8089cc3e8e09ed/users/d577e1385cfd46e2ad71c99a7fd25ca4/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:34.577042 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb4504-e212-4d0c-99db-066ae624618c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.577645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454e7d6-0895-4cc3-b494-d26741a38e0d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.579295 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-4454e7d6-0895-4cc3-b494-d26741a38e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:34.599133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1307/2616] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:34 2022] PUT /identity/v3/projects/8f75f3a52a9e40b2b4153add23e05cfb/users/83fb4f13c76d4ef49f59dded0c95a65a/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:34.603296 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040fbc8-d272-41f2-b7f8-7f6f4e2f8141 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.603296 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040fbc8-d272-41f2-b7f8-7f6f4e2f8141 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.603296 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040fbc8-d272-41f2-b7f8-7f6f4e2f8141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.632861 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e040fbc8-d272-41f2-b7f8-7f6f4e2f8141 None None] MFA Rules not processed for user `d577e1385cfd46e2ad71c99a7fd25ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:34.634201 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e040fbc8-d272-41f2-b7f8-7f6f4e2f8141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:34.663825 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454e7d6-0895-4cc3-b494-d26741a38e0d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.701951 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1308/2617] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:34.704015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567454e-6ef7-4608-88da-04a35b4df08e None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.704251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567454e-6ef7-4608-88da-04a35b4df08e None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.704525 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567454e-6ef7-4608-88da-04a35b4df08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.715510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:34.723915 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5fe3f-3542-4451-9d65-780be660833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.724594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5fe3f-3542-4451-9d65-780be660833c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.724833 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5fe3f-3542-4451-9d65-780be660833c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.725099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5fe3f-3542-4451-9d65-780be660833c admin admin] PATH_INFO: `/v3/projects/0d18f4006ab3420d9cf4ef34c7880ac7` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.726304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5fe3f-3542-4451-9d65-780be660833c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d18f4006ab3420d9cf4ef34c7880ac7)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.728249 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5fe3f-3542-4451-9d65-780be660833c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.734880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d567454e-6ef7-4608-88da-04a35b4df08e None None] MFA Rules not processed for user `83fb4f13c76d4ef49f59dded0c95a65a`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:34.736119 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d567454e-6ef7-4608-88da-04a35b4df08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:34.779738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-85a5fe3f-3542-4451-9d65-780be660833c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d18f4006ab3420d9cf4ef34c7880ac7', 'request_id': 'req-85a5fe3f-3542-4451-9d65-780be660833c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:34.789152 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-85a5fe3f-3542-4451-9d65-780be660833c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d18f4006ab3420d9cf4ef34c7880ac7', 'request_id': 'req-85a5fe3f-3542-4451-9d65-780be660833c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:34.795303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-85a5fe3f-3542-4451-9d65-780be660833c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d18f4006ab3420d9cf4ef34c7880ac7', 'request_id': 'req-85a5fe3f-3542-4451-9d65-780be660833c'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:34.806384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1309/2618] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:34.807200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-85a5fe3f-3542-4451-9d65-780be660833c admin admin] The token cache is being invalidate because project 0d18f4006ab3420d9cf4ef34c7880ac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:34.807335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567454e-6ef7-4608-88da-04a35b4df08e None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.807489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-85a5fe3f-3542-4451-9d65-780be660833c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:34.808135 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-85a5fe3f-3542-4451-9d65-780be660833c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:34.810291 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1310/2619] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:34 2022] DELETE /identity/v3/projects/0d18f4006ab3420d9cf4ef34c7880ac7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:34.813369 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:34.816120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19469199-2a7e-4ffe-b021-4816da2a85e5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.816398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19469199-2a7e-4ffe-b021-4816da2a85e5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.816661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19469199-2a7e-4ffe-b021-4816da2a85e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.823978 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567454e-6ef7-4608-88da-04a35b4df08e None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:34.839261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-19469199-2a7e-4ffe-b021-4816da2a85e5 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:34.840888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-19469199-2a7e-4ffe-b021-4816da2a85e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:34.885666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9b33e-2ae1-4ce3-ae52-8e4642962f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:34.886698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9b33e-2ae1-4ce3-ae52-8e4642962f01 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.887198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9b33e-2ae1-4ce3-ae52-8e4642962f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.887674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9b33e-2ae1-4ce3-ae52-8e4642962f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.888749 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9b33e-2ae1-4ce3-ae52-8e4642962f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:34.890905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9b33e-2ae1-4ce3-ae52-8e4642962f01 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:34.906205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1311/2620] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:34.907011 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19469199-2a7e-4ffe-b021-4816da2a85e5 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:34.908394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-19469199-2a7e-4ffe-b021-4816da2a85e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:34.923099 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1310/2621] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:34 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:34.924860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc08c5-0c01-4f46-93d3-58bfdc944fb8 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:34.925400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc08c5-0c01-4f46-93d3-58bfdc944fb8 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:34.926026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc08c5-0c01-4f46-93d3-58bfdc944fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:34.947943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f2fc08c5-0c01-4f46-93d3-58bfdc944fb8 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:34.949192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f2fc08c5-0c01-4f46-93d3-58bfdc944fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:34.973268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19469199-2a7e-4ffe-b021-4816da2a85e5 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.013865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:35.017625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1311/2622] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:35.018567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc08c5-0c01-4f46-93d3-58bfdc944fb8 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.019920 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f2fc08c5-0c01-4f46-93d3-58bfdc944fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:35.028889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bdfc9-e78b-40c4-80a8-680687e50978 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2402339784b34d98a4670db912617331', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.029545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bdfc9-e78b-40c4-80a8-680687e50978 service glance] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.029821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bdfc9-e78b-40c4-80a8-680687e50978 service glance] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.030091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bdfc9-e78b-40c4-80a8-680687e50978 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.031862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cf5bdfc9-e78b-40c4-80a8-680687e50978 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:35.032681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc08c5-0c01-4f46-93d3-58bfdc944fb8 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.041000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bf187-bcb1-4dc4-b3b1-8fa9a5e6d128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.041675 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bf187-bcb1-4dc4-b3b1-8fa9a5e6d128 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.041954 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bf187-bcb1-4dc4-b3b1-8fa9a5e6d128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.042233 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bf187-bcb1-4dc4-b3b1-8fa9a5e6d128 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.042915 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bf187-bcb1-4dc4-b3b1-8fa9a5e6d128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.044871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bf187-bcb1-4dc4-b3b1-8fa9a5e6d128 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.070262 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1312/2623] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:35 2022] POST /identity/v3/users => generated 297 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:35.071672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bf187-bcb1-4dc4-b3b1-8fa9a5e6d128 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.083511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bf187-bcb1-4dc4-b3b1-8fa9a5e6d128 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.088643 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e7f76-5039-48a3-a588-48fce2385434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.089267 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e7f76-5039-48a3-a588-48fce2385434 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.089578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e7f76-5039-48a3-a588-48fce2385434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.089858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e7f76-5039-48a3-a588-48fce2385434 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.090569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e7f76-5039-48a3-a588-48fce2385434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:35.090875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e7f76-5039-48a3-a588-48fce2385434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.092489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e7f76-5039-48a3-a588-48fce2385434 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.097940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bdfc9-e78b-40c4-80a8-680687e50978 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.099422 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bdfc9-e78b-40c4-80a8-680687e50978 service glance] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.106780 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1313/2624] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:35.107626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e7f76-5039-48a3-a588-48fce2385434 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.110702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1312/2625] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:35.111510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bdfc9-e78b-40c4-80a8-680687e50978 service glance] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.121669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e7f76-5039-48a3-a588-48fce2385434 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.122384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bdfc9-e78b-40c4-80a8-680687e50978 service glance] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.127071 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe33c26-9839-4f8d-a43f-5c4206811aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.127756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe33c26-9839-4f8d-a43f-5c4206811aaf admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.128038 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe33c26-9839-4f8d-a43f-5c4206811aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.128307 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe33c26-9839-4f8d-a43f-5c4206811aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.129001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe33c26-9839-4f8d-a43f-5c4206811aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.130712 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579b388-e7e5-4e2b-8ff5-635fbd6b4997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.130922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe33c26-9839-4f8d-a43f-5c4206811aaf admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.134015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579b388-e7e5-4e2b-8ff5-635fbd6b4997 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.134292 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579b388-e7e5-4e2b-8ff5-635fbd6b4997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.134567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579b388-e7e5-4e2b-8ff5-635fbd6b4997 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.135404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579b388-e7e5-4e2b-8ff5-635fbd6b4997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.137224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579b388-e7e5-4e2b-8ff5-635fbd6b4997 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.148085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1314/2626] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:35.152500 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579b388-e7e5-4e2b-8ff5-635fbd6b4997 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.165030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579b388-e7e5-4e2b-8ff5-635fbd6b4997 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.170717 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c72f-a136-40de-b694-c60335ce8ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.170880 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1313/2627] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:35 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:35.171471 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c72f-a136-40de-b694-c60335ce8ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.171791 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c72f-a136-40de-b694-c60335ce8ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.172065 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1c72f-a136-40de-b694-c60335ce8ef8 admin admin] PATH_INFO: `/v3/projects/6f4e23b1aba345968de1d2879e0e81bd/users/c9ea4b5ac69049f19a29285de48835b9/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.176386 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe33c26-9839-4f8d-a43f-5c4206811aaf admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.190081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1c72f-a136-40de-b694-c60335ce8ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4e23b1aba345968de1d2879e0e81bd, user_id=c9ea4b5ac69049f19a29285de48835b9, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.192841 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1c72f-a136-40de-b694-c60335ce8ef8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.211730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1315/2628] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:35 2022] PUT /identity/v3/projects/6f4e23b1aba345968de1d2879e0e81bd/users/c9ea4b5ac69049f19a29285de48835b9/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:35.216016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c72f-a136-40de-b694-c60335ce8ef8 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.245845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:35.260791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe33c26-9839-4f8d-a43f-5c4206811aaf admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.302549 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1c72f-a136-40de-b694-c60335ce8ef8 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.307727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbd470-b928-4488-95d1-86c0cdec9dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.308372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbd470-b928-4488-95d1-86c0cdec9dda admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.308705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbd470-b928-4488-95d1-86c0cdec9dda admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.308964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbd470-b928-4488-95d1-86c0cdec9dda admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.309662 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbd470-b928-4488-95d1-86c0cdec9dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.311308 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbd470-b928-4488-95d1-86c0cdec9dda admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.326874 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1316/2629] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:35.334927 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbd470-b928-4488-95d1-86c0cdec9dda admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.340959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c76f4-b2fe-4037-a63a-5dc78fa988e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.341985 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c76f4-b2fe-4037-a63a-5dc78fa988e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.342485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c76f4-b2fe-4037-a63a-5dc78fa988e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.342864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c76f4-b2fe-4037-a63a-5dc78fa988e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.343851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c76f4-b2fe-4037-a63a-5dc78fa988e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.347038 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c76f4-b2fe-4037-a63a-5dc78fa988e4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.353148 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbd470-b928-4488-95d1-86c0cdec9dda admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.361131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd230ec1-5b25-4162-b062-cde2c1e4f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.362000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd230ec1-5b25-4162-b062-cde2c1e4f518 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.362385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd230ec1-5b25-4162-b062-cde2c1e4f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.362823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd230ec1-5b25-4162-b062-cde2c1e4f518 admin admin] PATH_INFO: `/v3/projects/6f4e23b1aba345968de1d2879e0e81bd/users/c9ea4b5ac69049f19a29285de48835b9/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.366168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd230ec1-5b25-4162-b062-cde2c1e4f518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4e23b1aba345968de1d2879e0e81bd, user_id=c9ea4b5ac69049f19a29285de48835b9, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.370211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd230ec1-5b25-4162-b062-cde2c1e4f518 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.380608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1314/2630] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:35 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:35.386949 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c76f4-b2fe-4037-a63a-5dc78fa988e4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.390430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1317/2631] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:35 2022] PUT /identity/v3/projects/6f4e23b1aba345968de1d2879e0e81bd/users/c9ea4b5ac69049f19a29285de48835b9/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:35.400714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c76f4-b2fe-4037-a63a-5dc78fa988e4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.404115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09671fe-7e19-46ae-8df7-dea73267fcad None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.404410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09671fe-7e19-46ae-8df7-dea73267fcad None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.404684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09671fe-7e19-46ae-8df7-dea73267fcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.411436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:35.450469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f09671fe-7e19-46ae-8df7-dea73267fcad None None] MFA Rules not processed for user `c9ea4b5ac69049f19a29285de48835b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:35.452347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f09671fe-7e19-46ae-8df7-dea73267fcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:35.498099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95f38e-e8c0-4d41-9fc7-79b0a917491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.498684 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95f38e-e8c0-4d41-9fc7-79b0a917491b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.498941 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95f38e-e8c0-4d41-9fc7-79b0a917491b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.499250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95f38e-e8c0-4d41-9fc7-79b0a917491b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.500035 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95f38e-e8c0-4d41-9fc7-79b0a917491b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.501704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95f38e-e8c0-4d41-9fc7-79b0a917491b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.513322 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1315/2632] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:35.517355 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95f38e-e8c0-4d41-9fc7-79b0a917491b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.531536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95f38e-e8c0-4d41-9fc7-79b0a917491b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.537334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bce9e-5f12-450d-8bed-362d2ddd0546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.538327 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bce9e-5f12-450d-8bed-362d2ddd0546 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.538734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bce9e-5f12-450d-8bed-362d2ddd0546 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.539104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bce9e-5f12-450d-8bed-362d2ddd0546 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.541785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bce9e-5f12-450d-8bed-362d2ddd0546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.541785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10bce9e-5f12-450d-8bed-362d2ddd0546 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.554944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1316/2633] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:35.559277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bce9e-5f12-450d-8bed-362d2ddd0546 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.564121 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1318/2634] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:35.574156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10bce9e-5f12-450d-8bed-362d2ddd0546 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.577536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09671fe-7e19-46ae-8df7-dea73267fcad None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.579189 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f09671fe-7e19-46ae-8df7-dea73267fcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:35.582936 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d837e-7cea-4357-9aa7-5a2cc9af2f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.583638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d837e-7cea-4357-9aa7-5a2cc9af2f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.583917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d837e-7cea-4357-9aa7-5a2cc9af2f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.584188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d837e-7cea-4357-9aa7-5a2cc9af2f63 admin admin] PATH_INFO: `/v3/projects/c8e24298962e4e628f7a6e74eff37fb9/users/b2eefcec79fd44bea4168f73c543ccdf/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.602324 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d837e-7cea-4357-9aa7-5a2cc9af2f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e24298962e4e628f7a6e74eff37fb9, user_id=b2eefcec79fd44bea4168f73c543ccdf, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.605039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d837e-7cea-4357-9aa7-5a2cc9af2f63 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.622782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1317/2635] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:35 2022] PUT /identity/v3/projects/c8e24298962e4e628f7a6e74eff37fb9/users/b2eefcec79fd44bea4168f73c543ccdf/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:35.634282 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5500c-772b-4628-bcf1-1009d2f60367 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.634608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5500c-772b-4628-bcf1-1009d2f60367 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.636782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5500c-772b-4628-bcf1-1009d2f60367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.670773 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09671fe-7e19-46ae-8df7-dea73267fcad None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.673574 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2ef5500c-772b-4628-bcf1-1009d2f60367 None None] MFA Rules not processed for user `b2eefcec79fd44bea4168f73c543ccdf`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:35.674314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2ef5500c-772b-4628-bcf1-1009d2f60367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:35.755073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:35.759543 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1318/2636] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:35.762518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dc473-69ea-47b8-8c05-114f029e0afc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.763217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dc473-69ea-47b8-8c05-114f029e0afc service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.763631 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dc473-69ea-47b8-8c05-114f029e0afc service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.763909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dc473-69ea-47b8-8c05-114f029e0afc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.766860 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5500c-772b-4628-bcf1-1009d2f60367 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.768417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2ef5500c-772b-4628-bcf1-1009d2f60367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:35.782027 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5500c-772b-4628-bcf1-1009d2f60367 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.787261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964563f-6653-4a44-a3ce-66e19db5d6a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.788215 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964563f-6653-4a44-a3ce-66e19db5d6a9 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.788494 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964563f-6653-4a44-a3ce-66e19db5d6a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.788766 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964563f-6653-4a44-a3ce-66e19db5d6a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.799700 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964563f-6653-4a44-a3ce-66e19db5d6a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.801425 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964563f-6653-4a44-a3ce-66e19db5d6a9 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.811883 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1319/2637] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:51:35.836077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0dc473-69ea-47b8-8c05-114f029e0afc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:35.837713 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0dc473-69ea-47b8-8c05-114f029e0afc service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:35.851081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1319/2638] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:51:35.936781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964563f-6653-4a44-a3ce-66e19db5d6a9 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:35.945451 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964563f-6653-4a44-a3ce-66e19db5d6a9 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:35.951509 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19bc12-0a3c-4590-9e46-46f647af2a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:35.955280 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19bc12-0a3c-4590-9e46-46f647af2a8b service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:35.955280 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19bc12-0a3c-4590-9e46-46f647af2a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:35.955280 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19bc12-0a3c-4590-9e46-46f647af2a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:35.955280 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ec19bc12-0a3c-4590-9e46-46f647af2a8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:36.022067 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:36.042457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19bc12-0a3c-4590-9e46-46f647af2a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:36.045672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19bc12-0a3c-4590-9e46-46f647af2a8b service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:36.056104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1320/2639] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:36.417755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dc473-69ea-47b8-8c05-114f029e0afc service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:36.498205 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dc473-69ea-47b8-8c05-114f029e0afc service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:36.504958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:36.506870 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:36.507232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:36.507666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] PATH_INFO: `/v3/users/d577e1385cfd46e2ad71c99a7fd25ca4` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:36.509375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d577e1385cfd46e2ad71c99a7fd25ca4)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:36.512661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:36.578709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd577e1385cfd46e2ad71c99a7fd25ca4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:36.587018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd577e1385cfd46e2ad71c99a7fd25ca4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:36.587834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd577e1385cfd46e2ad71c99a7fd25ca4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:36.609440 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd577e1385cfd46e2ad71c99a7fd25ca4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:36.609807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd577e1385cfd46e2ad71c99a7fd25ca4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:36.628044 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1320/2640] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:36 2022] DELETE /identity/v3/users/d577e1385cfd46e2ad71c99a7fd25ca4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:36.632920 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f23815-fe57-41b9-a46d-d90ed7033698 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:36.633613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f23815-fe57-41b9-a46d-d90ed7033698 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:36.633613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f23815-fe57-41b9-a46d-d90ed7033698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:36.659746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f2f23815-fe57-41b9-a46d-d90ed7033698 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:36.661334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f2f23815-fe57-41b9-a46d-d90ed7033698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:36.733665 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1321/2641] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:36.744308 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:36.745488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:36.769871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:36.818725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a2b6b-e5b0-441e-973f-10f447c197a9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:36.822868 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0086988-902c-403b-867e-0040ae7dcf5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:36.823506 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0086988-902c-403b-867e-0040ae7dcf5f service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:36.823782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0086988-902c-403b-867e-0040ae7dcf5f service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:36.824055 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0086988-902c-403b-867e-0040ae7dcf5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:36.837726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0086988-902c-403b-867e-0040ae7dcf5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:36.839222 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0086988-902c-403b-867e-0040ae7dcf5f service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:36.850215 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1321/2642] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:37.153338 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f23815-fe57-41b9-a46d-d90ed7033698 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:37.154820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f2f23815-fe57-41b9-a46d-d90ed7033698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:37.167795 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f23815-fe57-41b9-a46d-d90ed7033698 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:37.176690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:37.177399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:37.177678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:37.177957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] PATH_INFO: `/v3/projects/16ec15b102a34cbbae8089cc3e8e09ed` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:37.179149 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ec15b102a34cbbae8089cc3e8e09ed)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:37.181051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:37.233113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ec15b102a34cbbae8089cc3e8e09ed', 'request_id': 'req-94b2a7d1-dfca-477d-ad78-05173d28875a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:37.243417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ec15b102a34cbbae8089cc3e8e09ed', 'request_id': 'req-94b2a7d1-dfca-477d-ad78-05173d28875a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:37.252468 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ec15b102a34cbbae8089cc3e8e09ed', 'request_id': 'req-94b2a7d1-dfca-477d-ad78-05173d28875a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:37.264049 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] The token cache is being invalidate because project 16ec15b102a34cbbae8089cc3e8e09ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:37.264428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:37.265120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:37.266736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1322/2643] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:37 2022] DELETE /identity/v3/projects/16ec15b102a34cbbae8089cc3e8e09ed => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:37.270894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0086988-902c-403b-867e-0040ae7dcf5f service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:37.281564 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0086988-902c-403b-867e-0040ae7dcf5f service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:37.345255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c4d6b-93b2-4799-a76a-b54906b7a49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:37.345979 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4d6b-93b2-4799-a76a-b54906b7a49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:37.346262 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4d6b-93b2-4799-a76a-b54906b7a49d admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:37.346541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4d6b-93b2-4799-a76a-b54906b7a49d admin admin] PATH_INFO: `/v3/users/c9ea4b5ac69049f19a29285de48835b9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:37.347784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c4d6b-93b2-4799-a76a-b54906b7a49d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ea4b5ac69049f19a29285de48835b9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:37.350148 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2c4d6b-93b2-4799-a76a-b54906b7a49d admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:37.414069 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7f2c4d6b-93b2-4799-a76a-b54906b7a49d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ea4b5ac69049f19a29285de48835b9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:37.423520 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7f2c4d6b-93b2-4799-a76a-b54906b7a49d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ea4b5ac69049f19a29285de48835b9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:37.424285 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7f2c4d6b-93b2-4799-a76a-b54906b7a49d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ea4b5ac69049f19a29285de48835b9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:37.440040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7f2c4d6b-93b2-4799-a76a-b54906b7a49d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ea4b5ac69049f19a29285de48835b9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:37.440823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7f2c4d6b-93b2-4799-a76a-b54906b7a49d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ea4b5ac69049f19a29285de48835b9'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:37.462037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1322/2644] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:37 2022] DELETE /identity/v3/users/c9ea4b5ac69049f19a29285de48835b9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:37.831040 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:37.833947 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:37.847971 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2a7d1-dfca-477d-ad78-05173d28875a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:37.925936 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:37.927682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:37.927965 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:37.928385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5 admin admin] PATH_INFO: `/v3/projects/6f4e23b1aba345968de1d2879e0e81bd` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:37.929630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f4e23b1aba345968de1d2879e0e81bd)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:37.931683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:37.945932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:38.002810 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f4e23b1aba345968de1d2879e0e81bd', 'request_id': 'req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:38.014112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f4e23b1aba345968de1d2879e0e81bd', 'request_id': 'req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:38.023297 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f4e23b1aba345968de1d2879e0e81bd', 'request_id': 'req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:38.039580 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5 admin admin] The token cache is being invalidate because project 6f4e23b1aba345968de1d2879e0e81bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:38.039880 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:38.040758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ffbe525e-d85b-4864-8f1d-7bdaa3a425b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:38.042408 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1323/2645] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:37 2022] DELETE /identity/v3/projects/6f4e23b1aba345968de1d2879e0e81bd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:38.047885 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b23a66-5eb3-4eba-84bc-6c7984cbde8f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:38.049084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b23a66-5eb3-4eba-84bc-6c7984cbde8f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:38.049510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b23a66-5eb3-4eba-84bc-6c7984cbde8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:38.075808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-03b23a66-5eb3-4eba-84bc-6c7984cbde8f None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:38.077046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-03b23a66-5eb3-4eba-84bc-6c7984cbde8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:38.115932 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:38.147255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1323/2646] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:38.155389 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b1bed-3b04-4a20-b6f3-0728eae8f6e0 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:38.155647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b1bed-3b04-4a20-b6f3-0728eae8f6e0 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:38.155924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b1bed-3b04-4a20-b6f3-0728eae8f6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:38.176541 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-789b1bed-3b04-4a20-b6f3-0728eae8f6e0 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:38.177579 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-789b1bed-3b04-4a20-b6f3-0728eae8f6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:38.186443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1324/2647] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:38.192538 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b23a66-5eb3-4eba-84bc-6c7984cbde8f None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:38.205407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b23a66-5eb3-4eba-84bc-6c7984cbde8f None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:38.210860 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895207a3-0cf4-4793-a189-b0e913252017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:38.211775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895207a3-0cf4-4793-a189-b0e913252017 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:38.212055 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895207a3-0cf4-4793-a189-b0e913252017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:38.212322 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895207a3-0cf4-4793-a189-b0e913252017 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:38.213043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895207a3-0cf4-4793-a189-b0e913252017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:38.213378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895207a3-0cf4-4793-a189-b0e913252017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:38.215043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895207a3-0cf4-4793-a189-b0e913252017 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:38.229726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1324/2648] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:38.234498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b1bed-3b04-4a20-b6f3-0728eae8f6e0 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:38.250609 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b1bed-3b04-4a20-b6f3-0728eae8f6e0 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:38.256157 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409e421-4bd4-4df9-800e-fcb597b14892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:38.256806 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409e421-4bd4-4df9-800e-fcb597b14892 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:38.257095 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409e421-4bd4-4df9-800e-fcb597b14892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:38.257417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409e421-4bd4-4df9-800e-fcb597b14892 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:38.258232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409e421-4bd4-4df9-800e-fcb597b14892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:38.260192 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409e421-4bd4-4df9-800e-fcb597b14892 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:38.315480 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1325/2649] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:38 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:38.319949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895207a3-0cf4-4793-a189-b0e913252017 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:38.331930 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895207a3-0cf4-4793-a189-b0e913252017 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:38.401754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e8d5b-2f72-4dd6-b7f5-b1f8c9030cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:38.402394 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8d5b-2f72-4dd6-b7f5-b1f8c9030cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:38.402672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8d5b-2f72-4dd6-b7f5-b1f8c9030cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:38.402948 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e8d5b-2f72-4dd6-b7f5-b1f8c9030cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:38.403630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e8d5b-2f72-4dd6-b7f5-b1f8c9030cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:38.405627 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e8d5b-2f72-4dd6-b7f5-b1f8c9030cb5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:38.429342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1325/2650] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:38 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:38.433578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409e421-4bd4-4df9-800e-fcb597b14892 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:38.444771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409e421-4bd4-4df9-800e-fcb597b14892 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:38.450273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d95e97-3c39-4dcd-8fdc-162346fd3c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:38.450991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d95e97-3c39-4dcd-8fdc-162346fd3c80 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:38.451396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d95e97-3c39-4dcd-8fdc-162346fd3c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:38.451756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d95e97-3c39-4dcd-8fdc-162346fd3c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:38.452466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d95e97-3c39-4dcd-8fdc-162346fd3c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:38.454121 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d95e97-3c39-4dcd-8fdc-162346fd3c80 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:38.466182 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1326/2651] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:38.470724 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e8d5b-2f72-4dd6-b7f5-b1f8c9030cb5 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:38.484865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e8d5b-2f72-4dd6-b7f5-b1f8c9030cb5 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:38.490436 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bff647-e06d-424c-b35c-add6c1dda49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:38.491071 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bff647-e06d-424c-b35c-add6c1dda49f admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:38.491354 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bff647-e06d-424c-b35c-add6c1dda49f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:38.491802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bff647-e06d-424c-b35c-add6c1dda49f admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:38.492790 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bff647-e06d-424c-b35c-add6c1dda49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:38.494454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bff647-e06d-424c-b35c-add6c1dda49f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:38.507160 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1326/2652] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:38.513417 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d95e97-3c39-4dcd-8fdc-162346fd3c80 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:38.514729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bff647-e06d-424c-b35c-add6c1dda49f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:38.516565 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c3bff647-e06d-424c-b35c-add6c1dda49f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:38.524657 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d95e97-3c39-4dcd-8fdc-162346fd3c80 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:38.530514 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c19ed-46a2-449d-8e4d-07ab7dd5a66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:38.531000 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bff647-e06d-424c-b35c-add6c1dda49f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:38.531200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c19ed-46a2-449d-8e4d-07ab7dd5a66a admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:38.531476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c19ed-46a2-449d-8e4d-07ab7dd5a66a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:38.531745 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c19ed-46a2-449d-8e4d-07ab7dd5a66a admin admin] PATH_INFO: `/v3/projects/f243c4833ee84644bc8dec001aee4c8e/users/e58000d915a34981a3856984c8eae9d0/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:38.536358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe3082-e547-444e-b066-c4735c59a7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:38.537108 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe3082-e547-444e-b066-c4735c59a7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:38.538203 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe3082-e547-444e-b066-c4735c59a7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:38.538590 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe3082-e547-444e-b066-c4735c59a7f8 admin admin] PATH_INFO: `/v3/users/b2eefcec79fd44bea4168f73c543ccdf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:38.542097 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe3082-e547-444e-b066-c4735c59a7f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2eefcec79fd44bea4168f73c543ccdf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:38.544429 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe3082-e547-444e-b066-c4735c59a7f8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:38.550828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c19ed-46a2-449d-8e4d-07ab7dd5a66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f243c4833ee84644bc8dec001aee4c8e, user_id=e58000d915a34981a3856984c8eae9d0, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:38.553972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c19ed-46a2-449d-8e4d-07ab7dd5a66a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:38.579404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1327/2653] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:38 2022] PUT /identity/v3/projects/f243c4833ee84644bc8dec001aee4c8e/users/e58000d915a34981a3856984c8eae9d0/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:38.639626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2cfe3082-e547-444e-b066-c4735c59a7f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2eefcec79fd44bea4168f73c543ccdf'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:38.647439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1193376-b540-45ab-a86c-58f73cd89736 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:38.647725 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1193376-b540-45ab-a86c-58f73cd89736 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:38.647998 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1193376-b540-45ab-a86c-58f73cd89736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:38.650191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2cfe3082-e547-444e-b066-c4735c59a7f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2eefcec79fd44bea4168f73c543ccdf'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:38.651161 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2cfe3082-e547-444e-b066-c4735c59a7f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2eefcec79fd44bea4168f73c543ccdf'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:38.667013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2cfe3082-e547-444e-b066-c4735c59a7f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2eefcec79fd44bea4168f73c543ccdf'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:38.667969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-2cfe3082-e547-444e-b066-c4735c59a7f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2eefcec79fd44bea4168f73c543ccdf'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:38.677362 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f1193376-b540-45ab-a86c-58f73cd89736 None None] MFA Rules not processed for user `e58000d915a34981a3856984c8eae9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:38.678756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f1193376-b540-45ab-a86c-58f73cd89736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:38.688260 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1327/2654] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:38 2022] DELETE /identity/v3/users/b2eefcec79fd44bea4168f73c543ccdf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:38.691118 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e17da-bafb-420d-bb9d-5492d392df50 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:38.691484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e17da-bafb-420d-bb9d-5492d392df50 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:38.691909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e17da-bafb-420d-bb9d-5492d392df50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:38.765400 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1328/2655] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:38.777812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1193376-b540-45ab-a86c-58f73cd89736 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:38.779690 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f1193376-b540-45ab-a86c-58f73cd89736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:38.830487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:38.854864 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-140e17da-bafb-420d-bb9d-5492d392df50 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:38.856103 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-140e17da-bafb-420d-bb9d-5492d392df50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:38.867326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:38.873021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1193376-b540-45ab-a86c-58f73cd89736 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:38.954614 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f646f-aac9-4f63-acf1-a83cb069c614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:38.955967 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f646f-aac9-4f63-acf1-a83cb069c614 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:38.956709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f646f-aac9-4f63-acf1-a83cb069c614 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:38.957133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f646f-aac9-4f63-acf1-a83cb069c614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:38.961317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1328/2656] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:38.972129 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e17da-bafb-420d-bb9d-5492d392df50 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:38.973793 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-140e17da-bafb-420d-bb9d-5492d392df50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:39.039703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f646f-aac9-4f63-acf1-a83cb069c614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:39.041237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f646f-aac9-4f63-acf1-a83cb069c614 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:39.052639 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1329/2657] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:51:39.075171 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e17da-bafb-420d-bb9d-5492d392df50 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:39.075331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f646f-aac9-4f63-acf1-a83cb069c614 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:39.076618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2b8f646f-aac9-4f63-acf1-a83cb069c614 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:39.080061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6da452-1a6e-4fa9-a42c-60ad911549d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:39.080704 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6da452-1a6e-4fa9-a42c-60ad911549d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:39.080984 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6da452-1a6e-4fa9-a42c-60ad911549d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:39.081654 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6da452-1a6e-4fa9-a42c-60ad911549d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:39.092225 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6da452-1a6e-4fa9-a42c-60ad911549d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:39.096964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6da452-1a6e-4fa9-a42c-60ad911549d8 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:39.097112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f646f-aac9-4f63-acf1-a83cb069c614 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:39.102394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:39.103141 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:39.103497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:39.103842 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] PATH_INFO: `/v3/users/e58000d915a34981a3856984c8eae9d0` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:39.104735 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1329/2658] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:39.105822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e58000d915a34981a3856984c8eae9d0)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:39.107974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:39.166495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e58000d915a34981a3856984c8eae9d0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:39.177983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e58000d915a34981a3856984c8eae9d0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:39.188275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e58000d915a34981a3856984c8eae9d0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:39.189331 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e58000d915a34981a3856984c8eae9d0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:39.218111 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e58000d915a34981a3856984c8eae9d0'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:39.227391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1330/2659] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:39 2022] DELETE /identity/v3/users/e58000d915a34981a3856984c8eae9d0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:39.231504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09d290-d530-4596-9761-358ce4f15dd7 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:39.231781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09d290-d530-4596-9761-358ce4f15dd7 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:39.232051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb09d290-d530-4596-9761-358ce4f15dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:39.262846 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cb09d290-d530-4596-9761-358ce4f15dd7 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:39.264512 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cb09d290-d530-4596-9761-358ce4f15dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:39.440761 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1330/2660] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:39.450537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:39.458836 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:39.474208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:39.537519 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024adae-88cb-4392-867f-e3e882f62a43 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:39.546889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52dae8-00ed-46cc-a612-3c88ece4c474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:39.547595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52dae8-00ed-46cc-a612-3c88ece4c474 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:39.547929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52dae8-00ed-46cc-a612-3c88ece4c474 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:39.548153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52dae8-00ed-46cc-a612-3c88ece4c474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:39.559731 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52dae8-00ed-46cc-a612-3c88ece4c474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:39.561252 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52dae8-00ed-46cc-a612-3c88ece4c474 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:39.581511 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1331/2661] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:51:39.596805 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09d290-d530-4596-9761-358ce4f15dd7 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:39.599559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cb09d290-d530-4596-9761-358ce4f15dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:39.619768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb09d290-d530-4596-9761-358ce4f15dd7 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:39.624837 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:39.625763 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:39.627156 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:39.628049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7 admin admin] PATH_INFO: `/v3/projects/c8e24298962e4e628f7a6e74eff37fb9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:39.630176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e24298962e4e628f7a6e74eff37fb9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:39.634049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:39.740890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e24298962e4e628f7a6e74eff37fb9', 'request_id': 'req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:39.750107 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e24298962e4e628f7a6e74eff37fb9', 'request_id': 'req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:39.754229 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:39.768821 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e24298962e4e628f7a6e74eff37fb9', 'request_id': 'req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:39.782383 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7 admin admin] The token cache is being invalidate because project c8e24298962e4e628f7a6e74eff37fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:39.782970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:39.783814 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-972e5e1e-6934-4537-9f26-ce3d4e6e78b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:39.785847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1331/2662] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:39 2022] DELETE /identity/v3/projects/c8e24298962e4e628f7a6e74eff37fb9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:39.790751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4583b3d-0e22-4c58-bc22-683db02a3dc9 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:39.791489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4583b3d-0e22-4c58-bc22-683db02a3dc9 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:39.791944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4583b3d-0e22-4c58-bc22-683db02a3dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:39.843716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a4583b3d-0e22-4c58-bc22-683db02a3dc9 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:39.845635 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a4583b3d-0e22-4c58-bc22-683db02a3dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:39.922015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1332/2663] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:39.932131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b81c0-ce34-4d4b-9171-9c9021876871 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:39.932131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b81c0-ce34-4d4b-9171-9c9021876871 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:39.932131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b81c0-ce34-4d4b-9171-9c9021876871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:39.961293 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a73b81c0-ce34-4d4b-9171-9c9021876871 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:39.962542 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a73b81c0-ce34-4d4b-9171-9c9021876871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:39.975715 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1332/2664] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:39.979774 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4583b3d-0e22-4c58-bc22-683db02a3dc9 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:39.992426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4583b3d-0e22-4c58-bc22-683db02a3dc9 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:39.998800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e583f-3ae0-41b8-b91f-934a5683cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:39.999449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e583f-3ae0-41b8-b91f-934a5683cf66 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:39.999730 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e583f-3ae0-41b8-b91f-934a5683cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:39.999998 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e583f-3ae0-41b8-b91f-934a5683cf66 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.000864 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e583f-3ae0-41b8-b91f-934a5683cf66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:40.001083 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e583f-3ae0-41b8-b91f-934a5683cf66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.002755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e583f-3ae0-41b8-b91f-934a5683cf66 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.015878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1333/2665] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:40.023667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b81c0-ce34-4d4b-9171-9c9021876871 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:40.030012 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e583f-3ae0-41b8-b91f-934a5683cf66 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:40.033269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1e2e583f-3ae0-41b8-b91f-934a5683cf66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:40.036576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b81c0-ce34-4d4b-9171-9c9021876871 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:40.049436 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e583f-3ae0-41b8-b91f-934a5683cf66 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:40.049707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd03698-4514-4738-8287-964841b95edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:40.050266 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd03698-4514-4738-8287-964841b95edd admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.050540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd03698-4514-4738-8287-964841b95edd admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.050825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd03698-4514-4738-8287-964841b95edd admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.053170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd03698-4514-4738-8287-964841b95edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.053586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd03698-4514-4738-8287-964841b95edd admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.066851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0c267-28e6-4011-be3a-e05a4bf455f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:40.069234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0c267-28e6-4011-be3a-e05a4bf455f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.069720 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0c267-28e6-4011-be3a-e05a4bf455f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.070341 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0c267-28e6-4011-be3a-e05a4bf455f1 admin admin] PATH_INFO: `/v3/projects/f243c4833ee84644bc8dec001aee4c8e` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.073259 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0c267-28e6-4011-be3a-e05a4bf455f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f243c4833ee84644bc8dec001aee4c8e)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.082621 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0c267-28e6-4011-be3a-e05a4bf455f1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.095054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1333/2666] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:40 2022] POST /identity/v3/projects => generated 399 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:40.096893 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd03698-4514-4738-8287-964841b95edd admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:40.165999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-01b0c267-28e6-4011-be3a-e05a4bf455f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f243c4833ee84644bc8dec001aee4c8e', 'request_id': 'req-01b0c267-28e6-4011-be3a-e05a4bf455f1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:40.188752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-01b0c267-28e6-4011-be3a-e05a4bf455f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f243c4833ee84644bc8dec001aee4c8e', 'request_id': 'req-01b0c267-28e6-4011-be3a-e05a4bf455f1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:40.196025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-01b0c267-28e6-4011-be3a-e05a4bf455f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f243c4833ee84644bc8dec001aee4c8e', 'request_id': 'req-01b0c267-28e6-4011-be3a-e05a4bf455f1'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:40.202547 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd03698-4514-4738-8287-964841b95edd admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:40.219248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-01b0c267-28e6-4011-be3a-e05a4bf455f1 admin admin] The token cache is being invalidate because project f243c4833ee84644bc8dec001aee4c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:40.219545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-01b0c267-28e6-4011-be3a-e05a4bf455f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:40.220214 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-01b0c267-28e6-4011-be3a-e05a4bf455f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:40.221990 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1334/2667] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:40 2022] DELETE /identity/v3/projects/f243c4833ee84644bc8dec001aee4c8e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:40.227686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff501a30-ac45-47ed-85e5-eeaf6fe340cb None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.227988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff501a30-ac45-47ed-85e5-eeaf6fe340cb None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.228383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff501a30-ac45-47ed-85e5-eeaf6fe340cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.271099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ff501a30-ac45-47ed-85e5-eeaf6fe340cb None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:40.272521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ff501a30-ac45-47ed-85e5-eeaf6fe340cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:40.283963 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c957021-5932-455c-b079-d444c66384e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:40.284893 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c957021-5932-455c-b079-d444c66384e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.285172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c957021-5932-455c-b079-d444c66384e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.286005 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c957021-5932-455c-b079-d444c66384e8 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.287097 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c957021-5932-455c-b079-d444c66384e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.289063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c957021-5932-455c-b079-d444c66384e8 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.298698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:40.333970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1334/2668] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:40 2022] POST /identity/v3/users => generated 300 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:40.335467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c957021-5932-455c-b079-d444c66384e8 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:40.338962 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2c957021-5932-455c-b079-d444c66384e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:40.361770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1335/2669] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:40.369364 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c957021-5932-455c-b079-d444c66384e8 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:40.376234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c927f-3426-4bd1-ab0b-d508a457f91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:40.377191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c927f-3426-4bd1-ab0b-d508a457f91c admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.377590 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c927f-3426-4bd1-ab0b-d508a457f91c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.377869 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c927f-3426-4bd1-ab0b-d508a457f91c admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.378608 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c927f-3426-4bd1-ab0b-d508a457f91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.380247 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c927f-3426-4bd1-ab0b-d508a457f91c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.386281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2a37b-4dcc-4f6d-893f-371c3919df03 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.386843 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2a37b-4dcc-4f6d-893f-371c3919df03 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.387201 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2a37b-4dcc-4f6d-893f-371c3919df03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.404510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1335/2670] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:40.417661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-6bb2a37b-4dcc-4f6d-893f-371c3919df03 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:40.418049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c927f-3426-4bd1-ab0b-d508a457f91c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:40.423204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6bb2a37b-4dcc-4f6d-893f-371c3919df03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:40.432062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c927f-3426-4bd1-ab0b-d508a457f91c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:40.436862 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1336/2671] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:40.438381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0e294-5374-41cd-aa39-7989e14669e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:40.439047 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0e294-5374-41cd-aa39-7989e14669e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.439395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0e294-5374-41cd-aa39-7989e14669e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.441137 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2a37b-4dcc-4f6d-893f-371c3919df03 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:40.445466 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0e294-5374-41cd-aa39-7989e14669e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.446651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0e294-5374-41cd-aa39-7989e14669e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.449114 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0e294-5374-41cd-aa39-7989e14669e6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.451793 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2a37b-4dcc-4f6d-893f-371c3919df03 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:40.458385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f90f3a-e05c-4cbc-8309-718fba01f600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:40.459076 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f90f3a-e05c-4cbc-8309-718fba01f600 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.459545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f90f3a-e05c-4cbc-8309-718fba01f600 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.459765 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f90f3a-e05c-4cbc-8309-718fba01f600 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.460544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f90f3a-e05c-4cbc-8309-718fba01f600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:40.461015 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f90f3a-e05c-4cbc-8309-718fba01f600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.462570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1336/2672] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:40.462857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f90f3a-e05c-4cbc-8309-718fba01f600 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.467444 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0e294-5374-41cd-aa39-7989e14669e6 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:40.477266 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1337/2673] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:40.478645 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0e294-5374-41cd-aa39-7989e14669e6 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:40.483567 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f90f3a-e05c-4cbc-8309-718fba01f600 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:40.488610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d9659-349a-4f06-bf52-cac8c32e7c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:40.488892 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d9659-349a-4f06-bf52-cac8c32e7c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.488994 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d9659-349a-4f06-bf52-cac8c32e7c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.489207 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d9659-349a-4f06-bf52-cac8c32e7c1a admin admin] PATH_INFO: `/v3/projects/75e190372e4941038a44d458de16c2d2/users/f04a4ee9ab48464b80bf42bb329e5a4f/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.496404 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f90f3a-e05c-4cbc-8309-718fba01f600 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:40.501790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef13e-b35f-436e-8e42-69418d0a3497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:40.502551 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef13e-b35f-436e-8e42-69418d0a3497 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.502958 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef13e-b35f-436e-8e42-69418d0a3497 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.503326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef13e-b35f-436e-8e42-69418d0a3497 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.504099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef13e-b35f-436e-8e42-69418d0a3497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.506254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef13e-b35f-436e-8e42-69418d0a3497 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.508484 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d9659-349a-4f06-bf52-cac8c32e7c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e190372e4941038a44d458de16c2d2, user_id=f04a4ee9ab48464b80bf42bb329e5a4f, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.511323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d9659-349a-4f06-bf52-cac8c32e7c1a admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.544339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1338/2675] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:40 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:40.545578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef13e-b35f-436e-8e42-69418d0a3497 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:40.545773 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1337/2675] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:40 2022] PUT /identity/v3/projects/75e190372e4941038a44d458de16c2d2/users/f04a4ee9ab48464b80bf42bb329e5a4f/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:40.554536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15095c-4ce0-4d10-9333-adce6fb68940 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.555084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15095c-4ce0-4d10-9333-adce6fb68940 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.556400 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15095c-4ce0-4d10-9333-adce6fb68940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.566968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:INSERT=6,keystone:DELETE=3,keystone:SELECT=91 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:40.596327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-8c15095c-4ce0-4d10-9333-adce6fb68940 None None] MFA Rules not processed for user `f04a4ee9ab48464b80bf42bb329e5a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:40.598111 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8c15095c-4ce0-4d10-9333-adce6fb68940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:40.640856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef13e-b35f-436e-8e42-69418d0a3497 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:40.650290 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440b83d-58c0-4f61-bf9e-85e1fea75c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:40.651702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440b83d-58c0-4f61-bf9e-85e1fea75c1b admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.652377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440b83d-58c0-4f61-bf9e-85e1fea75c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.652986 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440b83d-58c0-4f61-bf9e-85e1fea75c1b admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.655173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440b83d-58c0-4f61-bf9e-85e1fea75c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.657510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440b83d-58c0-4f61-bf9e-85e1fea75c1b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.696475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1339/2676] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:40 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:40.697689 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440b83d-58c0-4f61-bf9e-85e1fea75c1b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:40.697996 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1338/2677] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:40.705231 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15095c-4ce0-4d10-9333-adce6fb68940 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:40.708575 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8c15095c-4ce0-4d10-9333-adce6fb68940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:40.709397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440b83d-58c0-4f61-bf9e-85e1fea75c1b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:40.723569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987650-9b50-4a43-8528-882f7820f05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:40.723569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987650-9b50-4a43-8528-882f7820f05d admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.723569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987650-9b50-4a43-8528-882f7820f05d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.724664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34987650-9b50-4a43-8528-882f7820f05d admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.726521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34987650-9b50-4a43-8528-882f7820f05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.728279 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34987650-9b50-4a43-8528-882f7820f05d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.744655 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1340/2678] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:40.745907 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987650-9b50-4a43-8528-882f7820f05d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:40.758782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34987650-9b50-4a43-8528-882f7820f05d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:40.770800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9059d-8445-4f91-8aee-744f9b2db8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:40.771450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9059d-8445-4f91-8aee-744f9b2db8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.771731 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9059d-8445-4f91-8aee-744f9b2db8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.772001 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9059d-8445-4f91-8aee-744f9b2db8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.773008 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9059d-8445-4f91-8aee-744f9b2db8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.775239 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9059d-8445-4f91-8aee-744f9b2db8a8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.793058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1341/2679] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:40.794106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9059d-8445-4f91-8aee-744f9b2db8a8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:40.802587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15095c-4ce0-4d10-9333-adce6fb68940 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:40.805433 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9059d-8445-4f91-8aee-744f9b2db8a8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:40.809672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b209a-827d-41de-bc8d-11831c9de6e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:40.810939 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b209a-827d-41de-bc8d-11831c9de6e1 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.811456 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b209a-827d-41de-bc8d-11831c9de6e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.812040 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b209a-827d-41de-bc8d-11831c9de6e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.816284 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed1a1e-e86e-4652-9401-2ae1cbadee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:40.817089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed1a1e-e86e-4652-9401-2ae1cbadee3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.817399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed1a1e-e86e-4652-9401-2ae1cbadee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.817792 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed1a1e-e86e-4652-9401-2ae1cbadee3e admin admin] PATH_INFO: `/v3/projects/30a1535be6b34f4eb24c8982bf861032/users/31e5cf2de6a64e51b1dd6dfa82d0dd61/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.824442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b209a-827d-41de-bc8d-11831c9de6e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.827729 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b209a-827d-41de-bc8d-11831c9de6e1 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.835559 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed1a1e-e86e-4652-9401-2ae1cbadee3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a1535be6b34f4eb24c8982bf861032, user_id=31e5cf2de6a64e51b1dd6dfa82d0dd61, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:40.838546 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed1a1e-e86e-4652-9401-2ae1cbadee3e admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:40.851410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1339/2680] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:40.862296 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1342/2681] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:40 2022] PUT /identity/v3/projects/30a1535be6b34f4eb24c8982bf861032/users/31e5cf2de6a64e51b1dd6dfa82d0dd61/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:40.872341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253e152-f009-44c2-92bc-159496f29d42 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:40.872622 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253e152-f009-44c2-92bc-159496f29d42 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:40.872894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253e152-f009-44c2-92bc-159496f29d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:40.912355 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6253e152-f009-44c2-92bc-159496f29d42 None None] MFA Rules not processed for user `31e5cf2de6a64e51b1dd6dfa82d0dd61`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:40.913850 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6253e152-f009-44c2-92bc-159496f29d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:41.009433 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1340/2682] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:41.022204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed1a1e-e86e-4652-9401-2ae1cbadee3e admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:41.052478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:41.099286 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed1a1e-e86e-4652-9401-2ae1cbadee3e admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:41.106159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54dc37-a4e4-4c0b-a3ff-ae067f4e1d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:41.106802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54dc37-a4e4-4c0b-a3ff-ae067f4e1d17 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:41.107084 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54dc37-a4e4-4c0b-a3ff-ae067f4e1d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:41.107531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54dc37-a4e4-4c0b-a3ff-ae067f4e1d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:41.117375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54dc37-a4e4-4c0b-a3ff-ae067f4e1d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:41.118988 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54dc37-a4e4-4c0b-a3ff-ae067f4e1d17 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:41.131080 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1343/2683] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:41.158134 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253e152-f009-44c2-92bc-159496f29d42 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:41.194696 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:41.240034 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253e152-f009-44c2-92bc-159496f29d42 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:41.246018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:41.246687 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:41.246989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:41.247277 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] PATH_INFO: `/v3/users/31e5cf2de6a64e51b1dd6dfa82d0dd61` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:41.248643 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e5cf2de6a64e51b1dd6dfa82d0dd61)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:41.250949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:41.337960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e5cf2de6a64e51b1dd6dfa82d0dd61'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:41.357013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e5cf2de6a64e51b1dd6dfa82d0dd61'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:41.358319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e5cf2de6a64e51b1dd6dfa82d0dd61'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:41.375169 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e5cf2de6a64e51b1dd6dfa82d0dd61'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:41.375964 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e5cf2de6a64e51b1dd6dfa82d0dd61'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:41.403008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1341/2684] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:41 2022] DELETE /identity/v3/users/31e5cf2de6a64e51b1dd6dfa82d0dd61 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:41.407557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba362009-1a4e-42ed-bdbc-3724aee0c64a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:41.408050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba362009-1a4e-42ed-bdbc-3724aee0c64a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:41.408387 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba362009-1a4e-42ed-bdbc-3724aee0c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:41.429645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ba362009-1a4e-42ed-bdbc-3724aee0c64a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:41.430981 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ba362009-1a4e-42ed-bdbc-3724aee0c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:41.496059 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1344/2685] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:41.506273 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:41.507781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:41.567798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45743dc2-d7cd-44d4-9bc3-901cff00a697 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:41.571810 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a3cdb-ebe7-4fbe-98cb-4dbd38b1b123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:41.572458 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a3cdb-ebe7-4fbe-98cb-4dbd38b1b123 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:41.572737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a3cdb-ebe7-4fbe-98cb-4dbd38b1b123 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:41.573007 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a3cdb-ebe7-4fbe-98cb-4dbd38b1b123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:41.583351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a3cdb-ebe7-4fbe-98cb-4dbd38b1b123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:41.584822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a3cdb-ebe7-4fbe-98cb-4dbd38b1b123 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:41.594269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1342/2686] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:51:41.878422 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba362009-1a4e-42ed-bdbc-3724aee0c64a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:41.879878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ba362009-1a4e-42ed-bdbc-3724aee0c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:41.892245 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba362009-1a4e-42ed-bdbc-3724aee0c64a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:41.896953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629aed5-af71-4fba-a178-eb483b6864ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:41.897646 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629aed5-af71-4fba-a178-eb483b6864ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:41.897930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629aed5-af71-4fba-a178-eb483b6864ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:41.898208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629aed5-af71-4fba-a178-eb483b6864ab admin admin] PATH_INFO: `/v3/projects/30a1535be6b34f4eb24c8982bf861032` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:41.899628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629aed5-af71-4fba-a178-eb483b6864ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a1535be6b34f4eb24c8982bf861032)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:41.901647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629aed5-af71-4fba-a178-eb483b6864ab admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:41.952046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6629aed5-af71-4fba-a178-eb483b6864ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a1535be6b34f4eb24c8982bf861032', 'request_id': 'req-6629aed5-af71-4fba-a178-eb483b6864ab'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:41.960543 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6629aed5-af71-4fba-a178-eb483b6864ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a1535be6b34f4eb24c8982bf861032', 'request_id': 'req-6629aed5-af71-4fba-a178-eb483b6864ab'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:41.966682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6629aed5-af71-4fba-a178-eb483b6864ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a1535be6b34f4eb24c8982bf861032', 'request_id': 'req-6629aed5-af71-4fba-a178-eb483b6864ab'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:41.978624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6629aed5-af71-4fba-a178-eb483b6864ab admin admin] The token cache is being invalidate because project 30a1535be6b34f4eb24c8982bf861032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:41.978906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6629aed5-af71-4fba-a178-eb483b6864ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:41.979533 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6629aed5-af71-4fba-a178-eb483b6864ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:41.981159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1345/2687] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:41 2022] DELETE /identity/v3/projects/30a1535be6b34f4eb24c8982bf861032 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:41.987321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2171525-d3a3-479e-9018-2863295a5357 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:41.987571 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2171525-d3a3-479e-9018-2863295a5357 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:41.987851 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2171525-d3a3-479e-9018-2863295a5357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:42.010126 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e2171525-d3a3-479e-9018-2863295a5357 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:42.011261 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e2171525-d3a3-479e-9018-2863295a5357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:42.060401 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:42.078372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1343/2688] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:42.088056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa74a-a1ad-4292-93b8-578c5facf06a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:42.088595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa74a-a1ad-4292-93b8-578c5facf06a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:42.088595 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa74a-a1ad-4292-93b8-578c5facf06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:42.110098 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-697aa74a-a1ad-4292-93b8-578c5facf06a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:42.111310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-697aa74a-a1ad-4292-93b8-578c5facf06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:42.120293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1346/2689] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:42.124814 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2171525-d3a3-479e-9018-2863295a5357 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:42.138519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2171525-d3a3-479e-9018-2863295a5357 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:42.143656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d289d-bbc3-48d2-ba03-c36bebeefc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:42.144290 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d289d-bbc3-48d2-ba03-c36bebeefc24 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:42.144566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d289d-bbc3-48d2-ba03-c36bebeefc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:42.144831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d289d-bbc3-48d2-ba03-c36bebeefc24 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:42.145568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d289d-bbc3-48d2-ba03-c36bebeefc24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:42.145883 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d289d-bbc3-48d2-ba03-c36bebeefc24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:42.147672 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d289d-bbc3-48d2-ba03-c36bebeefc24 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:42.160191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1344/2690] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:42.164604 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697aa74a-a1ad-4292-93b8-578c5facf06a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:42.174091 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697aa74a-a1ad-4292-93b8-578c5facf06a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:42.181046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8cff8-ff46-4f46-a448-b0ff34bcb58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:42.181801 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8cff8-ff46-4f46-a448-b0ff34bcb58b admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:42.182096 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8cff8-ff46-4f46-a448-b0ff34bcb58b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:42.182396 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8cff8-ff46-4f46-a448-b0ff34bcb58b admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:42.183076 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8cff8-ff46-4f46-a448-b0ff34bcb58b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:42.185060 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8cff8-ff46-4f46-a448-b0ff34bcb58b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:42.216109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1347/2691] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:42 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:42.220301 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d289d-bbc3-48d2-ba03-c36bebeefc24 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:42.230568 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d289d-bbc3-48d2-ba03-c36bebeefc24 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:42.297335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af4265-b9c2-4151-833e-2f4d6c819dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:42.297982 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af4265-b9c2-4151-833e-2f4d6c819dee admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:42.298434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af4265-b9c2-4151-833e-2f4d6c819dee admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:42.298768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af4265-b9c2-4151-833e-2f4d6c819dee admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:42.299510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af4265-b9c2-4151-833e-2f4d6c819dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:42.301576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af4265-b9c2-4151-833e-2f4d6c819dee admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:42.335992 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1345/2692] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:42 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:42.341164 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8cff8-ff46-4f46-a448-b0ff34bcb58b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:42.354619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8cff8-ff46-4f46-a448-b0ff34bcb58b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:42.359518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bb768-f51d-486a-bd33-e9c31f6bdf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:42.360175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bb768-f51d-486a-bd33-e9c31f6bdf76 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:42.360450 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bb768-f51d-486a-bd33-e9c31f6bdf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:42.360712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bb768-f51d-486a-bd33-e9c31f6bdf76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:42.361581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bb768-f51d-486a-bd33-e9c31f6bdf76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:42.363198 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bb768-f51d-486a-bd33-e9c31f6bdf76 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:42.373644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1348/2693] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:42.377848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af4265-b9c2-4151-833e-2f4d6c819dee admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:42.390118 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af4265-b9c2-4151-833e-2f4d6c819dee admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:42.396146 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfb53b-5e59-4ffd-9937-da16c2b412e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:42.396774 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfb53b-5e59-4ffd-9937-da16c2b412e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:42.397051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfb53b-5e59-4ffd-9937-da16c2b412e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:42.397349 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfb53b-5e59-4ffd-9937-da16c2b412e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:42.398058 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfb53b-5e59-4ffd-9937-da16c2b412e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:42.399666 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfb53b-5e59-4ffd-9937-da16c2b412e9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:42.419345 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1346/2694] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:42.425072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bb768-f51d-486a-bd33-e9c31f6bdf76 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:42.437251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bb768-f51d-486a-bd33-e9c31f6bdf76 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:42.442550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150ebf4-b04d-4682-9345-ee1e1991f1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:42.443285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150ebf4-b04d-4682-9345-ee1e1991f1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:42.443565 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150ebf4-b04d-4682-9345-ee1e1991f1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:42.443835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150ebf4-b04d-4682-9345-ee1e1991f1c2 admin admin] PATH_INFO: `/v3/projects/b8fb12a886544ec7b32aedd9fe43ee01/users/8ec39c2bf1784b16b1fa357f763c2bdd/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:42.462661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:42.477977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150ebf4-b04d-4682-9345-ee1e1991f1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8fb12a886544ec7b32aedd9fe43ee01, user_id=8ec39c2bf1784b16b1fa357f763c2bdd, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:42.481342 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150ebf4-b04d-4682-9345-ee1e1991f1c2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:42.499344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1349/2695] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:42 2022] PUT /identity/v3/projects/b8fb12a886544ec7b32aedd9fe43ee01/users/8ec39c2bf1784b16b1fa357f763c2bdd/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:42.504503 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bc2d6-e185-44e9-8f50-9f1c75b3bc8f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:42.504792 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bc2d6-e185-44e9-8f50-9f1c75b3bc8f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:42.505067 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bc2d6-e185-44e9-8f50-9f1c75b3bc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:42.529784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-886bc2d6-e185-44e9-8f50-9f1c75b3bc8f None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:42.530933 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-886bc2d6-e185-44e9-8f50-9f1c75b3bc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:42.603779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1347/2696] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:42.615839 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150ebf4-b04d-4682-9345-ee1e1991f1c2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:42.617712 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2150ebf4-b04d-4682-9345-ee1e1991f1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:42.686145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150ebf4-b04d-4682-9345-ee1e1991f1c2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:42.689830 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963e943-8b6a-4041-8f22-13bf66830b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:42.690556 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963e943-8b6a-4041-8f22-13bf66830b0e service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:42.690840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963e943-8b6a-4041-8f22-13bf66830b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:42.691140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963e943-8b6a-4041-8f22-13bf66830b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:42.701461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963e943-8b6a-4041-8f22-13bf66830b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:42.703019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963e943-8b6a-4041-8f22-13bf66830b0e service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:42.714159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1350/2697] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:43.374357 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b33c-a424-4705-a867-5230cacaa153 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:43.374679 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b33c-a424-4705-a867-5230cacaa153 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:43.374917 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93b33c-a424-4705-a867-5230cacaa153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:43.403636 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-dc93b33c-a424-4705-a867-5230cacaa153 None None] MFA Rules not processed for user `8ec39c2bf1784b16b1fa357f763c2bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:43.404845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-dc93b33c-a424-4705-a867-5230cacaa153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:43.450263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:43.477172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1348/2698] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:43.490413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963e943-8b6a-4041-8f22-13bf66830b0e service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:43.491881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1963e943-8b6a-4041-8f22-13bf66830b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:43.552506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963e943-8b6a-4041-8f22-13bf66830b0e service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:43.556512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b948e6b-bfdb-41e3-9507-e7fcb4e5d32a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:43.557237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b948e6b-bfdb-41e3-9507-e7fcb4e5d32a service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:43.557583 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b948e6b-bfdb-41e3-9507-e7fcb4e5d32a service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:43.557977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b948e6b-bfdb-41e3-9507-e7fcb4e5d32a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:43.567042 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b948e6b-bfdb-41e3-9507-e7fcb4e5d32a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:43.568475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b948e6b-bfdb-41e3-9507-e7fcb4e5d32a service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:43.577550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1351/2699] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:43.713451 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93b33c-a424-4705-a867-5230cacaa153 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:43.719475 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93b33c-a424-4705-a867-5230cacaa153 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:43.723405 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c99dc7-0a22-4483-a475-b4452b4c057c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:43.724104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c99dc7-0a22-4483-a475-b4452b4c057c service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:43.724481 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c99dc7-0a22-4483-a475-b4452b4c057c service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:43.724786 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c99dc7-0a22-4483-a475-b4452b4c057c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:43.726760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d0c99dc7-0a22-4483-a475-b4452b4c057c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:43.739818 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c99dc7-0a22-4483-a475-b4452b4c057c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:43.741368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c99dc7-0a22-4483-a475-b4452b4c057c service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:43.752112 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1349/2700] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:45.021937 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5f186-1c7e-4c79-b366-1341826f2a42 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:45.022510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5f186-1c7e-4c79-b366-1341826f2a42 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:45.022510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5f186-1c7e-4c79-b366-1341826f2a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:45.049899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d0d5f186-1c7e-4c79-b366-1341826f2a42 None None] MFA Rules not processed for user `8ec39c2bf1784b16b1fa357f763c2bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:45.051464 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d0d5f186-1c7e-4c79-b366-1341826f2a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:45.069632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1352/2701] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:45.333536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c99dc7-0a22-4483-a475-b4452b4c057c service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:45.335120 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d0c99dc7-0a22-4483-a475-b4452b4c057c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:45.347523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c99dc7-0a22-4483-a475-b4452b4c057c service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:45.351959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ced90a-84c8-4f75-91e0-e419bd2a056c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:45.352590 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ced90a-84c8-4f75-91e0-e419bd2a056c service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:45.352866 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ced90a-84c8-4f75-91e0-e419bd2a056c service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:45.353131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ced90a-84c8-4f75-91e0-e419bd2a056c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:45.355106 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-64ced90a-84c8-4f75-91e0-e419bd2a056c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:45.367323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ced90a-84c8-4f75-91e0-e419bd2a056c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:45.368956 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ced90a-84c8-4f75-91e0-e419bd2a056c service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:45.378710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1350/2702] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:46.111966 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5f186-1c7e-4c79-b366-1341826f2a42 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:46.113660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d0d5f186-1c7e-4c79-b366-1341826f2a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:46.129692 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5f186-1c7e-4c79-b366-1341826f2a42 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:46.135964 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:46.137052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:46.137548 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:46.137912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] PATH_INFO: `/v3/users/f04a4ee9ab48464b80bf42bb329e5a4f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:46.139288 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04a4ee9ab48464b80bf42bb329e5a4f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:46.141537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:46.207863 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04a4ee9ab48464b80bf42bb329e5a4f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:46.215014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04a4ee9ab48464b80bf42bb329e5a4f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:46.223553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04a4ee9ab48464b80bf42bb329e5a4f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:46.224277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04a4ee9ab48464b80bf42bb329e5a4f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:46.240757 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04a4ee9ab48464b80bf42bb329e5a4f'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:46.242602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:46.248913 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1353/2703] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:46 2022] DELETE /identity/v3/users/f04a4ee9ab48464b80bf42bb329e5a4f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:46.253170 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d9361-2d31-4d34-9195-00bd44c66766 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:46.253518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d9361-2d31-4d34-9195-00bd44c66766 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:46.253767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d9361-2d31-4d34-9195-00bd44c66766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:46.273265 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9a4d9361-2d31-4d34-9195-00bd44c66766 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:46.274632 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9a4d9361-2d31-4d34-9195-00bd44c66766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:46.339831 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1351/2704] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:46.350240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:46.351935 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:46.410516 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab33e2-896b-4f21-bcae-76f3355639b8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:46.414240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e633d66-7c9f-4b3f-ba1d-97674fae9d71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:46.414866 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e633d66-7c9f-4b3f-ba1d-97674fae9d71 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:46.415146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e633d66-7c9f-4b3f-ba1d-97674fae9d71 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:46.415418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e633d66-7c9f-4b3f-ba1d-97674fae9d71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:46.424751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e633d66-7c9f-4b3f-ba1d-97674fae9d71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:46.426234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e633d66-7c9f-4b3f-ba1d-97674fae9d71 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:46.436428 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1354/2705] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:46.800155 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d9361-2d31-4d34-9195-00bd44c66766 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:46.801931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9a4d9361-2d31-4d34-9195-00bd44c66766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:46.823298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d9361-2d31-4d34-9195-00bd44c66766 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:46.837028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:46.837853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:46.838836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:46.839342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] PATH_INFO: `/v3/projects/75e190372e4941038a44d458de16c2d2` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:46.840713 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e190372e4941038a44d458de16c2d2)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:46.847635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:46.913249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e190372e4941038a44d458de16c2d2', 'request_id': 'req-a83e0fde-1eef-4718-82cb-2e1193afab71'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:46.921275 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e190372e4941038a44d458de16c2d2', 'request_id': 'req-a83e0fde-1eef-4718-82cb-2e1193afab71'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:46.932959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e190372e4941038a44d458de16c2d2', 'request_id': 'req-a83e0fde-1eef-4718-82cb-2e1193afab71'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:46.945872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] The token cache is being invalidate because project 75e190372e4941038a44d458de16c2d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:46.946163 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:46.946804 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:46.948517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1352/2706] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:46 2022] DELETE /identity/v3/projects/75e190372e4941038a44d458de16c2d2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:47.302131 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e633d66-7c9f-4b3f-ba1d-97674fae9d71 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:47.304751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-8e633d66-7c9f-4b3f-ba1d-97674fae9d71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:47.325709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e633d66-7c9f-4b3f-ba1d-97674fae9d71 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:47.390800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee8331-683d-47e1-8d66-6f62778d02c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:47.391472 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee8331-683d-47e1-8d66-6f62778d02c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:47.391758 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee8331-683d-47e1-8d66-6f62778d02c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:47.392070 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee8331-683d-47e1-8d66-6f62778d02c2 admin admin] PATH_INFO: `/v3/users/adea8e6fd0cb47f394e811865db51ade` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:47.393687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee8331-683d-47e1-8d66-6f62778d02c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adea8e6fd0cb47f394e811865db51ade)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:47.395660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee8331-683d-47e1-8d66-6f62778d02c2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:47.454675 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9fee8331-683d-47e1-8d66-6f62778d02c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adea8e6fd0cb47f394e811865db51ade'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:47.464361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9fee8331-683d-47e1-8d66-6f62778d02c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adea8e6fd0cb47f394e811865db51ade'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:47.472675 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9fee8331-683d-47e1-8d66-6f62778d02c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adea8e6fd0cb47f394e811865db51ade'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:47.473393 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9fee8331-683d-47e1-8d66-6f62778d02c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adea8e6fd0cb47f394e811865db51ade'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:47.490946 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-9fee8331-683d-47e1-8d66-6f62778d02c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adea8e6fd0cb47f394e811865db51ade'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:47.502736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1355/2707] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:47 2022] DELETE /identity/v3/users/adea8e6fd0cb47f394e811865db51ade => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:47.686954 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:47.688519 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:47.704293 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0fde-1eef-4718-82cb-2e1193afab71 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:47.746996 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:47.765083 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212c1d0-bcd9-4333-a952-3abfc199ddd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:47.765808 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212c1d0-bcd9-4333-a952-3abfc199ddd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:47.766068 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212c1d0-bcd9-4333-a952-3abfc199ddd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:47.766336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212c1d0-bcd9-4333-a952-3abfc199ddd4 admin admin] PATH_INFO: `/v3/projects/f4e2694e4ec547b8a028b545da0f3c9e` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:47.767588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212c1d0-bcd9-4333-a952-3abfc199ddd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e2694e4ec547b8a028b545da0f3c9e)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:47.769527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212c1d0-bcd9-4333-a952-3abfc199ddd4 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:47.816343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1212c1d0-bcd9-4333-a952-3abfc199ddd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e2694e4ec547b8a028b545da0f3c9e', 'request_id': 'req-1212c1d0-bcd9-4333-a952-3abfc199ddd4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:47.822338 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1212c1d0-bcd9-4333-a952-3abfc199ddd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e2694e4ec547b8a028b545da0f3c9e', 'request_id': 'req-1212c1d0-bcd9-4333-a952-3abfc199ddd4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:47.831646 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1212c1d0-bcd9-4333-a952-3abfc199ddd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e2694e4ec547b8a028b545da0f3c9e', 'request_id': 'req-1212c1d0-bcd9-4333-a952-3abfc199ddd4'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:47.842053 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1212c1d0-bcd9-4333-a952-3abfc199ddd4 admin admin] The token cache is being invalidate because project f4e2694e4ec547b8a028b545da0f3c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:47.842352 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1212c1d0-bcd9-4333-a952-3abfc199ddd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:47.842946 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1212c1d0-bcd9-4333-a952-3abfc199ddd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:47.844437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1353/2708] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:47 2022] DELETE /identity/v3/projects/f4e2694e4ec547b8a028b545da0f3c9e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:47.849693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5a2b2-01d2-4689-ba95-4ce35674ab78 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:47.849980 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5a2b2-01d2-4689-ba95-4ce35674ab78 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:47.850421 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5a2b2-01d2-4689-ba95-4ce35674ab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:47.872512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-99a5a2b2-01d2-4689-ba95-4ce35674ab78 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:47.873906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-99a5a2b2-01d2-4689-ba95-4ce35674ab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:47.888212 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:47.942786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1356/2709] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:47.955413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c14ec-0e82-419c-9c6d-2b2e473449ae None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:47.955751 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c14ec-0e82-419c-9c6d-2b2e473449ae None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:47.956395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c14ec-0e82-419c-9c6d-2b2e473449ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:47.977375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6a1c14ec-0e82-419c-9c6d-2b2e473449ae None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:47.978597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6a1c14ec-0e82-419c-9c6d-2b2e473449ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:47.991477 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1354/2710] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:47.992859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5a2b2-01d2-4689-ba95-4ce35674ab78 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:48.002908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5a2b2-01d2-4689-ba95-4ce35674ab78 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:48.008159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c06d1-2cb8-4f4f-a50d-433cbb040292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:48.008781 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c06d1-2cb8-4f4f-a50d-433cbb040292 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:48.009055 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c06d1-2cb8-4f4f-a50d-433cbb040292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:48.009365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c06d1-2cb8-4f4f-a50d-433cbb040292 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:48.010097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c06d1-2cb8-4f4f-a50d-433cbb040292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:48.010383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c06d1-2cb8-4f4f-a50d-433cbb040292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:48.012002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c06d1-2cb8-4f4f-a50d-433cbb040292 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:48.025764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1357/2711] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:51:48.030671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c14ec-0e82-419c-9c6d-2b2e473449ae None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:48.041090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c14ec-0e82-419c-9c6d-2b2e473449ae None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:48.046065 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ac9f4-e26d-4aeb-bf87-f163a6b3a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:48.046702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ac9f4-e26d-4aeb-bf87-f163a6b3a37e admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:48.046982 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ac9f4-e26d-4aeb-bf87-f163a6b3a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:48.047254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ac9f4-e26d-4aeb-bf87-f163a6b3a37e admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:48.047942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ac9f4-e26d-4aeb-bf87-f163a6b3a37e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:48.050047 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ac9f4-e26d-4aeb-bf87-f163a6b3a37e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:48.091410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1355/2712] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:48 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:48.092364 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c06d1-2cb8-4f4f-a50d-433cbb040292 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:48.103847 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c06d1-2cb8-4f4f-a50d-433cbb040292 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:48.170182 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062bb83-8d18-4c64-8154-e50001ff817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:48.170819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062bb83-8d18-4c64-8154-e50001ff817f admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:48.171097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062bb83-8d18-4c64-8154-e50001ff817f admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:48.171367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062bb83-8d18-4c64-8154-e50001ff817f admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:48.172034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062bb83-8d18-4c64-8154-e50001ff817f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:48.173991 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062bb83-8d18-4c64-8154-e50001ff817f admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:48.201334 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1358/2713] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:48 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:48.204168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ac9f4-e26d-4aeb-bf87-f163a6b3a37e admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:48.216131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ac9f4-e26d-4aeb-bf87-f163a6b3a37e admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:48.221068 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab062a-d40a-45ac-83e0-f3c44a2fd31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:48.221858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab062a-d40a-45ac-83e0-f3c44a2fd31f admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:48.222198 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab062a-d40a-45ac-83e0-f3c44a2fd31f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:48.222550 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab062a-d40a-45ac-83e0-f3c44a2fd31f admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:48.223341 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab062a-d40a-45ac-83e0-f3c44a2fd31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:48.224998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab062a-d40a-45ac-83e0-f3c44a2fd31f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:48.235880 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1356/2714] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:48.240398 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062bb83-8d18-4c64-8154-e50001ff817f admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:48.250767 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062bb83-8d18-4c64-8154-e50001ff817f admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:48.255475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6ba4d-7607-44d4-96bc-975e4079f348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:48.256070 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6ba4d-7607-44d4-96bc-975e4079f348 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:48.256354 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6ba4d-7607-44d4-96bc-975e4079f348 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:48.256629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6ba4d-7607-44d4-96bc-975e4079f348 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:48.257376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6ba4d-7607-44d4-96bc-975e4079f348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:48.259050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6ba4d-7607-44d4-96bc-975e4079f348 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:48.275120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1359/2715] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:48.279509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab062a-d40a-45ac-83e0-f3c44a2fd31f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:48.289905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab062a-d40a-45ac-83e0-f3c44a2fd31f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:48.294437 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f00c7-10c0-4a97-8740-af4fd5fe6a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:48.295105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f00c7-10c0-4a97-8740-af4fd5fe6a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:48.295541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f00c7-10c0-4a97-8740-af4fd5fe6a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:48.295711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f00c7-10c0-4a97-8740-af4fd5fe6a9c admin admin] PATH_INFO: `/v3/projects/5e42fcae0aa94eaa87247899eb38ff5f/users/e5dcee5baeaf4c4bab0d27b058240940/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:48.311360 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f00c7-10c0-4a97-8740-af4fd5fe6a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e42fcae0aa94eaa87247899eb38ff5f, user_id=e5dcee5baeaf4c4bab0d27b058240940, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:48.314001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f00c7-10c0-4a97-8740-af4fd5fe6a9c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:48.328987 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1357/2716] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:48 2022] PUT /identity/v3/projects/5e42fcae0aa94eaa87247899eb38ff5f/users/e5dcee5baeaf4c4bab0d27b058240940/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:48.340819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d40b4-cace-48e6-839a-d2ecf6942aff None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:48.341392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d40b4-cace-48e6-839a-d2ecf6942aff None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:48.341392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d40b4-cace-48e6-839a-d2ecf6942aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:48.371315 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bc7d40b4-cace-48e6-839a-d2ecf6942aff None None] MFA Rules not processed for user `e5dcee5baeaf4c4bab0d27b058240940`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:48.372535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bc7d40b4-cace-48e6-839a-d2ecf6942aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:48.446063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1360/2717] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:48.458415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f00c7-10c0-4a97-8740-af4fd5fe6a9c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:48.460327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-419f00c7-10c0-4a97-8740-af4fd5fe6a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:48.525435 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f00c7-10c0-4a97-8740-af4fd5fe6a9c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:48.529633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5f3ad-7d31-4afc-8208-7a1530a73056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:48.530285 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5f3ad-7d31-4afc-8208-7a1530a73056 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:48.530541 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5f3ad-7d31-4afc-8208-7a1530a73056 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:48.530812 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5f3ad-7d31-4afc-8208-7a1530a73056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:48.540664 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5f3ad-7d31-4afc-8208-7a1530a73056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:48.542347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5f3ad-7d31-4afc-8208-7a1530a73056 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:48.553887 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1358/2718] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:54.665303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d40b4-cace-48e6-839a-d2ecf6942aff None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:54.667102 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bc7d40b4-cace-48e6-839a-d2ecf6942aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:54.687272 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:54.746635 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d40b4-cace-48e6-839a-d2ecf6942aff None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:54.752488 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a1154-9fd1-4107-8e21-da54d199b5ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:54.753074 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a1154-9fd1-4107-8e21-da54d199b5ad service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:54.753375 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a1154-9fd1-4107-8e21-da54d199b5ad service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:54.753643 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a1154-9fd1-4107-8e21-da54d199b5ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:54.755550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-682a1154-9fd1-4107-8e21-da54d199b5ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:54.767918 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a1154-9fd1-4107-8e21-da54d199b5ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:54.769513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a1154-9fd1-4107-8e21-da54d199b5ad service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:54.780273 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1361/2719] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:57.165186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5f3ad-7d31-4afc-8208-7a1530a73056 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:57.179110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:57.235117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5f3ad-7d31-4afc-8208-7a1530a73056 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:57.239593 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51021ed-e880-4833-be97-78d3a4de808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:57.240235 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51021ed-e880-4833-be97-78d3a4de808e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:57.240510 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51021ed-e880-4833-be97-78d3a4de808e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:57.240779 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51021ed-e880-4833-be97-78d3a4de808e admin admin] PATH_INFO: `/v3/users/e5dcee5baeaf4c4bab0d27b058240940` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:57.241950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51021ed-e880-4833-be97-78d3a4de808e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5dcee5baeaf4c4bab0d27b058240940)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:57.243871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51021ed-e880-4833-be97-78d3a4de808e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:57.272983 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a1154-9fd1-4107-8e21-da54d199b5ad service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:57.274746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-682a1154-9fd1-4107-8e21-da54d199b5ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:57.292479 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a1154-9fd1-4107-8e21-da54d199b5ad service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:57.297796 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7f887-bc51-4e6f-86aa-a37ae7264e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:57.298605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f887-bc51-4e6f-86aa-a37ae7264e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:57.298908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f887-bc51-4e6f-86aa-a37ae7264e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:57.299189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7f887-bc51-4e6f-86aa-a37ae7264e95 admin admin] PATH_INFO: `/v3/users/83fb4f13c76d4ef49f59dded0c95a65a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:57.300456 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7f887-bc51-4e6f-86aa-a37ae7264e95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83fb4f13c76d4ef49f59dded0c95a65a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:57.301172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a51021ed-e880-4833-be97-78d3a4de808e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5dcee5baeaf4c4bab0d27b058240940'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:57.302438 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7f887-bc51-4e6f-86aa-a37ae7264e95 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:57.309795 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a51021ed-e880-4833-be97-78d3a4de808e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5dcee5baeaf4c4bab0d27b058240940'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:57.310539 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a51021ed-e880-4833-be97-78d3a4de808e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5dcee5baeaf4c4bab0d27b058240940'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:57.325708 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a51021ed-e880-4833-be97-78d3a4de808e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5dcee5baeaf4c4bab0d27b058240940'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:57.326432 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-a51021ed-e880-4833-be97-78d3a4de808e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5dcee5baeaf4c4bab0d27b058240940'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:57.342074 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1359/2720] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:57 2022] DELETE /identity/v3/users/e5dcee5baeaf4c4bab0d27b058240940 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:57.347193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c45c0-5bc0-4a99-8981-14d0a815f0af None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:57.347476 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c45c0-5bc0-4a99-8981-14d0a815f0af None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:57.347888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c45c0-5bc0-4a99-8981-14d0a815f0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:57.354921 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5da7f887-bc51-4e6f-86aa-a37ae7264e95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83fb4f13c76d4ef49f59dded0c95a65a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:57.362831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5da7f887-bc51-4e6f-86aa-a37ae7264e95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83fb4f13c76d4ef49f59dded0c95a65a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:57.367363 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4f2c45c0-5bc0-4a99-8981-14d0a815f0af None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:57.368635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4f2c45c0-5bc0-4a99-8981-14d0a815f0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:57.371708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5da7f887-bc51-4e6f-86aa-a37ae7264e95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83fb4f13c76d4ef49f59dded0c95a65a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:57.372463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5da7f887-bc51-4e6f-86aa-a37ae7264e95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83fb4f13c76d4ef49f59dded0c95a65a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:57.385810 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-5da7f887-bc51-4e6f-86aa-a37ae7264e95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83fb4f13c76d4ef49f59dded0c95a65a'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:57.391999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1362/2721] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:51:57 2022] DELETE /identity/v3/users/83fb4f13c76d4ef49f59dded0c95a65a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:57.396762 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530354e-6104-4869-89bf-73f409482e09 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:57.397052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530354e-6104-4869-89bf-73f409482e09 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:57.397361 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530354e-6104-4869-89bf-73f409482e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:57.416749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2530354e-6104-4869-89bf-73f409482e09 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:57.418343 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2530354e-6104-4869-89bf-73f409482e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:57.430912 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1360/2722] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:57.440901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c45c0-5bc0-4a99-8981-14d0a815f0af None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:57.442621 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4f2c45c0-5bc0-4a99-8981-14d0a815f0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:57.483969 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:57.500178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1363/2723] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:57.510537 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530354e-6104-4869-89bf-73f409482e09 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:57.512019 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2530354e-6104-4869-89bf-73f409482e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:57.520194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c45c0-5bc0-4a99-8981-14d0a815f0af None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:57.527208 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:57.574623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b0019-3e83-4792-a9bc-15bb9c098b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:57.575573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b0019-3e83-4792-a9bc-15bb9c098b03 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:57.578150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b0019-3e83-4792-a9bc-15bb9c098b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:57.579043 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b0019-3e83-4792-a9bc-15bb9c098b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:57.580027 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530354e-6104-4869-89bf-73f409482e09 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:57.584413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7147caa-8e43-4dcf-ac96-7856eb25a92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:57.585080 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7147caa-8e43-4dcf-ac96-7856eb25a92d service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:57.585366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7147caa-8e43-4dcf-ac96-7856eb25a92d service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:57.585787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7147caa-8e43-4dcf-ac96-7856eb25a92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:57.589785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b0019-3e83-4792-a9bc-15bb9c098b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:57.591247 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b0019-3e83-4792-a9bc-15bb9c098b03 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:57.601300 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1361/2724] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:57.605716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7147caa-8e43-4dcf-ac96-7856eb25a92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:57.608596 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7147caa-8e43-4dcf-ac96-7856eb25a92d service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:57.623770 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1364/2725] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:51:58.288614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b0019-3e83-4792-a9bc-15bb9c098b03 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.290522 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-423b0019-3e83-4792-a9bc-15bb9c098b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:58.296052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7147caa-8e43-4dcf-ac96-7856eb25a92d service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.297754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e7147caa-8e43-4dcf-ac96-7856eb25a92d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:58.309905 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b0019-3e83-4792-a9bc-15bb9c098b03 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.315403 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115fdcf-6779-4f51-a872-2c329589fde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.316104 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115fdcf-6779-4f51-a872-2c329589fde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.316443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115fdcf-6779-4f51-a872-2c329589fde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.316772 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115fdcf-6779-4f51-a872-2c329589fde2 admin admin] PATH_INFO: `/v3/projects/8f75f3a52a9e40b2b4153add23e05cfb` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.317983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115fdcf-6779-4f51-a872-2c329589fde2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f75f3a52a9e40b2b4153add23e05cfb)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.320041 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115fdcf-6779-4f51-a872-2c329589fde2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.332234 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7147caa-8e43-4dcf-ac96-7856eb25a92d service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.338017 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a0028-04e7-46d1-8e22-358f9bfdb331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.338810 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a0028-04e7-46d1-8e22-358f9bfdb331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.339390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a0028-04e7-46d1-8e22-358f9bfdb331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.339670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a0028-04e7-46d1-8e22-358f9bfdb331 admin admin] PATH_INFO: `/v3/projects/5e42fcae0aa94eaa87247899eb38ff5f` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.341211 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a0028-04e7-46d1-8e22-358f9bfdb331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e42fcae0aa94eaa87247899eb38ff5f)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.343646 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a0028-04e7-46d1-8e22-358f9bfdb331 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.377157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4115fdcf-6779-4f51-a872-2c329589fde2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f75f3a52a9e40b2b4153add23e05cfb', 'request_id': 'req-4115fdcf-6779-4f51-a872-2c329589fde2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:58.385467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4115fdcf-6779-4f51-a872-2c329589fde2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f75f3a52a9e40b2b4153add23e05cfb', 'request_id': 'req-4115fdcf-6779-4f51-a872-2c329589fde2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:58.394182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4115fdcf-6779-4f51-a872-2c329589fde2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f75f3a52a9e40b2b4153add23e05cfb', 'request_id': 'req-4115fdcf-6779-4f51-a872-2c329589fde2'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:58.401242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e49a0028-04e7-46d1-8e22-358f9bfdb331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e42fcae0aa94eaa87247899eb38ff5f', 'request_id': 'req-e49a0028-04e7-46d1-8e22-358f9bfdb331'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:58.408031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4115fdcf-6779-4f51-a872-2c329589fde2 admin admin] The token cache is being invalidate because project 8f75f3a52a9e40b2b4153add23e05cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:58.408336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4115fdcf-6779-4f51-a872-2c329589fde2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:58.409254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-4115fdcf-6779-4f51-a872-2c329589fde2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:58.411619 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e49a0028-04e7-46d1-8e22-358f9bfdb331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e42fcae0aa94eaa87247899eb38ff5f', 'request_id': 'req-e49a0028-04e7-46d1-8e22-358f9bfdb331'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:58.415657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1362/2726] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:58 2022] DELETE /identity/v3/projects/8f75f3a52a9e40b2b4153add23e05cfb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:58.417276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4bfe2-bd96-4fa6-8de6-cbeb5736137f None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.417587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4bfe2-bd96-4fa6-8de6-cbeb5736137f None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.417915 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4bfe2-bd96-4fa6-8de6-cbeb5736137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.420629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e49a0028-04e7-46d1-8e22-358f9bfdb331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e42fcae0aa94eaa87247899eb38ff5f', 'request_id': 'req-e49a0028-04e7-46d1-8e22-358f9bfdb331'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:58.434279 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e49a0028-04e7-46d1-8e22-358f9bfdb331 admin admin] The token cache is being invalidate because project 5e42fcae0aa94eaa87247899eb38ff5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:51:58.434658 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e49a0028-04e7-46d1-8e22-358f9bfdb331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:58.435389 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e49a0028-04e7-46d1-8e22-358f9bfdb331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:51:58.436971 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1365/2727] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:51:58 2022] DELETE /identity/v3/projects/5e42fcae0aa94eaa87247899eb38ff5f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:58.443164 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22716fa2-f2b8-4996-9257-a4d7f31ecac5 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.443449 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22716fa2-f2b8-4996-9257-a4d7f31ecac5 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.443727 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22716fa2-f2b8-4996-9257-a4d7f31ecac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.444031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-36c4bfe2-bd96-4fa6-8de6-cbeb5736137f None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:58.445378 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-36c4bfe2-bd96-4fa6-8de6-cbeb5736137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:58.464800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-22716fa2-f2b8-4996-9257-a4d7f31ecac5 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:58.466063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-22716fa2-f2b8-4996-9257-a4d7f31ecac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:58.512553 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1363/2728] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:58.521213 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd9ca1-8999-401a-903f-2fcba5f0d95d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.521566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd9ca1-8999-401a-903f-2fcba5f0d95d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.521801 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd9ca1-8999-401a-903f-2fcba5f0d95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.538743 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1366/2729] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:58.541073 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-08cd9ca1-8999-401a-903f-2fcba5f0d95d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:58.542329 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-08cd9ca1-8999-401a-903f-2fcba5f0d95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:58.546736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dabb5e-8484-4e8b-84d7-01b043a10c12 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.547027 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dabb5e-8484-4e8b-84d7-01b043a10c12 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.547305 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dabb5e-8484-4e8b-84d7-01b043a10c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.550263 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1364/2730] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:58.554462 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd9ca1-8999-401a-903f-2fcba5f0d95d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.563790 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd9ca1-8999-401a-903f-2fcba5f0d95d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.568447 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-13dabb5e-8484-4e8b-84d7-01b043a10c12 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:58.569742 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-13dabb5e-8484-4e8b-84d7-01b043a10c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:58.570110 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcf789-8524-4bfa-82cc-900c74ab3b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.570750 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcf789-8524-4bfa-82cc-900c74ab3b71 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.571045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcf789-8524-4bfa-82cc-900c74ab3b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.571312 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcf789-8524-4bfa-82cc-900c74ab3b71 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.572026 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcf789-8524-4bfa-82cc-900c74ab3b71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:58.572332 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcf789-8524-4bfa-82cc-900c74ab3b71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.574148 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dcf789-8524-4bfa-82cc-900c74ab3b71 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.575996 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:58.580379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1367/2731] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:58.585489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dabb5e-8484-4e8b-84d7-01b043a10c12 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.591182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1365/2732] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:51:58.595524 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcf789-8524-4bfa-82cc-900c74ab3b71 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.598977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dabb5e-8484-4e8b-84d7-01b043a10c12 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.603917 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f135c2-4240-44db-884a-a1fabaeb5a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.604643 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f135c2-4240-44db-884a-a1fabaeb5a8b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.604925 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f135c2-4240-44db-884a-a1fabaeb5a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.605196 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f135c2-4240-44db-884a-a1fabaeb5a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.605859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dcf789-8524-4bfa-82cc-900c74ab3b71 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.605993 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f135c2-4240-44db-884a-a1fabaeb5a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:51:58.606244 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f135c2-4240-44db-884a-a1fabaeb5a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.607887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f135c2-4240-44db-884a-a1fabaeb5a8b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.618438 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df9914-d8b1-448a-9cdb-507ae4f4fb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.619090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df9914-d8b1-448a-9cdb-507ae4f4fb37 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.619389 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df9914-d8b1-448a-9cdb-507ae4f4fb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.619674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df9914-d8b1-448a-9cdb-507ae4f4fb37 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.620361 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df9914-d8b1-448a-9cdb-507ae4f4fb37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.620647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1368/2733] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:51:58.622486 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df9914-d8b1-448a-9cdb-507ae4f4fb37 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.630423 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f135c2-4240-44db-884a-a1fabaeb5a8b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.641033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f135c2-4240-44db-884a-a1fabaeb5a8b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.646593 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109e144-2f2b-430c-9cb8-aa9eadb33be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.647322 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109e144-2f2b-430c-9cb8-aa9eadb33be2 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.647878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109e144-2f2b-430c-9cb8-aa9eadb33be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.647878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109e144-2f2b-430c-9cb8-aa9eadb33be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.648591 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109e144-2f2b-430c-9cb8-aa9eadb33be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.650564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109e144-2f2b-430c-9cb8-aa9eadb33be2 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.653517 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1366/2734] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:58 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:58.657896 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df9914-d8b1-448a-9cdb-507ae4f4fb37 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.672813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:58.690453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1369/2735] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:58 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:58.694481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109e144-2f2b-430c-9cb8-aa9eadb33be2 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.721942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df9914-d8b1-448a-9cdb-507ae4f4fb37 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.758012 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109e144-2f2b-430c-9cb8-aa9eadb33be2 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.763624 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdee41-4a6d-416b-96b2-43dbf1f36f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.764222 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdee41-4a6d-416b-96b2-43dbf1f36f81 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.764510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdee41-4a6d-416b-96b2-43dbf1f36f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.764785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdee41-4a6d-416b-96b2-43dbf1f36f81 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.765487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdee41-4a6d-416b-96b2-43dbf1f36f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.767493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdee41-4a6d-416b-96b2-43dbf1f36f81 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.783763 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0d4a3-2d5c-43e0-b9a9-389fc943f693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.784471 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d4a3-2d5c-43e0-b9a9-389fc943f693 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.784710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d4a3-2d5c-43e0-b9a9-389fc943f693 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.785003 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d4a3-2d5c-43e0-b9a9-389fc943f693 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.785732 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0d4a3-2d5c-43e0-b9a9-389fc943f693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.787686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0d4a3-2d5c-43e0-b9a9-389fc943f693 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.794869 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1370/2736] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:58 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:58.796615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdee41-4a6d-416b-96b2-43dbf1f36f81 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.808023 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdee41-4a6d-416b-96b2-43dbf1f36f81 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.812479 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1367/2737] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:58 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:58.812775 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cda00-a372-4c2c-8556-b9054df44744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.813352 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cda00-a372-4c2c-8556-b9054df44744 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.813545 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0d4a3-2d5c-43e0-b9a9-389fc943f693 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.813840 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cda00-a372-4c2c-8556-b9054df44744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.814116 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359cda00-a372-4c2c-8556-b9054df44744 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.814841 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cda00-a372-4c2c-8556-b9054df44744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.816633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359cda00-a372-4c2c-8556-b9054df44744 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.826686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0d4a3-2d5c-43e0-b9a9-389fc943f693 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.831849 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1371/2738] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:58.832137 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2eae5-4d63-482d-b381-42d1ede48c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.832862 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2eae5-4d63-482d-b381-42d1ede48c2b admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.833207 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2eae5-4d63-482d-b381-42d1ede48c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.833534 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2eae5-4d63-482d-b381-42d1ede48c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.834337 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2eae5-4d63-482d-b381-42d1ede48c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.836176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cda00-a372-4c2c-8556-b9054df44744 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.836362 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2eae5-4d63-482d-b381-42d1ede48c2b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.849504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1368/2739] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:58.853110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359cda00-a372-4c2c-8556-b9054df44744 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.853886 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2eae5-4d63-482d-b381-42d1ede48c2b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.855282 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d2ed1-e381-456f-bed2-c5a8b0f66d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.855898 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d2ed1-e381-456f-bed2-c5a8b0f66d62 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.856171 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d2ed1-e381-456f-bed2-c5a8b0f66d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.856483 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d2ed1-e381-456f-bed2-c5a8b0f66d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.857173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d2ed1-e381-456f-bed2-c5a8b0f66d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.858922 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d2ed1-e381-456f-bed2-c5a8b0f66d62 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.863959 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2eae5-4d63-482d-b381-42d1ede48c2b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.868715 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edd2e8-70d2-4d16-b345-8a6590e7fd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.869358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edd2e8-70d2-4d16-b345-8a6590e7fd98 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.869576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1372/2740] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:58.872758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edd2e8-70d2-4d16-b345-8a6590e7fd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.873075 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edd2e8-70d2-4d16-b345-8a6590e7fd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.873748 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d2ed1-e381-456f-bed2-c5a8b0f66d62 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.873870 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edd2e8-70d2-4d16-b345-8a6590e7fd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.875443 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edd2e8-70d2-4d16-b345-8a6590e7fd98 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.884009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d2ed1-e381-456f-bed2-c5a8b0f66d62 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.886931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1369/2741] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:51:58.891153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edd2e8-70d2-4d16-b345-8a6590e7fd98 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:58.892958 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5324af0-7bbe-4418-b589-d61358547390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.893734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5324af0-7bbe-4418-b589-d61358547390 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.894012 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5324af0-7bbe-4418-b589-d61358547390 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.894280 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5324af0-7bbe-4418-b589-d61358547390 admin admin] PATH_INFO: `/v3/projects/d574845e0d594727a619f2f27ffa4fb8/users/697aba2e62914362a9ae2cac5ade3a72/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.901599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edd2e8-70d2-4d16-b345-8a6590e7fd98 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:58.906176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90341d-f46f-44a6-81c5-6357aef1e9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:58.906839 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90341d-f46f-44a6-81c5-6357aef1e9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.907112 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90341d-f46f-44a6-81c5-6357aef1e9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.907377 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90341d-f46f-44a6-81c5-6357aef1e9f2 admin admin] PATH_INFO: `/v3/projects/8f73c4d4bf054289a41ee6b82c91d6a9/users/610902c58d68428db1e6357edb32e823/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.910043 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5324af0-7bbe-4418-b589-d61358547390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d574845e0d594727a619f2f27ffa4fb8, user_id=697aba2e62914362a9ae2cac5ade3a72, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.912751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5324af0-7bbe-4418-b589-d61358547390 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.922937 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90341d-f46f-44a6-81c5-6357aef1e9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f73c4d4bf054289a41ee6b82c91d6a9, user_id=610902c58d68428db1e6357edb32e823, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:58.925573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90341d-f46f-44a6-81c5-6357aef1e9f2 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:58.927501 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1373/2742] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:58 2022] PUT /identity/v3/projects/d574845e0d594727a619f2f27ffa4fb8/users/697aba2e62914362a9ae2cac5ade3a72/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:58.940959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90a4b6-5b5a-470f-bfdc-26d746e002e8 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.941243 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90a4b6-5b5a-470f-bfdc-26d746e002e8 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.941550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90a4b6-5b5a-470f-bfdc-26d746e002e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.949871 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1370/2743] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:58 2022] PUT /identity/v3/projects/8f73c4d4bf054289a41ee6b82c91d6a9/users/610902c58d68428db1e6357edb32e823/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:58.960754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589087d-b669-4614-b547-05915e7c3928 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:58.961004 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589087d-b669-4614-b547-05915e7c3928 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:58.961294 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1589087d-b669-4614-b547-05915e7c3928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:58.974930 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-ce90a4b6-5b5a-470f-bfdc-26d746e002e8 None None] MFA Rules not processed for user `697aba2e62914362a9ae2cac5ade3a72`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:58.976210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ce90a4b6-5b5a-470f-bfdc-26d746e002e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:58.990637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-1589087d-b669-4614-b547-05915e7c3928 None None] MFA Rules not processed for user `610902c58d68428db1e6357edb32e823`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:58.991972 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1589087d-b669-4614-b547-05915e7c3928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:59.001523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:59.049822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1374/2744] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:59.054105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90a4b6-5b5a-470f-bfdc-26d746e002e8 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:59.076659 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1371/2745] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:51:59.090545 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589087d-b669-4614-b547-05915e7c3928 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:59.091228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:59.092335 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1589087d-b669-4614-b547-05915e7c3928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:59.128531 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90a4b6-5b5a-470f-bfdc-26d746e002e8 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:59.134264 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d7540-c1b9-4f8a-8c92-0608541377c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:59.134994 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7540-c1b9-4f8a-8c92-0608541377c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:59.135275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7540-c1b9-4f8a-8c92-0608541377c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:59.135544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7540-c1b9-4f8a-8c92-0608541377c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:59.136230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d7540-c1b9-4f8a-8c92-0608541377c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:59.138265 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d7540-c1b9-4f8a-8c92-0608541377c4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:59.164892 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1589087d-b669-4614-b547-05915e7c3928 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:59.170158 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1375/2746] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:51:59 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:51:59.170314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc4230-5be2-4c05-b329-6e2e066525be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:59.170314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc4230-5be2-4c05-b329-6e2e066525be service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:59.170314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc4230-5be2-4c05-b329-6e2e066525be service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:59.170314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc4230-5be2-4c05-b329-6e2e066525be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:59.171468 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d7540-c1b9-4f8a-8c92-0608541377c4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:59.179056 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc4230-5be2-4c05-b329-6e2e066525be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:59.180598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc4230-5be2-4c05-b329-6e2e066525be service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:59.193113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1372/2747] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:51:59.238408 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d7540-c1b9-4f8a-8c92-0608541377c4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:59.249896 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71b644-3664-470a-ab7c-71a11b036a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:59.250515 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71b644-3664-470a-ab7c-71a11b036a69 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:59.250799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71b644-3664-470a-ab7c-71a11b036a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:59.251069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d71b644-3664-470a-ab7c-71a11b036a69 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:59.251732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71b644-3664-470a-ab7c-71a11b036a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:59.253723 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d71b644-3664-470a-ab7c-71a11b036a69 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:59.279856 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1376/2748] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:51:59 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:51:59.281090 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc4230-5be2-4c05-b329-6e2e066525be service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:59.292044 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc4230-5be2-4c05-b329-6e2e066525be service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:59.298053 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8e187-8760-42d9-a0fa-5c9a1a78cd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:59.298849 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8e187-8760-42d9-a0fa-5c9a1a78cd2f admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:59.299132 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8e187-8760-42d9-a0fa-5c9a1a78cd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:59.299582 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8e187-8760-42d9-a0fa-5c9a1a78cd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:59.300859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8e187-8760-42d9-a0fa-5c9a1a78cd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:59.302586 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8e187-8760-42d9-a0fa-5c9a1a78cd2f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:59.316177 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1373/2749] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:59.317542 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71b644-3664-470a-ab7c-71a11b036a69 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:59.328363 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d71b644-3664-470a-ab7c-71a11b036a69 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:59.334167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ea683-5d45-4467-a21e-ff8087209c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:59.335025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ea683-5d45-4467-a21e-ff8087209c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:59.335429 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ea683-5d45-4467-a21e-ff8087209c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:59.335783 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ea683-5d45-4467-a21e-ff8087209c6a admin admin] PATH_INFO: `/v3/projects/da67877dc52f41bf8a33e3be91d5501a/users/ecc6c4488ab84f1b8ca912745ca35c28/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:59.355615 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ea683-5d45-4467-a21e-ff8087209c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da67877dc52f41bf8a33e3be91d5501a, user_id=ecc6c4488ab84f1b8ca912745ca35c28, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:59.363413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ea683-5d45-4467-a21e-ff8087209c6a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:59.378858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1377/2750] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:59 2022] PUT /identity/v3/projects/da67877dc52f41bf8a33e3be91d5501a/users/ecc6c4488ab84f1b8ca912745ca35c28/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:51:59.383451 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8e187-8760-42d9-a0fa-5c9a1a78cd2f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:59.393768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8e187-8760-42d9-a0fa-5c9a1a78cd2f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:59.456849 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c78c2-7e7d-49e5-9182-2f3717090125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:59.457501 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c78c2-7e7d-49e5-9182-2f3717090125 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:59.457782 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c78c2-7e7d-49e5-9182-2f3717090125 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:59.459338 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c78c2-7e7d-49e5-9182-2f3717090125 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:59.459338 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c78c2-7e7d-49e5-9182-2f3717090125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:59.460349 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c78c2-7e7d-49e5-9182-2f3717090125 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:59.472096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1374/2751] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:51:59.476597 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ea683-5d45-4467-a21e-ff8087209c6a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:59.489414 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ea683-5d45-4467-a21e-ff8087209c6a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:59.495491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b5429-a6f9-42d0-bf04-732632a73af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:59.496193 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b5429-a6f9-42d0-bf04-732632a73af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:59.496477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b5429-a6f9-42d0-bf04-732632a73af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:59.496755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b5429-a6f9-42d0-bf04-732632a73af6 admin admin] PATH_INFO: `/v3/projects/da67877dc52f41bf8a33e3be91d5501a/users/ecc6c4488ab84f1b8ca912745ca35c28/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:59.498851 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b5429-a6f9-42d0-bf04-732632a73af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da67877dc52f41bf8a33e3be91d5501a, user_id=ecc6c4488ab84f1b8ca912745ca35c28, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:59.501534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b5429-a6f9-42d0-bf04-732632a73af6 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:59.512660 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1378/2752] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:51:59 2022] PUT /identity/v3/projects/da67877dc52f41bf8a33e3be91d5501a/users/ecc6c4488ab84f1b8ca912745ca35c28/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:51:59.523180 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ac63-f9eb-4b96-82ea-fbed7046a8bb None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:59.523639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ac63-f9eb-4b96-82ea-fbed7046a8bb None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:59.524057 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ac63-f9eb-4b96-82ea-fbed7046a8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:59.557570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-9f16ac63-f9eb-4b96-82ea-fbed7046a8bb None None] MFA Rules not processed for user `ecc6c4488ab84f1b8ca912745ca35c28`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:51:59.558727 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9f16ac63-f9eb-4b96-82ea-fbed7046a8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:51:59.588232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:51:59.631633 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1375/2753] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:51:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:51:59.643571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b5429-a6f9-42d0-bf04-732632a73af6 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:51:59.701605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b5429-a6f9-42d0-bf04-732632a73af6 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:51:59.706633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784053c-7e84-4234-806d-30abb4a69504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:51:59.707308 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784053c-7e84-4234-806d-30abb4a69504 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:51:59.707557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784053c-7e84-4234-806d-30abb4a69504 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:51:59.707880 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784053c-7e84-4234-806d-30abb4a69504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:51:59.719230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784053c-7e84-4234-806d-30abb4a69504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:51:59.720699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784053c-7e84-4234-806d-30abb4a69504 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:51:59.731764 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1379/2754] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:51:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:01.172168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16ac63-f9eb-4b96-82ea-fbed7046a8bb None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:01.239533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16ac63-f9eb-4b96-82ea-fbed7046a8bb None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:01.246669 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:01.247310 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:01.247594 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:01.247901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] PATH_INFO: `/v3/users/697aba2e62914362a9ae2cac5ade3a72` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:01.249139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=697aba2e62914362a9ae2cac5ade3a72)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:01.251178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:01.301865 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '697aba2e62914362a9ae2cac5ade3a72'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:01.308799 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '697aba2e62914362a9ae2cac5ade3a72'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:01.309509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '697aba2e62914362a9ae2cac5ade3a72'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:01.321694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '697aba2e62914362a9ae2cac5ade3a72'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:01.322319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '697aba2e62914362a9ae2cac5ade3a72'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:01.336885 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1376/2755] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:52:01 2022] DELETE /identity/v3/users/697aba2e62914362a9ae2cac5ade3a72 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:01.341797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572e8e6-4800-460e-b499-bcba61c78129 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:01.342379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572e8e6-4800-460e-b499-bcba61c78129 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:01.342379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572e8e6-4800-460e-b499-bcba61c78129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:01.365238 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-2572e8e6-4800-460e-b499-bcba61c78129 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:01.366561 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2572e8e6-4800-460e-b499-bcba61c78129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:01.372372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:01.444058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1380/2756] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:01.454496 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:01.456478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:01.506983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:01.521154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e766bbf-b1b1-41eb-b5ad-42e7a6cd2c6b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:01.525535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c25d2-59f6-4339-b728-96eaa90afdbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:01.526124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c25d2-59f6-4339-b728-96eaa90afdbf service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:01.526406 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c25d2-59f6-4339-b728-96eaa90afdbf service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:01.526681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c25d2-59f6-4339-b728-96eaa90afdbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:01.536388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c25d2-59f6-4339-b728-96eaa90afdbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:01.537870 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c25d2-59f6-4339-b728-96eaa90afdbf service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:01.547421 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1377/2757] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:01.825979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572e8e6-4800-460e-b499-bcba61c78129 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:01.827403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2572e8e6-4800-460e-b499-bcba61c78129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:01.839703 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572e8e6-4800-460e-b499-bcba61c78129 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:01.844760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:01.845463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:01.845738 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:01.846009 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] PATH_INFO: `/v3/projects/d574845e0d594727a619f2f27ffa4fb8` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:01.847412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d574845e0d594727a619f2f27ffa4fb8)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:01.849549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:01.902489 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd574845e0d594727a619f2f27ffa4fb8', 'request_id': 'req-95220838-29ca-406d-88be-0a669eb27b4b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:01.910456 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd574845e0d594727a619f2f27ffa4fb8', 'request_id': 'req-95220838-29ca-406d-88be-0a669eb27b4b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:01.917824 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd574845e0d594727a619f2f27ffa4fb8', 'request_id': 'req-95220838-29ca-406d-88be-0a669eb27b4b'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:01.929773 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] The token cache is being invalidate because project d574845e0d594727a619f2f27ffa4fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:52:01.930050 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:01.930796 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:01.932517 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1381/2758] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:52:01 2022] DELETE /identity/v3/projects/d574845e0d594727a619f2f27ffa4fb8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:01.936398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c25d2-59f6-4339-b728-96eaa90afdbf service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:01.946716 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c25d2-59f6-4339-b728-96eaa90afdbf service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:02.009548 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53359456-0374-49ca-b39a-8e93daf71d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:02.010327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53359456-0374-49ca-b39a-8e93daf71d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:02.010713 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53359456-0374-49ca-b39a-8e93daf71d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:02.011028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53359456-0374-49ca-b39a-8e93daf71d4b admin admin] PATH_INFO: `/v3/users/ecc6c4488ab84f1b8ca912745ca35c28` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:02.012254 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53359456-0374-49ca-b39a-8e93daf71d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc6c4488ab84f1b8ca912745ca35c28)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:02.014270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53359456-0374-49ca-b39a-8e93daf71d4b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:02.064522 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53359456-0374-49ca-b39a-8e93daf71d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc6c4488ab84f1b8ca912745ca35c28'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:02.072618 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53359456-0374-49ca-b39a-8e93daf71d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc6c4488ab84f1b8ca912745ca35c28'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:02.073698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53359456-0374-49ca-b39a-8e93daf71d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc6c4488ab84f1b8ca912745ca35c28'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:02.088185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53359456-0374-49ca-b39a-8e93daf71d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc6c4488ab84f1b8ca912745ca35c28'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:02.088945 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-53359456-0374-49ca-b39a-8e93daf71d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc6c4488ab84f1b8ca912745ca35c28'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:02.103890 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1378/2759] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:52:01 2022] DELETE /identity/v3/users/ecc6c4488ab84f1b8ca912745ca35c28 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:02.395186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:02.396667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:02.411822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95220838-29ca-406d-88be-0a669eb27b4b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:02.485228 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e4f4c-b480-4181-b993-9292a1b83a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:02.486004 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e4f4c-b480-4181-b993-9292a1b83a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:02.486308 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e4f4c-b480-4181-b993-9292a1b83a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:02.486571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e4f4c-b480-4181-b993-9292a1b83a81 admin admin] PATH_INFO: `/v3/projects/da67877dc52f41bf8a33e3be91d5501a` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:02.487908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e4f4c-b480-4181-b993-9292a1b83a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da67877dc52f41bf8a33e3be91d5501a)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:02.490122 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e4f4c-b480-4181-b993-9292a1b83a81 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:02.530240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:02.540940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e71e4f4c-b480-4181-b993-9292a1b83a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da67877dc52f41bf8a33e3be91d5501a', 'request_id': 'req-e71e4f4c-b480-4181-b993-9292a1b83a81'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:02.549751 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e71e4f4c-b480-4181-b993-9292a1b83a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da67877dc52f41bf8a33e3be91d5501a', 'request_id': 'req-e71e4f4c-b480-4181-b993-9292a1b83a81'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:02.555634 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e71e4f4c-b480-4181-b993-9292a1b83a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da67877dc52f41bf8a33e3be91d5501a', 'request_id': 'req-e71e4f4c-b480-4181-b993-9292a1b83a81'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:02.567222 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e71e4f4c-b480-4181-b993-9292a1b83a81 admin admin] The token cache is being invalidate because project da67877dc52f41bf8a33e3be91d5501a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:52:02.567502 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e71e4f4c-b480-4181-b993-9292a1b83a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:02.568162 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e71e4f4c-b480-4181-b993-9292a1b83a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:02.569737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1382/2760] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:52:02 2022] DELETE /identity/v3/projects/da67877dc52f41bf8a33e3be91d5501a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:02.575173 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c60c25-49a6-426e-b3ff-a959642fcea3 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:02.575697 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c60c25-49a6-426e-b3ff-a959642fcea3 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:02.575697 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c60c25-49a6-426e-b3ff-a959642fcea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:02.600054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-71c60c25-49a6-426e-b3ff-a959642fcea3 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:02.601454 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-71c60c25-49a6-426e-b3ff-a959642fcea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:02.664094 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1379/2761] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:02.672337 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b6f06-5335-4261-94c0-c0114b16e2fd None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:02.672617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b6f06-5335-4261-94c0-c0114b16e2fd None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:02.672897 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b6f06-5335-4261-94c0-c0114b16e2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:02.694679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-d73b6f06-5335-4261-94c0-c0114b16e2fd None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:02.696117 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-d73b6f06-5335-4261-94c0-c0114b16e2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:02.706388 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1383/2762] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:52:02.711185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c60c25-49a6-426e-b3ff-a959642fcea3 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:02.721706 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c60c25-49a6-426e-b3ff-a959642fcea3 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:02.727424 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69724c28-5d0d-488f-96bc-eb43a5fda5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:02.728072 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69724c28-5d0d-488f-96bc-eb43a5fda5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:02.728344 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69724c28-5d0d-488f-96bc-eb43a5fda5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:02.728626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69724c28-5d0d-488f-96bc-eb43a5fda5e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:02.729648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69724c28-5d0d-488f-96bc-eb43a5fda5e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:52:02.730016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69724c28-5d0d-488f-96bc-eb43a5fda5e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:02.732063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69724c28-5d0d-488f-96bc-eb43a5fda5e9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:02.734083 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:02.749524 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1380/2763] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:52:02.753987 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b6f06-5335-4261-94c0-c0114b16e2fd None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:02.764007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b6f06-5335-4261-94c0-c0114b16e2fd None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:02.771823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4342e1-b69f-4a4d-885d-6756f45f2ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:02.772173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4342e1-b69f-4a4d-885d-6756f45f2ace admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:02.772461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4342e1-b69f-4a4d-885d-6756f45f2ace admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:02.772732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4342e1-b69f-4a4d-885d-6756f45f2ace admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:02.773565 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4342e1-b69f-4a4d-885d-6756f45f2ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:02.776316 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4342e1-b69f-4a4d-885d-6756f45f2ace admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:02.814412 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1384/2764] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:52:02 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:52:02.815693 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69724c28-5d0d-488f-96bc-eb43a5fda5e9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:02.826317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69724c28-5d0d-488f-96bc-eb43a5fda5e9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:02.886751 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6de70d-daa2-4335-a49f-65e3810c31c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:02.887373 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6de70d-daa2-4335-a49f-65e3810c31c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:02.887649 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6de70d-daa2-4335-a49f-65e3810c31c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:02.887920 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6de70d-daa2-4335-a49f-65e3810c31c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:02.888578 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6de70d-daa2-4335-a49f-65e3810c31c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:02.890509 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6de70d-daa2-4335-a49f-65e3810c31c7 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:02.913587 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1381/2765] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:52:02 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:52:02.918374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4342e1-b69f-4a4d-885d-6756f45f2ace admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:02.929191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4342e1-b69f-4a4d-885d-6756f45f2ace admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:02.934281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fa226-cac6-4e62-9644-6e72b0d79a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:02.934890 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa226-cac6-4e62-9644-6e72b0d79a69 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:02.935171 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa226-cac6-4e62-9644-6e72b0d79a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:02.935445 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fa226-cac6-4e62-9644-6e72b0d79a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:02.936140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fa226-cac6-4e62-9644-6e72b0d79a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:02.937787 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fa226-cac6-4e62-9644-6e72b0d79a69 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:02.948037 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1385/2766] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:52:02.952408 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6de70d-daa2-4335-a49f-65e3810c31c7 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:02.964801 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6de70d-daa2-4335-a49f-65e3810c31c7 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:02.970284 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f581c1c-e75f-48be-b966-9443c16c6929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:02.970928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f581c1c-e75f-48be-b966-9443c16c6929 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:02.971193 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f581c1c-e75f-48be-b966-9443c16c6929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:02.971493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f581c1c-e75f-48be-b966-9443c16c6929 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:02.972162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f581c1c-e75f-48be-b966-9443c16c6929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:02.973838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f581c1c-e75f-48be-b966-9443c16c6929 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:02.984775 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1382/2767] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:52:02.989549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fa226-cac6-4e62-9644-6e72b0d79a69 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:03.000130 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fa226-cac6-4e62-9644-6e72b0d79a69 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:03.009999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1845363-1897-449e-9e4b-ee48245b2dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:03.010702 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1845363-1897-449e-9e4b-ee48245b2dde admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:03.011112 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1845363-1897-449e-9e4b-ee48245b2dde admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:03.011325 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1845363-1897-449e-9e4b-ee48245b2dde admin admin] PATH_INFO: `/v3/projects/1478b2e93d8e4fb6bc00d390d9bcdab9/users/eb78d2d2eea1435288bb870d35dc6db0/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:03.029031 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1845363-1897-449e-9e4b-ee48245b2dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=1478b2e93d8e4fb6bc00d390d9bcdab9, user_id=eb78d2d2eea1435288bb870d35dc6db0, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:03.031725 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1845363-1897-449e-9e4b-ee48245b2dde admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:03.046325 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1386/2768] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:52:02 2022] PUT /identity/v3/projects/1478b2e93d8e4fb6bc00d390d9bcdab9/users/eb78d2d2eea1435288bb870d35dc6db0/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:03.051781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe27cf4-a1a6-42ab-802e-8d20848fadc0 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:03.052087 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe27cf4-a1a6-42ab-802e-8d20848fadc0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:03.052368 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe27cf4-a1a6-42ab-802e-8d20848fadc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:03.071785 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cbe27cf4-a1a6-42ab-802e-8d20848fadc0 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:03.073410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cbe27cf4-a1a6-42ab-802e-8d20848fadc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:03.137670 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1383/2769] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:03.149512 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1845363-1897-449e-9e4b-ee48245b2dde admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:03.151575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a1845363-1897-449e-9e4b-ee48245b2dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:03.235372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1845363-1897-449e-9e4b-ee48245b2dde admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:03.239022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b0dc1-d2f8-4d0b-b7a4-94923f059f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:03.239639 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b0dc1-d2f8-4d0b-b7a4-94923f059f4b service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:03.239915 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b0dc1-d2f8-4d0b-b7a4-94923f059f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:03.240230 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b0dc1-d2f8-4d0b-b7a4-94923f059f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:03.250304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b0dc1-d2f8-4d0b-b7a4-94923f059f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:03.251726 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b0dc1-d2f8-4d0b-b7a4-94923f059f4b service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:03.261461 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1387/2770] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:52:03.911309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb33f2-a491-4847-8bef-ea306edc49dd None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:03.911894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb33f2-a491-4847-8bef-ea306edc49dd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:03.911894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb33f2-a491-4847-8bef-ea306edc49dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:03.940466 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b0bb33f2-a491-4847-8bef-ea306edc49dd None None] MFA Rules not processed for user `eb78d2d2eea1435288bb870d35dc6db0`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:03.941734 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b0bb33f2-a491-4847-8bef-ea306edc49dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:04.016232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1384/2771] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:04.020790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b0dc1-d2f8-4d0b-b7a4-94923f059f4b service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:04.031124 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b0dc1-d2f8-4d0b-b7a4-94923f059f4b service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:04.037323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca64d-ba26-4b46-b23a-1b0a75fd9d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:04.038120 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca64d-ba26-4b46-b23a-1b0a75fd9d2b admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:04.038630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca64d-ba26-4b46-b23a-1b0a75fd9d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:04.039089 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ca64d-ba26-4b46-b23a-1b0a75fd9d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:04.039916 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ca64d-ba26-4b46-b23a-1b0a75fd9d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:04.042426 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ca64d-ba26-4b46-b23a-1b0a75fd9d2b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:04.082048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1388/2772] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:52:04 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:52:04.086781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb33f2-a491-4847-8bef-ea306edc49dd None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:04.093116 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:04.103968 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb33f2-a491-4847-8bef-ea306edc49dd None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:04.168657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04ec92-5faf-4ea2-8515-a2d3f0f3b4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:04.169579 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04ec92-5faf-4ea2-8515-a2d3f0f3b4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:04.169935 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04ec92-5faf-4ea2-8515-a2d3f0f3b4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:04.170287 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04ec92-5faf-4ea2-8515-a2d3f0f3b4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:04.171055 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04ec92-5faf-4ea2-8515-a2d3f0f3b4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:04.173012 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04ec92-5faf-4ea2-8515-a2d3f0f3b4b1 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:04.196487 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1385/2773] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:52:04 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:52:04.200776 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca64d-ba26-4b46-b23a-1b0a75fd9d2b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:04.212629 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ca64d-ba26-4b46-b23a-1b0a75fd9d2b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:04.217317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1abbfe-9628-49f2-bf21-9b7c4d79a46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:04.217931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1abbfe-9628-49f2-bf21-9b7c4d79a46b admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:04.218264 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1abbfe-9628-49f2-bf21-9b7c4d79a46b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:04.218530 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1abbfe-9628-49f2-bf21-9b7c4d79a46b admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:04.219275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1abbfe-9628-49f2-bf21-9b7c4d79a46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:04.221127 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1abbfe-9628-49f2-bf21-9b7c4d79a46b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:04.236887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1389/2774] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:52:04.238573 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04ec92-5faf-4ea2-8515-a2d3f0f3b4b1 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:04.248973 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04ec92-5faf-4ea2-8515-a2d3f0f3b4b1 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:04.253942 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a407f-d888-4016-9ecf-726587769942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:04.254610 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a407f-d888-4016-9ecf-726587769942 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:04.254888 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a407f-d888-4016-9ecf-726587769942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:04.255154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a407f-d888-4016-9ecf-726587769942 admin admin] PATH_INFO: `/v3/projects/feb3b9b7c5ab49c4ae2f5d2ddfc273d4/users/98895f2c797848b5ad72383830f49c26/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:04.272366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a407f-d888-4016-9ecf-726587769942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb3b9b7c5ab49c4ae2f5d2ddfc273d4, user_id=98895f2c797848b5ad72383830f49c26, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:04.275133 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a407f-d888-4016-9ecf-726587769942 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:04.297030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1386/2775] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:52:04 2022] PUT /identity/v3/projects/feb3b9b7c5ab49c4ae2f5d2ddfc273d4/users/98895f2c797848b5ad72383830f49c26/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:04.301002 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1abbfe-9628-49f2-bf21-9b7c4d79a46b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:04.311736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1abbfe-9628-49f2-bf21-9b7c4d79a46b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:04.347858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:04.378887 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f3bb9-03cd-4e88-aa66-3d3351bfa1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:04.379543 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f3bb9-03cd-4e88-aa66-3d3351bfa1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:04.379822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f3bb9-03cd-4e88-aa66-3d3351bfa1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:04.380093 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f3bb9-03cd-4e88-aa66-3d3351bfa1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:04.381106 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f3bb9-03cd-4e88-aa66-3d3351bfa1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:04.382526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f3bb9-03cd-4e88-aa66-3d3351bfa1b0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:04.396066 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1390/2776] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:52:04.397194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a407f-d888-4016-9ecf-726587769942 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:04.410212 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a407f-d888-4016-9ecf-726587769942 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:04.419949 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccccd3-20e1-44cf-a81f-3cc1cfc473c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:04.420793 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccccd3-20e1-44cf-a81f-3cc1cfc473c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:04.421186 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccccd3-20e1-44cf-a81f-3cc1cfc473c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:04.429916 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccccd3-20e1-44cf-a81f-3cc1cfc473c5 admin admin] PATH_INFO: `/v3/projects/feb3b9b7c5ab49c4ae2f5d2ddfc273d4/users/98895f2c797848b5ad72383830f49c26/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:04.432686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccccd3-20e1-44cf-a81f-3cc1cfc473c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb3b9b7c5ab49c4ae2f5d2ddfc273d4, user_id=98895f2c797848b5ad72383830f49c26, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:04.435559 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccccd3-20e1-44cf-a81f-3cc1cfc473c5 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:04.447950 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1387/2777] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:52:04 2022] PUT /identity/v3/projects/feb3b9b7c5ab49c4ae2f5d2ddfc273d4/users/98895f2c797848b5ad72383830f49c26/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:05.140693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80e353-cb03-46da-910b-cf4cd793d544 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:05.141602 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80e353-cb03-46da-910b-cf4cd793d544 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:05.142285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80e353-cb03-46da-910b-cf4cd793d544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:05.174648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-af80e353-cb03-46da-910b-cf4cd793d544 None None] MFA Rules not processed for user `98895f2c797848b5ad72383830f49c26`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:05.175931 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-af80e353-cb03-46da-910b-cf4cd793d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:05.260518 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1391/2778] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:52:05.271533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fc7af-c312-4b96-a016-12d23f3d6fee None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:05.272162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fc7af-c312-4b96-a016-12d23f3d6fee None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:05.272162 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fc7af-c312-4b96-a016-12d23f3d6fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:05.293150 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-806fc7af-c312-4b96-a016-12d23f3d6fee None None] MFA Rules not processed for user `eb78d2d2eea1435288bb870d35dc6db0`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:05.294420 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-806fc7af-c312-4b96-a016-12d23f3d6fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:05.355262 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1388/2779] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:05.368251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80e353-cb03-46da-910b-cf4cd793d544 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:05.369857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-af80e353-cb03-46da-910b-cf4cd793d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:05.447326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80e353-cb03-46da-910b-cf4cd793d544 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:05.453662 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b49314-2591-45f2-88a2-12137231c3d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:05.454313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b49314-2591-45f2-88a2-12137231c3d6 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:05.454592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b49314-2591-45f2-88a2-12137231c3d6 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:05.454878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b49314-2591-45f2-88a2-12137231c3d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:05.465519 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b49314-2591-45f2-88a2-12137231c3d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:05.467138 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b49314-2591-45f2-88a2-12137231c3d6 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:05.477251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1392/2780] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:05.718127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fc7af-c312-4b96-a016-12d23f3d6fee None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:05.775411 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fc7af-c312-4b96-a016-12d23f3d6fee None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:05.779304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1b342-406f-425f-bb31-f31f002c3f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:05.779918 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1b342-406f-425f-bb31-f31f002c3f7b service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:05.780194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1b342-406f-425f-bb31-f31f002c3f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:05.780453 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1b342-406f-425f-bb31-f31f002c3f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:05.782599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-86a1b342-406f-425f-bb31-f31f002c3f7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:05.793056 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1b342-406f-425f-bb31-f31f002c3f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:05.794557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1b342-406f-425f-bb31-f31f002c3f7b service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:05.802490 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1389/2781] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:09.591545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b49314-2591-45f2-88a2-12137231c3d6 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:09.593277 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a6b49314-2591-45f2-88a2-12137231c3d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:09.638439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:09.665962 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b49314-2591-45f2-88a2-12137231c3d6 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:09.671006 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:09.671653 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:09.671904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:09.672211 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] PATH_INFO: `/v3/users/610902c58d68428db1e6357edb32e823` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:09.673612 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=610902c58d68428db1e6357edb32e823)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:09.675527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:09.728632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '610902c58d68428db1e6357edb32e823'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:09.735589 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '610902c58d68428db1e6357edb32e823'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:09.744578 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '610902c58d68428db1e6357edb32e823'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:09.746672 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '610902c58d68428db1e6357edb32e823'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:09.761481 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '610902c58d68428db1e6357edb32e823'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:09.768184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1393/2782] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:52:09 2022] DELETE /identity/v3/users/610902c58d68428db1e6357edb32e823 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:09.772585 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4662f8-ec19-4415-b194-1f23c7d8190b None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:09.773165 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4662f8-ec19-4415-b194-1f23c7d8190b None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:09.773251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4662f8-ec19-4415-b194-1f23c7d8190b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:09.780314 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:09.794077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-2f4662f8-ec19-4415-b194-1f23c7d8190b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:09.795597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2f4662f8-ec19-4415-b194-1f23c7d8190b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:09.854742 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1390/2783] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:09.864760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:09.866376 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:09.926977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84d62a-5844-402c-869f-ee1467d393d4 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:09.931564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46703b92-6045-405b-a55e-59a38b07c2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:09.932204 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46703b92-6045-405b-a55e-59a38b07c2fa service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:09.932468 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46703b92-6045-405b-a55e-59a38b07c2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:09.932739 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46703b92-6045-405b-a55e-59a38b07c2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:09.945094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46703b92-6045-405b-a55e-59a38b07c2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:09.946608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46703b92-6045-405b-a55e-59a38b07c2fa service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:09.959203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1394/2784] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:10.247396 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4662f8-ec19-4415-b194-1f23c7d8190b None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:10.248826 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2f4662f8-ec19-4415-b194-1f23c7d8190b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:10.260951 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4662f8-ec19-4415-b194-1f23c7d8190b None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:10.265739 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:10.266399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:10.266678 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:10.266943 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] PATH_INFO: `/v3/projects/8f73c4d4bf054289a41ee6b82c91d6a9` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:10.268127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f73c4d4bf054289a41ee6b82c91d6a9)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:10.270081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:10.325817 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f73c4d4bf054289a41ee6b82c91d6a9', 'request_id': 'req-cedc6e85-247c-4161-bfcd-bf4d0c08e052'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:10.332755 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f73c4d4bf054289a41ee6b82c91d6a9', 'request_id': 'req-cedc6e85-247c-4161-bfcd-bf4d0c08e052'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:10.341684 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f73c4d4bf054289a41ee6b82c91d6a9', 'request_id': 'req-cedc6e85-247c-4161-bfcd-bf4d0c08e052'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:10.352641 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] The token cache is being invalidate because project 8f73c4d4bf054289a41ee6b82c91d6a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:52:10.352916 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:10.353588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:10.355142 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1391/2785] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:52:10 2022] DELETE /identity/v3/projects/8f73c4d4bf054289a41ee6b82c91d6a9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:52:12.752586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcd023-89bb-4363-90f6-ab12c6649260 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:12.753108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcd023-89bb-4363-90f6-ab12c6649260 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:12.753108 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcd023-89bb-4363-90f6-ab12c6649260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:12.774311 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-a5bcd023-89bb-4363-90f6-ab12c6649260 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:12.775829 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a5bcd023-89bb-4363-90f6-ab12c6649260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:12.845335 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:12.858281 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1395/2786] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Jul 26 02:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:12.871825 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:12.873457 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:12.954032 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc6e85-247c-4161-bfcd-bf4d0c08e052 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:12.961336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d7594-110a-4bc4-8449-6d0540a86a78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:12.961970 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d7594-110a-4bc4-8449-6d0540a86a78 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:12.962274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d7594-110a-4bc4-8449-6d0540a86a78 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:12.962542 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d7594-110a-4bc4-8449-6d0540a86a78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:12.971248 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d7594-110a-4bc4-8449-6d0540a86a78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:12.972840 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d7594-110a-4bc4-8449-6d0540a86a78 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:12.982720 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1392/2787] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:15.799739 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7871024-0b43-49b9-8df7-38eac1000bc6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:15.800287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7871024-0b43-49b9-8df7-38eac1000bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:15.800287 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7871024-0b43-49b9-8df7-38eac1000bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:15.821575 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f7871024-0b43-49b9-8df7-38eac1000bc6 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:15.822807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f7871024-0b43-49b9-8df7-38eac1000bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:15.832592 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1396/2788] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Jul 26 02:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:15.851338 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d7594-110a-4bc4-8449-6d0540a86a78 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:15.863319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d7594-110a-4bc4-8449-6d0540a86a78 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:15.870030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890c2bb-acd3-4e69-87c9-748bffa56333 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:15.870768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c2bb-acd3-4e69-87c9-748bffa56333 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:15.871054 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c2bb-acd3-4e69-87c9-748bffa56333 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:15.871325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890c2bb-acd3-4e69-87c9-748bffa56333 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:15.880430 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890c2bb-acd3-4e69-87c9-748bffa56333 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:15.883431 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890c2bb-acd3-4e69-87c9-748bffa56333 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:15.886434 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:15.895178 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1393/2789] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:17.572457 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7871024-0b43-49b9-8df7-38eac1000bc6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:17.574073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f7871024-0b43-49b9-8df7-38eac1000bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:17.640870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7871024-0b43-49b9-8df7-38eac1000bc6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:17.646656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f0de8-94da-4fe0-a61e-14e8d2560bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:17.647314 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f0de8-94da-4fe0-a61e-14e8d2560bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:17.647617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f0de8-94da-4fe0-a61e-14e8d2560bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:17.647901 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f0de8-94da-4fe0-a61e-14e8d2560bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:17.650043 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-379f0de8-94da-4fe0-a61e-14e8d2560bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:17.719239 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f0de8-94da-4fe0-a61e-14e8d2560bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:17.720688 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f0de8-94da-4fe0-a61e-14e8d2560bb3 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:17.735156 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1397/2790] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:19.097214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861960e-29fd-489f-8041-0053c0ba12df None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:19.097960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861960e-29fd-489f-8041-0053c0ba12df None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:19.097960 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861960e-29fd-489f-8041-0053c0ba12df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:19.119681 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-b861960e-29fd-489f-8041-0053c0ba12df None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:19.120921 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-b861960e-29fd-489f-8041-0053c0ba12df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:19.130776 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1394/2791] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Jul 26 02:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:19.146373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f0de8-94da-4fe0-a61e-14e8d2560bb3 service cinder] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:19.147963 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-379f0de8-94da-4fe0-a61e-14e8d2560bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:19.164025 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f0de8-94da-4fe0-a61e-14e8d2560bb3 service cinder] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:19.169977 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a000-9105-45a4-88c0-49158b3ea39b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:19.170633 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a000-9105-45a4-88c0-49158b3ea39b service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:19.170879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a000-9105-45a4-88c0-49158b3ea39b service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:19.171153 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7a000-9105-45a4-88c0-49158b3ea39b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:19.180399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7a000-9105-45a4-88c0-49158b3ea39b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:19.182059 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7a000-9105-45a4-88c0-49158b3ea39b service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:19.192476 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1398/2792] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:22.194606 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f627aea-1201-4bbc-8321-5985046adb32 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:22.195179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f627aea-1201-4bbc-8321-5985046adb32 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:22.195179 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f627aea-1201-4bbc-8321-5985046adb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:22.216050 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-7f627aea-1201-4bbc-8321-5985046adb32 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:22.217274 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-7f627aea-1201-4bbc-8321-5985046adb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:22.228639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1395/2793] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Jul 26 02:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:22.244216 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a000-9105-45a4-88c0-49158b3ea39b service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:22.256698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7a000-9105-45a4-88c0-49158b3ea39b service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:22.263453 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d0a4f-9548-4771-9e10-631db1b1c212 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:22.264073 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d0a4f-9548-4771-9e10-631db1b1c212 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:22.264373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d0a4f-9548-4771-9e10-631db1b1c212 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:22.264679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50d0a4f-9548-4771-9e10-631db1b1c212 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:22.275179 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d0a4f-9548-4771-9e10-631db1b1c212 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:22.276913 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50d0a4f-9548-4771-9e10-631db1b1c212 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:22.287058 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1399/2794] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:25.378657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5d45a-2421-4484-8e82-c417b1458021 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:25.379224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5d45a-2421-4484-8e82-c417b1458021 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:25.379224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5d45a-2421-4484-8e82-c417b1458021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:25.401044 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-e8d5d45a-2421-4484-8e82-c417b1458021 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:25.402343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-e8d5d45a-2421-4484-8e82-c417b1458021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:25.412049 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1396/2795] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Jul 26 02:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:25.429107 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d0a4f-9548-4771-9e10-631db1b1c212 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:25.440906 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50d0a4f-9548-4771-9e10-631db1b1c212 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:25.447203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b880b8-3404-450d-b7fe-9a02d406b136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:25.447819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b880b8-3404-450d-b7fe-9a02d406b136 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:25.448094 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b880b8-3404-450d-b7fe-9a02d406b136 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:25.448362 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b880b8-3404-450d-b7fe-9a02d406b136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:25.457992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b880b8-3404-450d-b7fe-9a02d406b136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:25.459630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b880b8-3404-450d-b7fe-9a02d406b136 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:25.470585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1400/2796] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:28.553384 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb300c-c980-4709-8531-4fd10169efde None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:28.554009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb300c-c980-4709-8531-4fd10169efde None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:28.554009 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb300c-c980-4709-8531-4fd10169efde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:28.579624 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-4abb300c-c980-4709-8531-4fd10169efde None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:28.581180 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4abb300c-c980-4709-8531-4fd10169efde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:28.595152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1397/2797] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Jul 26 02:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:28.610879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b880b8-3404-450d-b7fe-9a02d406b136 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:28.627653 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b880b8-3404-450d-b7fe-9a02d406b136 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:28.635315 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36f2bc-bc55-4ffc-9a30-6b85a35efa54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:28.636109 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36f2bc-bc55-4ffc-9a30-6b85a35efa54 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:28.636237 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36f2bc-bc55-4ffc-9a30-6b85a35efa54 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:28.636440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36f2bc-bc55-4ffc-9a30-6b85a35efa54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:28.646860 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36f2bc-bc55-4ffc-9a30-6b85a35efa54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:28.648460 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36f2bc-bc55-4ffc-9a30-6b85a35efa54 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:28.659168 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1401/2798] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:37.909057 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb300c-c980-4709-8531-4fd10169efde None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:37.911313 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-4abb300c-c980-4709-8531-4fd10169efde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:37.926187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb300c-c980-4709-8531-4fd10169efde None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:37.931829 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:37.932511 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:37.932813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:37.933084 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] PATH_INFO: `/v3/users/eb78d2d2eea1435288bb870d35dc6db0` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:37.934398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb78d2d2eea1435288bb870d35dc6db0)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:37.936336 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:37.989847 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb78d2d2eea1435288bb870d35dc6db0'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:37.997941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb78d2d2eea1435288bb870d35dc6db0'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:37.998719 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb78d2d2eea1435288bb870d35dc6db0'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.012209 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb78d2d2eea1435288bb870d35dc6db0'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.012858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb78d2d2eea1435288bb870d35dc6db0'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.028523 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1398/2799] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:52:37 2022] DELETE /identity/v3/users/eb78d2d2eea1435288bb870d35dc6db0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:38.219644 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36f2bc-bc55-4ffc-9a30-6b85a35efa54 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:38.250876 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36f2bc-bc55-4ffc-9a30-6b85a35efa54 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:38.304028 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=100 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:38.314956 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:38.315610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:38.315893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:38.316172 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] PATH_INFO: `/v3/projects/1478b2e93d8e4fb6bc00d390d9bcdab9` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:38.317395 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1478b2e93d8e4fb6bc00d390d9bcdab9)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:38.319368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:38.374765 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1478b2e93d8e4fb6bc00d390d9bcdab9', 'request_id': 'req-6eae6282-5ed8-40f3-9556-0711692a5037'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.383495 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1478b2e93d8e4fb6bc00d390d9bcdab9', 'request_id': 'req-6eae6282-5ed8-40f3-9556-0711692a5037'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.389505 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1478b2e93d8e4fb6bc00d390d9bcdab9', 'request_id': 'req-6eae6282-5ed8-40f3-9556-0711692a5037'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.400577 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] The token cache is being invalidate because project 1478b2e93d8e4fb6bc00d390d9bcdab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:52:38.400860 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.401527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.403056 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1402/2800] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:52:38 2022] DELETE /identity/v3/projects/1478b2e93d8e4fb6bc00d390d9bcdab9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:52:38.407187 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:38.408723 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:38.422012 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248581bc-0985-4cf9-8a0a-724f53c5a5bd admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:38.479736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c86dc-6893-4bd4-b6b5-27063b987e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:38.480736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c86dc-6893-4bd4-b6b5-27063b987e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:38.481018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c86dc-6893-4bd4-b6b5-27063b987e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:38.481304 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c86dc-6893-4bd4-b6b5-27063b987e5e admin admin] PATH_INFO: `/v3/users/98895f2c797848b5ad72383830f49c26` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:38.482576 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c86dc-6893-4bd4-b6b5-27063b987e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=98895f2c797848b5ad72383830f49c26)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:38.484722 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c86dc-6893-4bd4-b6b5-27063b987e5e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:38.534022 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:38.535894 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-627c86dc-6893-4bd4-b6b5-27063b987e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98895f2c797848b5ad72383830f49c26'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.554018 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-627c86dc-6893-4bd4-b6b5-27063b987e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98895f2c797848b5ad72383830f49c26'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.554874 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-627c86dc-6893-4bd4-b6b5-27063b987e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98895f2c797848b5ad72383830f49c26'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.570359 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-627c86dc-6893-4bd4-b6b5-27063b987e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98895f2c797848b5ad72383830f49c26'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.571093 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-627c86dc-6893-4bd4-b6b5-27063b987e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98895f2c797848b5ad72383830f49c26'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.586375 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1399/2801] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:52:38 2022] DELETE /identity/v3/users/98895f2c797848b5ad72383830f49c26 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:38.777628 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:38.779499 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:38.793392 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6282-5ed8-40f3-9556-0711692a5037 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:38.852721 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff76617-faa1-499b-9b4f-8239b7df73b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:38.853403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff76617-faa1-499b-9b4f-8239b7df73b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:38.853682 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff76617-faa1-499b-9b4f-8239b7df73b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:38.853954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff76617-faa1-499b-9b4f-8239b7df73b7 admin admin] PATH_INFO: `/v3/projects/feb3b9b7c5ab49c4ae2f5d2ddfc273d4` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:38.855126 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff76617-faa1-499b-9b4f-8239b7df73b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb3b9b7c5ab49c4ae2f5d2ddfc273d4)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:38.857031 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff76617-faa1-499b-9b4f-8239b7df73b7 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:38.905645 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8ff76617-faa1-499b-9b4f-8239b7df73b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb3b9b7c5ab49c4ae2f5d2ddfc273d4', 'request_id': 'req-8ff76617-faa1-499b-9b4f-8239b7df73b7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.916039 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8ff76617-faa1-499b-9b4f-8239b7df73b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb3b9b7c5ab49c4ae2f5d2ddfc273d4', 'request_id': 'req-8ff76617-faa1-499b-9b4f-8239b7df73b7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.924630 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8ff76617-faa1-499b-9b4f-8239b7df73b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb3b9b7c5ab49c4ae2f5d2ddfc273d4', 'request_id': 'req-8ff76617-faa1-499b-9b4f-8239b7df73b7'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.938069 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8ff76617-faa1-499b-9b4f-8239b7df73b7 admin admin] The token cache is being invalidate because project feb3b9b7c5ab49c4ae2f5d2ddfc273d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86830) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:52:38.938347 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8ff76617-faa1-499b-9b4f-8239b7df73b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.939090 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-8ff76617-faa1-499b-9b4f-8239b7df73b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:38.940785 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1403/2802] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:52:38 2022] DELETE /identity/v3/projects/feb3b9b7c5ab49c4ae2f5d2ddfc273d4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:38.946096 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b27b4-885c-484d-9d84-46f6ad5b9d71 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:38.946619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b27b4-885c-484d-9d84-46f6ad5b9d71 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:38.946619 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b27b4-885c-484d-9d84-46f6ad5b9d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:38.968757 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-197b27b4-885c-484d-9d84-46f6ad5b9d71 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:38.970089 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-197b27b4-885c-484d-9d84-46f6ad5b9d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:39.035540 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1400/2803] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:39.044146 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9734d-e620-4bac-ada1-f038f1055c7a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.044463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9734d-e620-4bac-ada1-f038f1055c7a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.044765 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9734d-e620-4bac-ada1-f038f1055c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.065393 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-e4d9734d-e620-4bac-ada1-f038f1055c7a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:39.066544 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e4d9734d-e620-4bac-ada1-f038f1055c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:39.075679 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1404/2804] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:39.080566 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b27b4-885c-484d-9d84-46f6ad5b9d71 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:39.090803 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b27b4-885c-484d-9d84-46f6ad5b9d71 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:39.095710 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf0f0d-09d0-4145-9fac-641802701745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:39.096356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf0f0d-09d0-4145-9fac-641802701745 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.096657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf0f0d-09d0-4145-9fac-641802701745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.096958 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf0f0d-09d0-4145-9fac-641802701745 admin admin] PATH_INFO: `/v3/domains` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.097702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf0f0d-09d0-4145-9fac-641802701745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86829) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:52:39.098010 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf0f0d-09d0-4145-9fac-641802701745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:39.099626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf0f0d-09d0-4145-9fac-641802701745 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:39.111777 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1401/2805] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:52:39.116599 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9734d-e620-4bac-ada1-f038f1055c7a None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:39.123012 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:39.127416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9734d-e620-4bac-ada1-f038f1055c7a None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:39.133554 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe86453-ae11-4088-bcfe-b17ce219136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:39.134379 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe86453-ae11-4088-bcfe-b17ce219136d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.134888 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe86453-ae11-4088-bcfe-b17ce219136d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.135350 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe86453-ae11-4088-bcfe-b17ce219136d admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.136026 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe86453-ae11-4088-bcfe-b17ce219136d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:39.138029 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe86453-ae11-4088-bcfe-b17ce219136d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:39.167951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1405/2806] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:52:39 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:52:39.172456 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf0f0d-09d0-4145-9fac-641802701745 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:39.187463 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf0f0d-09d0-4145-9fac-641802701745 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:39.247996 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4393c9-d715-41f4-9f65-cea9da9dc412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:39.248623 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4393c9-d715-41f4-9f65-cea9da9dc412 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.248901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4393c9-d715-41f4-9f65-cea9da9dc412 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.249192 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4393c9-d715-41f4-9f65-cea9da9dc412 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.249887 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4393c9-d715-41f4-9f65-cea9da9dc412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:39.251823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4393c9-d715-41f4-9f65-cea9da9dc412 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:39.273999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1402/2807] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:52:39 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:52:39.278345 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe86453-ae11-4088-bcfe-b17ce219136d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:39.289454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe86453-ae11-4088-bcfe-b17ce219136d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:39.294640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45b992-99ca-4aea-a3f0-dcf6b016a5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:39.295248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b992-99ca-4aea-a3f0-dcf6b016a5dd admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.295527 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b992-99ca-4aea-a3f0-dcf6b016a5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.295784 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45b992-99ca-4aea-a3f0-dcf6b016a5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.296473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45b992-99ca-4aea-a3f0-dcf6b016a5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:39.298115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45b992-99ca-4aea-a3f0-dcf6b016a5dd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:39.308240 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1406/2808] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:52:39.312500 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4393c9-d715-41f4-9f65-cea9da9dc412 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:39.323668 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4393c9-d715-41f4-9f65-cea9da9dc412 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:39.329146 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fe42d-5f88-4a0d-ad3f-947bd9adbb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:39.330211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fe42d-5f88-4a0d-ad3f-947bd9adbb94 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.330489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fe42d-5f88-4a0d-ad3f-947bd9adbb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.330753 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fe42d-5f88-4a0d-ad3f-947bd9adbb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.331450 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fe42d-5f88-4a0d-ad3f-947bd9adbb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:39.333037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fe42d-5f88-4a0d-ad3f-947bd9adbb94 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:39.343982 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1403/2809] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:52:39.348405 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45b992-99ca-4aea-a3f0-dcf6b016a5dd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:39.359285 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45b992-99ca-4aea-a3f0-dcf6b016a5dd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:39.364662 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81cb7b-ede3-4fa8-83cc-c5b759825e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:39.365399 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81cb7b-ede3-4fa8-83cc-c5b759825e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.365683 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81cb7b-ede3-4fa8-83cc-c5b759825e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.365957 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81cb7b-ede3-4fa8-83cc-c5b759825e3c admin admin] PATH_INFO: `/v3/projects/c7fc1c9527cd4430a560c969b7dc5039/users/710c5b3f5207476b86eee47aac692e76/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.381248 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81cb7b-ede3-4fa8-83cc-c5b759825e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fc1c9527cd4430a560c969b7dc5039, user_id=710c5b3f5207476b86eee47aac692e76, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:39.383954 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81cb7b-ede3-4fa8-83cc-c5b759825e3c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:39.398845 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1407/2810] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:52:39 2022] PUT /identity/v3/projects/c7fc1c9527cd4430a560c969b7dc5039/users/710c5b3f5207476b86eee47aac692e76/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:39.409718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccadaed-160f-406e-9128-c5aed2478a2d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.410008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccadaed-160f-406e-9128-c5aed2478a2d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.410281 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccadaed-160f-406e-9128-c5aed2478a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.442626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-fccadaed-160f-406e-9128-c5aed2478a2d None None] MFA Rules not processed for user `710c5b3f5207476b86eee47aac692e76`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:39.443925 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fccadaed-160f-406e-9128-c5aed2478a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:39.461823 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:39.513987 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1404/2811] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:39.519076 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81cb7b-ede3-4fa8-83cc-c5b759825e3c admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:39.589060 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81cb7b-ede3-4fa8-83cc-c5b759825e3c admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:39.595519 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcfc34-4332-4888-b8d5-992d0050acb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:39.596140 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcfc34-4332-4888-b8d5-992d0050acb1 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.596418 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcfc34-4332-4888-b8d5-992d0050acb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.596686 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcfc34-4332-4888-b8d5-992d0050acb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.597391 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcfc34-4332-4888-b8d5-992d0050acb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:39.599455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcfc34-4332-4888-b8d5-992d0050acb1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:39.627591 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1408/2812] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:52:39 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:52:39.631919 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccadaed-160f-406e-9128-c5aed2478a2d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:39.642637 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccadaed-160f-406e-9128-c5aed2478a2d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:39.699039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188ca80-cb7d-4c8e-9a45-94afae06fc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:39.699652 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188ca80-cb7d-4c8e-9a45-94afae06fc77 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.699931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188ca80-cb7d-4c8e-9a45-94afae06fc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.700184 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5188ca80-cb7d-4c8e-9a45-94afae06fc77 admin admin] PATH_INFO: `/v3/users` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.700927 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188ca80-cb7d-4c8e-9a45-94afae06fc77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:39.702891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5188ca80-cb7d-4c8e-9a45-94afae06fc77 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:39.726516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1405/2813] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:52:39 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:52:39.730716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcfc34-4332-4888-b8d5-992d0050acb1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:39.743216 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcfc34-4332-4888-b8d5-992d0050acb1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:39.749953 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393f4f9-34c9-463e-aee6-fd93de0b77c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:39.750648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393f4f9-34c9-463e-aee6-fd93de0b77c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.750929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393f4f9-34c9-463e-aee6-fd93de0b77c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.751202 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393f4f9-34c9-463e-aee6-fd93de0b77c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.751948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393f4f9-34c9-463e-aee6-fd93de0b77c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:39.753899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393f4f9-34c9-463e-aee6-fd93de0b77c1 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:39.765866 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1409/2814] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:52:39.770013 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188ca80-cb7d-4c8e-9a45-94afae06fc77 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:39.780872 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5188ca80-cb7d-4c8e-9a45-94afae06fc77 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:39.786821 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270df93e-8d91-440c-bc17-3961789ccf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:39.787467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270df93e-8d91-440c-bc17-3961789ccf6c admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.787758 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270df93e-8d91-440c-bc17-3961789ccf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.788031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270df93e-8d91-440c-bc17-3961789ccf6c admin admin] PATH_INFO: `/v3/projects/2e5253b9d8f24ef1881e7460f00873d8/users/284d0d29909b42b6810140829de76f07/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.803059 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270df93e-8d91-440c-bc17-3961789ccf6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5253b9d8f24ef1881e7460f00873d8, user_id=284d0d29909b42b6810140829de76f07, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:39.805767 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270df93e-8d91-440c-bc17-3961789ccf6c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:39.820617 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1406/2815] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:52:39 2022] PUT /identity/v3/projects/2e5253b9d8f24ef1881e7460f00873d8/users/284d0d29909b42b6810140829de76f07/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:39.824834 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393f4f9-34c9-463e-aee6-fd93de0b77c1 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:39.835367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393f4f9-34c9-463e-aee6-fd93de0b77c1 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:39.895807 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca15b7-2cfb-44a5-a7b6-68121f3c531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:39.896430 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca15b7-2cfb-44a5-a7b6-68121f3c531c admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.896706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca15b7-2cfb-44a5-a7b6-68121f3c531c admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.896975 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca15b7-2cfb-44a5-a7b6-68121f3c531c admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.897709 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca15b7-2cfb-44a5-a7b6-68121f3c531c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:39.899304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca15b7-2cfb-44a5-a7b6-68121f3c531c admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:39.909252 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1410/2816] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:52:39.913651 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270df93e-8d91-440c-bc17-3961789ccf6c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:39.924682 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270df93e-8d91-440c-bc17-3961789ccf6c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:39.930300 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce0db0-9a00-414c-a6e3-62cdc303a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:39.931006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce0db0-9a00-414c-a6e3-62cdc303a485 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.931284 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce0db0-9a00-414c-a6e3-62cdc303a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.931554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce0db0-9a00-414c-a6e3-62cdc303a485 admin admin] PATH_INFO: `/v3/projects/2e5253b9d8f24ef1881e7460f00873d8/users/284d0d29909b42b6810140829de76f07/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.933789 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce0db0-9a00-414c-a6e3-62cdc303a485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5253b9d8f24ef1881e7460f00873d8, user_id=284d0d29909b42b6810140829de76f07, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:39.936448 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce0db0-9a00-414c-a6e3-62cdc303a485 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:39.947955 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1407/2817] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:52:39 2022] PUT /identity/v3/projects/2e5253b9d8f24ef1881e7460f00873d8/users/284d0d29909b42b6810140829de76f07/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:39.959903 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c468ab-a425-4417-851b-0a7bb5707437 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:39.960190 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c468ab-a425-4417-851b-0a7bb5707437 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:39.960488 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c468ab-a425-4417-851b-0a7bb5707437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:39.989710 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-84c468ab-a425-4417-851b-0a7bb5707437 None None] MFA Rules not processed for user `284d0d29909b42b6810140829de76f07`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:39.990936 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-84c468ab-a425-4417-851b-0a7bb5707437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:39.996536 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:40.065022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1411/2818] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:52:40.076696 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce0db0-9a00-414c-a6e3-62cdc303a485 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:40.078554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-1fce0db0-9a00-414c-a6e3-62cdc303a485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:40.138961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce0db0-9a00-414c-a6e3-62cdc303a485 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:40.143564 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d709aa-0763-47f4-8755-1f05af5de04e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:40.144167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d709aa-0763-47f4-8755-1f05af5de04e service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:40.144495 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d709aa-0763-47f4-8755-1f05af5de04e service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:40.144764 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d709aa-0763-47f4-8755-1f05af5de04e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:40.169323 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:40.204006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d709aa-0763-47f4-8755-1f05af5de04e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:40.205876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d709aa-0763-47f4-8755-1f05af5de04e service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:40.215317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1408/2819] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:43.089274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf5a54-5be3-42cf-b575-45369cb1707d None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:43.089873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf5a54-5be3-42cf-b575-45369cb1707d None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:43.089873 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf5a54-5be3-42cf-b575-45369cb1707d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:43.110833 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-80bf5a54-5be3-42cf-b575-45369cb1707d None None] MFA Rules not processed for user `8ec39c2bf1784b16b1fa357f763c2bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:43.112095 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-80bf5a54-5be3-42cf-b575-45369cb1707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:43.171343 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1412/2820] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:44.483639 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d709aa-0763-47f4-8755-1f05af5de04e service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:44.485317 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-c1d709aa-0763-47f4-8755-1f05af5de04e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:44.497015 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d709aa-0763-47f4-8755-1f05af5de04e service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:44.500598 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0b3a7-561b-4860-9aa6-a4e73c638259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:44.501207 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0b3a7-561b-4860-9aa6-a4e73c638259 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:44.501518 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0b3a7-561b-4860-9aa6-a4e73c638259 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:44.501791 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0b3a7-561b-4860-9aa6-a4e73c638259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:44.510764 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0b3a7-561b-4860-9aa6-a4e73c638259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:44.512183 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0b3a7-561b-4860-9aa6-a4e73c638259 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:44.521505 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1409/2821] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:49.503534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf5a54-5be3-42cf-b575-45369cb1707d None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:49.571300 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf5a54-5be3-42cf-b575-45369cb1707d None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:49.578959 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:49.579973 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:49.580249 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:49.580506 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] PATH_INFO: `/v3/users/710c5b3f5207476b86eee47aac692e76` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:49.581736 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=710c5b3f5207476b86eee47aac692e76)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:49.583640 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:49.633962 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '710c5b3f5207476b86eee47aac692e76'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:49.636087 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:49.642752 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '710c5b3f5207476b86eee47aac692e76'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:49.650309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '710c5b3f5207476b86eee47aac692e76'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:49.650972 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '710c5b3f5207476b86eee47aac692e76'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:49.662325 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '710c5b3f5207476b86eee47aac692e76'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:49.668183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1413/2822] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:52:49 2022] DELETE /identity/v3/users/710c5b3f5207476b86eee47aac692e76 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:49.672760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1d98b-51cb-4ce9-9e6c-f1aa0048199d None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:49.673250 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1d98b-51cb-4ce9-9e6c-f1aa0048199d None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:49.673365 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1d98b-51cb-4ce9-9e6c-f1aa0048199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:49.693444 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-54e1d98b-51cb-4ce9-9e6c-f1aa0048199d None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:49.694663 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-54e1d98b-51cb-4ce9-9e6c-f1aa0048199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:49.757149 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1410/2823] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:49.767210 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:49.769021 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:49.826525 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6426c0-cf73-4925-b62a-11fdf41f2d26 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:49.830585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ba636-5d68-4be4-8dbb-e9b35afd6b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:49.831206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ba636-5d68-4be4-8dbb-e9b35afd6b58 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:49.831486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ba636-5d68-4be4-8dbb-e9b35afd6b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:49.831760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ba636-5d68-4be4-8dbb-e9b35afd6b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:49.841250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ba636-5d68-4be4-8dbb-e9b35afd6b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:49.842708 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ba636-5d68-4be4-8dbb-e9b35afd6b58 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:49.852543 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1414/2824] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:50.131251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1d98b-51cb-4ce9-9e6c-f1aa0048199d None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:50.132875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-54e1d98b-51cb-4ce9-9e6c-f1aa0048199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:50.152398 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1d98b-51cb-4ce9-9e6c-f1aa0048199d None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:50.158220 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:50.159034 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:50.159172 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:50.159372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] PATH_INFO: `/v3/projects/c7fc1c9527cd4430a560c969b7dc5039` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:50.160763 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7fc1c9527cd4430a560c969b7dc5039)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:50.162734 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:50.212531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7fc1c9527cd4430a560c969b7dc5039', 'request_id': 'req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.218625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7fc1c9527cd4430a560c969b7dc5039', 'request_id': 'req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.227281 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7fc1c9527cd4430a560c969b7dc5039', 'request_id': 'req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.238105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] The token cache is being invalidate because project c7fc1c9527cd4430a560c969b7dc5039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:52:50.238105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.238653 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.240259 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1411/2825] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:52:50 2022] DELETE /identity/v3/projects/c7fc1c9527cd4430a560c969b7dc5039 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:50.244693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ba636-5d68-4be4-8dbb-e9b35afd6b58 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:50.254569 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ba636-5d68-4be4-8dbb-e9b35afd6b58 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:50.314800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc84cc7-2b67-436c-add9-761038532671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:50.315359 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc84cc7-2b67-436c-add9-761038532671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:50.315638 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc84cc7-2b67-436c-add9-761038532671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:50.315915 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc84cc7-2b67-436c-add9-761038532671 admin admin] PATH_INFO: `/v3/users/284d0d29909b42b6810140829de76f07` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:50.317129 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc84cc7-2b67-436c-add9-761038532671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=284d0d29909b42b6810140829de76f07)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:50.319081 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc84cc7-2b67-436c-add9-761038532671 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:50.369510 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ecc84cc7-2b67-436c-add9-761038532671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284d0d29909b42b6810140829de76f07'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.377051 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ecc84cc7-2b67-436c-add9-761038532671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284d0d29909b42b6810140829de76f07'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.386646 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ecc84cc7-2b67-436c-add9-761038532671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284d0d29909b42b6810140829de76f07'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.387368 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ecc84cc7-2b67-436c-add9-761038532671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284d0d29909b42b6810140829de76f07'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.395126 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:50.401707 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-ecc84cc7-2b67-436c-add9-761038532671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284d0d29909b42b6810140829de76f07'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.408455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1415/2826] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:52:50 2022] DELETE /identity/v3/users/284d0d29909b42b6810140829de76f07 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:50.708269 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:50.709821 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:50.723428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ebbdc-a5dd-4468-8dd5-ef7f03e3af9c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:50.763483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:50.790350 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677689b-e239-4471-a1a3-d54cc7f50699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:50.791117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677689b-e239-4471-a1a3-d54cc7f50699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:50.791393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677689b-e239-4471-a1a3-d54cc7f50699 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:50.791656 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677689b-e239-4471-a1a3-d54cc7f50699 admin admin] PATH_INFO: `/v3/projects/2e5253b9d8f24ef1881e7460f00873d8` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:50.792901 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677689b-e239-4471-a1a3-d54cc7f50699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5253b9d8f24ef1881e7460f00873d8)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:50.794858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677689b-e239-4471-a1a3-d54cc7f50699 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:50.843393 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e677689b-e239-4471-a1a3-d54cc7f50699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5253b9d8f24ef1881e7460f00873d8', 'request_id': 'req-e677689b-e239-4471-a1a3-d54cc7f50699'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.850460 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e677689b-e239-4471-a1a3-d54cc7f50699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5253b9d8f24ef1881e7460f00873d8', 'request_id': 'req-e677689b-e239-4471-a1a3-d54cc7f50699'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.859657 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e677689b-e239-4471-a1a3-d54cc7f50699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5253b9d8f24ef1881e7460f00873d8', 'request_id': 'req-e677689b-e239-4471-a1a3-d54cc7f50699'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.872255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e677689b-e239-4471-a1a3-d54cc7f50699 admin admin] The token cache is being invalidate because project 2e5253b9d8f24ef1881e7460f00873d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:52:50.872480 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e677689b-e239-4471-a1a3-d54cc7f50699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.873255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-e677689b-e239-4471-a1a3-d54cc7f50699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:50.875157 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1412/2827] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:52:50 2022] DELETE /identity/v3/projects/2e5253b9d8f24ef1881e7460f00873d8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:50.881585 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735ea5b-ce48-4c57-a038-cc911ce7e5b3 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:50.882105 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735ea5b-ce48-4c57-a038-cc911ce7e5b3 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:50.882216 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735ea5b-ce48-4c57-a038-cc911ce7e5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:50.905976 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5735ea5b-ce48-4c57-a038-cc911ce7e5b3 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:50.907293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5735ea5b-ce48-4c57-a038-cc911ce7e5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:50.982948 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1416/2828] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:50.992895 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa229211-8cf2-47ab-94c1-70d4dfac2d5a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:50.993182 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa229211-8cf2-47ab-94c1-70d4dfac2d5a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:50.993557 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa229211-8cf2-47ab-94c1-70d4dfac2d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:51.027483 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-aa229211-8cf2-47ab-94c1-70d4dfac2d5a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:51.029022 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-aa229211-8cf2-47ab-94c1-70d4dfac2d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:51.039071 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1413/2829] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:51.043586 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735ea5b-ce48-4c57-a038-cc911ce7e5b3 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:51.071623 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735ea5b-ce48-4c57-a038-cc911ce7e5b3 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:51.081571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56719a03-8581-4896-a6a6-d3aabf788791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:51.082301 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719a03-8581-4896-a6a6-d3aabf788791 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:51.082651 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719a03-8581-4896-a6a6-d3aabf788791 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:51.082992 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56719a03-8581-4896-a6a6-d3aabf788791 admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:51.083821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56719a03-8581-4896-a6a6-d3aabf788791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:52:51.084251 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56719a03-8581-4896-a6a6-d3aabf788791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:51.086103 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56719a03-8581-4896-a6a6-d3aabf788791 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:51.099344 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1417/2830] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:52:51.104165 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa229211-8cf2-47ab-94c1-70d4dfac2d5a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:51.114621 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa229211-8cf2-47ab-94c1-70d4dfac2d5a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:51.119326 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6a635-124b-4bea-a6ba-a070b94c5b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:51.119952 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6a635-124b-4bea-a6ba-a070b94c5b07 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:51.120232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6a635-124b-4bea-a6ba-a070b94c5b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:51.120502 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6a635-124b-4bea-a6ba-a070b94c5b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:51.121176 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6a635-124b-4bea-a6ba-a070b94c5b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:51.123550 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6a635-124b-4bea-a6ba-a070b94c5b07 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:51.155674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1414/2831] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:52:51 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:52:51.159553 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56719a03-8581-4896-a6a6-d3aabf788791 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:51.170373 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56719a03-8581-4896-a6a6-d3aabf788791 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:51.226879 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bc436-7802-4535-8212-73e47918641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:51.227716 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bc436-7802-4535-8212-73e47918641b admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:51.228113 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bc436-7802-4535-8212-73e47918641b admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:51.228459 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68bc436-7802-4535-8212-73e47918641b admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:51.229245 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bc436-7802-4535-8212-73e47918641b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:51.231308 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68bc436-7802-4535-8212-73e47918641b admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:51.254826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1418/2832] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:52:51 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:52:51.259283 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6a635-124b-4bea-a6ba-a070b94c5b07 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:51.270243 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6a635-124b-4bea-a6ba-a070b94c5b07 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:51.275471 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563ac60-d79a-48ee-adbc-614b02019876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:51.276117 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563ac60-d79a-48ee-adbc-614b02019876 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:51.276404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563ac60-d79a-48ee-adbc-614b02019876 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:51.276674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563ac60-d79a-48ee-adbc-614b02019876 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:51.277415 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563ac60-d79a-48ee-adbc-614b02019876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:51.279031 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563ac60-d79a-48ee-adbc-614b02019876 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:51.289389 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1415/2833] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:52:51.293678 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bc436-7802-4535-8212-73e47918641b admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:51.304552 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68bc436-7802-4535-8212-73e47918641b admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:51.310889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c36102-df7a-4590-b6a0-33c58cfdbdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:51.311501 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c36102-df7a-4590-b6a0-33c58cfdbdb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:51.311782 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c36102-df7a-4590-b6a0-33c58cfdbdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:51.312052 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c36102-df7a-4590-b6a0-33c58cfdbdb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:51.312755 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c36102-df7a-4590-b6a0-33c58cfdbdb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:51.314432 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c36102-df7a-4590-b6a0-33c58cfdbdb0 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:51.326220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1419/2834] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:52:51.330858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563ac60-d79a-48ee-adbc-614b02019876 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:51.341395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563ac60-d79a-48ee-adbc-614b02019876 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:51.346498 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de34cc-d7fe-482e-822d-4077ff28d011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:51.347168 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de34cc-d7fe-482e-822d-4077ff28d011 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:51.348086 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de34cc-d7fe-482e-822d-4077ff28d011 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:51.348372 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de34cc-d7fe-482e-822d-4077ff28d011 admin admin] PATH_INFO: `/v3/projects/784b503d994e4849b7d85cd72274bd39/users/1d8f98d7943a49f0a4507dca33f60096/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:51.363709 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de34cc-d7fe-482e-822d-4077ff28d011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784b503d994e4849b7d85cd72274bd39, user_id=1d8f98d7943a49f0a4507dca33f60096, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:51.366428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de34cc-d7fe-482e-822d-4077ff28d011 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:51.380413 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1416/2835] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:52:51 2022] PUT /identity/v3/projects/784b503d994e4849b7d85cd72274bd39/users/1d8f98d7943a49f0a4507dca33f60096/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:52:51.451800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159f6cf-55a4-4ec2-a15f-0358257f025c None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:51.452101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159f6cf-55a4-4ec2-a15f-0358257f025c None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:51.452725 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159f6cf-55a4-4ec2-a15f-0358257f025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:51.485617 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-5159f6cf-55a4-4ec2-a15f-0358257f025c None None] MFA Rules not processed for user `1d8f98d7943a49f0a4507dca33f60096`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:51.486817 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5159f6cf-55a4-4ec2-a15f-0358257f025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:51.536018 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:51.560591 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1420/2836] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:52:51.572285 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de34cc-d7fe-482e-822d-4077ff28d011 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:51.574131 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f9de34cc-d7fe-482e-822d-4077ff28d011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:51.634214 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de34cc-d7fe-482e-822d-4077ff28d011 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:51.638210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bd2a4-d1db-42ee-8a36-cdbf5c09a652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:51.638852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bd2a4-d1db-42ee-8a36-cdbf5c09a652 service cinder] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:51.639124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bd2a4-d1db-42ee-8a36-cdbf5c09a652 service cinder] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:51.639390 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bd2a4-d1db-42ee-8a36-cdbf5c09a652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:51.649207 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bd2a4-d1db-42ee-8a36-cdbf5c09a652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:51.650765 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857bd2a4-d1db-42ee-8a36-cdbf5c09a652 service cinder] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:51.660711 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1417/2837] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:55.098347 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef085e0-3639-4348-84da-0030681a8dbc None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:55.098942 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef085e0-3639-4348-84da-0030681a8dbc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:55.098942 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef085e0-3639-4348-84da-0030681a8dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:55.120042 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-eef085e0-3639-4348-84da-0030681a8dbc None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:55.121261 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-eef085e0-3639-4348-84da-0030681a8dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:55.185648 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1421/2838] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Jul 26 02:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:55.201754 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bd2a4-d1db-42ee-8a36-cdbf5c09a652 service cinder] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:55.203458 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-857bd2a4-d1db-42ee-8a36-cdbf5c09a652 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:55.210590 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:55.282307 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bd2a4-d1db-42ee-8a36-cdbf5c09a652 service cinder] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:55.288423 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc400ae3-f4ef-4f1e-ad9e-b76304d94683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:55.289034 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc400ae3-f4ef-4f1e-ad9e-b76304d94683 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:55.289397 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc400ae3-f4ef-4f1e-ad9e-b76304d94683 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:55.289595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc400ae3-f4ef-4f1e-ad9e-b76304d94683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:55.298001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc400ae3-f4ef-4f1e-ad9e-b76304d94683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:55.299599 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc400ae3-f4ef-4f1e-ad9e-b76304d94683 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:55.309174 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1418/2839] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:57.082932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef085e0-3639-4348-84da-0030681a8dbc None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:57.093386 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef085e0-3639-4348-84da-0030681a8dbc None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:57.099260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:57.099938 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:57.100214 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:57.100487 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] PATH_INFO: `/v3/users/1d8f98d7943a49f0a4507dca33f60096` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:57.101874 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d8f98d7943a49f0a4507dca33f60096)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:57.104178 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:57.154098 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d8f98d7943a49f0a4507dca33f60096'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:57.160950 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d8f98d7943a49f0a4507dca33f60096'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:57.169555 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d8f98d7943a49f0a4507dca33f60096'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:57.170213 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d8f98d7943a49f0a4507dca33f60096'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:57.182186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d8f98d7943a49f0a4507dca33f60096'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:57.188310 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1422/2840] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:52:57 2022] DELETE /identity/v3/users/1d8f98d7943a49f0a4507dca33f60096 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:57.192914 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7e17f-a029-4b17-87ce-f9246977c7f0 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:57.193439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7e17f-a029-4b17-87ce-f9246977c7f0 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:57.193845 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7e17f-a029-4b17-87ce-f9246977c7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:57.213595 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-6bc7e17f-a029-4b17-87ce-f9246977c7f0 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:57.214874 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6bc7e17f-a029-4b17-87ce-f9246977c7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:57.271611 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1419/2841] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:57.281932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:57.283534 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:57.341535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151c221-d65e-4f91-89be-544607d2315d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:57.345610 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4979a-586d-4d06-9609-87df2cfaff97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:57.346217 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4979a-586d-4d06-9609-87df2cfaff97 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:57.346493 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4979a-586d-4d06-9609-87df2cfaff97 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:57.346760 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4979a-586d-4d06-9609-87df2cfaff97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:57.355874 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4979a-586d-4d06-9609-87df2cfaff97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:57.357323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4979a-586d-4d06-9609-87df2cfaff97 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:57.362439 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:57.370345 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1423/2842] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:57.667379 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7e17f-a029-4b17-87ce-f9246977c7f0 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:57.668876 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-6bc7e17f-a029-4b17-87ce-f9246977c7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:57.683077 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7e17f-a029-4b17-87ce-f9246977c7f0 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:57.688588 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780b2a1-dbf6-4b9e-a08d-2db2571def10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:57.689439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b2a1-dbf6-4b9e-a08d-2db2571def10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:57.689784 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b2a1-dbf6-4b9e-a08d-2db2571def10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:57.690280 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b2a1-dbf6-4b9e-a08d-2db2571def10 admin admin] PATH_INFO: `/v3/projects/784b503d994e4849b7d85cd72274bd39` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:57.692446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780b2a1-dbf6-4b9e-a08d-2db2571def10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784b503d994e4849b7d85cd72274bd39)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:57.694441 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780b2a1-dbf6-4b9e-a08d-2db2571def10 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:57.746194 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1780b2a1-dbf6-4b9e-a08d-2db2571def10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784b503d994e4849b7d85cd72274bd39', 'request_id': 'req-1780b2a1-dbf6-4b9e-a08d-2db2571def10'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:57.752962 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1780b2a1-dbf6-4b9e-a08d-2db2571def10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784b503d994e4849b7d85cd72274bd39', 'request_id': 'req-1780b2a1-dbf6-4b9e-a08d-2db2571def10'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:57.762725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1780b2a1-dbf6-4b9e-a08d-2db2571def10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784b503d994e4849b7d85cd72274bd39', 'request_id': 'req-1780b2a1-dbf6-4b9e-a08d-2db2571def10'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:57.773105 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1780b2a1-dbf6-4b9e-a08d-2db2571def10 admin admin] The token cache is being invalidate because project 784b503d994e4849b7d85cd72274bd39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:52:57.773426 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1780b2a1-dbf6-4b9e-a08d-2db2571def10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:57.774051 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-1780b2a1-dbf6-4b9e-a08d-2db2571def10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:52:57.775563 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1420/2843] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:52:57 2022] DELETE /identity/v3/projects/784b503d994e4849b7d85cd72274bd39 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:52:57.780880 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1732f-7f4a-456c-b106-45c33e6d6108 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:57.781167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1732f-7f4a-456c-b106-45c33e6d6108 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:57.781473 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1732f-7f4a-456c-b106-45c33e6d6108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:57.801317 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-1ee1732f-7f4a-456c-b106-45c33e6d6108 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:57.802545 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1ee1732f-7f4a-456c-b106-45c33e6d6108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:57.865661 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1424/2844] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:52:57.873998 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cdd84-f379-46b3-a60a-1738bbef4021 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:57.874289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cdd84-f379-46b3-a60a-1738bbef4021 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:57.874561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cdd84-f379-46b3-a60a-1738bbef4021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:57.896445 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-931cdd84-f379-46b3-a60a-1738bbef4021 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:57.897698 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-931cdd84-f379-46b3-a60a-1738bbef4021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:57.905878 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1421/2845] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:57.910521 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1732f-7f4a-456c-b106-45c33e6d6108 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:57.921220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1732f-7f4a-456c-b106-45c33e6d6108 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:57.926800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f338f3-4e79-4821-af7f-f51e7791607a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:57.927413 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f338f3-4e79-4821-af7f-f51e7791607a admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:57.927693 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f338f3-4e79-4821-af7f-f51e7791607a admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:57.927966 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f338f3-4e79-4821-af7f-f51e7791607a admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:57.928667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f338f3-4e79-4821-af7f-f51e7791607a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:52:57.928971 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f338f3-4e79-4821-af7f-f51e7791607a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:57.930618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f338f3-4e79-4821-af7f-f51e7791607a admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:57.943520 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1425/2846] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 02:52:57.948098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cdd84-f379-46b3-a60a-1738bbef4021 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:57.958279 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cdd84-f379-46b3-a60a-1738bbef4021 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:57.963635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae37c04-51bb-4e8c-aa95-e6d12d5f85e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:57.964249 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae37c04-51bb-4e8c-aa95-e6d12d5f85e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:57.964529 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae37c04-51bb-4e8c-aa95-e6d12d5f85e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:57.964802 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae37c04-51bb-4e8c-aa95-e6d12d5f85e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:57.965497 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae37c04-51bb-4e8c-aa95-e6d12d5f85e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:57.967399 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae37c04-51bb-4e8c-aa95-e6d12d5f85e3 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:57.972307 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:58.000973 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1422/2847] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:52:57 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:52:58.005293 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f338f3-4e79-4821-af7f-f51e7791607a admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:58.015546 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f338f3-4e79-4821-af7f-f51e7791607a admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:58.071900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a13cf-1c23-4aca-b5c3-c0f9883a4c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:58.072520 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a13cf-1c23-4aca-b5c3-c0f9883a4c5d admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:58.072797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a13cf-1c23-4aca-b5c3-c0f9883a4c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:58.073070 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a13cf-1c23-4aca-b5c3-c0f9883a4c5d admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:58.073771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a13cf-1c23-4aca-b5c3-c0f9883a4c5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:58.075698 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a13cf-1c23-4aca-b5c3-c0f9883a4c5d admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:58.099815 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1426/2848] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:52:58 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:52:58.103875 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae37c04-51bb-4e8c-aa95-e6d12d5f85e3 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:58.114922 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae37c04-51bb-4e8c-aa95-e6d12d5f85e3 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:58.120221 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ad36a-45cf-4068-b894-0f74109cdc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:58.121048 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ad36a-45cf-4068-b894-0f74109cdc3f admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:58.121467 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ad36a-45cf-4068-b894-0f74109cdc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:58.121838 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ad36a-45cf-4068-b894-0f74109cdc3f admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:58.122625 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ad36a-45cf-4068-b894-0f74109cdc3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:58.124402 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ad36a-45cf-4068-b894-0f74109cdc3f admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:58.134725 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1423/2849] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:52:58.138889 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a13cf-1c23-4aca-b5c3-c0f9883a4c5d admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:58.149192 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a13cf-1c23-4aca-b5c3-c0f9883a4c5d admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:58.154831 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631d781-0de1-4125-9c84-4996946ed899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:58.155576 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d781-0de1-4125-9c84-4996946ed899 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:58.155858 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d781-0de1-4125-9c84-4996946ed899 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:58.156133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d781-0de1-4125-9c84-4996946ed899 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:58.156835 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631d781-0de1-4125-9c84-4996946ed899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:58.158485 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631d781-0de1-4125-9c84-4996946ed899 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:58.172951 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1427/2850] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 02:52:58.174630 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ad36a-45cf-4068-b894-0f74109cdc3f admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:58.185420 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ad36a-45cf-4068-b894-0f74109cdc3f admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:58.190385 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535fa7e-23be-440a-a7e8-7d63d473fcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:58.191122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535fa7e-23be-440a-a7e8-7d63d473fcfe admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:58.191446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535fa7e-23be-440a-a7e8-7d63d473fcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:58.191743 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535fa7e-23be-440a-a7e8-7d63d473fcfe admin admin] PATH_INFO: `/v3/projects/7f8c71fdbb604ca9a35e5bbe23cc6f08/users/226bdd73a20e4544bf888401cf2ec3c3/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:58.207422 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535fa7e-23be-440a-a7e8-7d63d473fcfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8c71fdbb604ca9a35e5bbe23cc6f08, user_id=226bdd73a20e4544bf888401cf2ec3c3, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:58.210148 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535fa7e-23be-440a-a7e8-7d63d473fcfe admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:58.224245 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1424/2851] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:52:58 2022] PUT /identity/v3/projects/7f8c71fdbb604ca9a35e5bbe23cc6f08/users/226bdd73a20e4544bf888401cf2ec3c3/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:52:58.229924 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62423981-d69e-46fb-ac31-edd1e477e864 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:58.230214 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62423981-d69e-46fb-ac31-edd1e477e864 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:58.230549 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62423981-d69e-46fb-ac31-edd1e477e864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:58.261814 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-62423981-d69e-46fb-ac31-edd1e477e864 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:58.263360 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-62423981-d69e-46fb-ac31-edd1e477e864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:58.328656 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1428/2852] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:58.341388 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535fa7e-23be-440a-a7e8-7d63d473fcfe admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:58.344125 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-0535fa7e-23be-440a-a7e8-7d63d473fcfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:58.366691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767925c2-9d84-4984-9f8c-b3c8def412d7 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:58.367083 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767925c2-9d84-4984-9f8c-b3c8def412d7 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:58.367357 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767925c2-9d84-4984-9f8c-b3c8def412d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:58.383486 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:52:58.388853 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-767925c2-9d84-4984-9f8c-b3c8def412d7 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:58.390881 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-767925c2-9d84-4984-9f8c-b3c8def412d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:58.399842 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1429/2853] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Jul 26 02:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:52:58.405232 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535fa7e-23be-440a-a7e8-7d63d473fcfe admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:58.410321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b3cb2-f1a3-40f6-a921-9b98cc2747a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:58.410879 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b3cb2-f1a3-40f6-a921-9b98cc2747a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:58.411167 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b3cb2-f1a3-40f6-a921-9b98cc2747a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:58.411410 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b3cb2-f1a3-40f6-a921-9b98cc2747a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:58.415349 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767925c2-9d84-4984-9f8c-b3c8def412d7 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:58.417045 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-767925c2-9d84-4984-9f8c-b3c8def412d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:58.421381 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b3cb2-f1a3-40f6-a921-9b98cc2747a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:58.422833 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b3cb2-f1a3-40f6-a921-9b98cc2747a1 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:58.432718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1425/2854] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:52:58.495064 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767925c2-9d84-4984-9f8c-b3c8def412d7 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:58.501746 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307c596-2356-464b-93c2-f51782399e10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:58.502456 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307c596-2356-464b-93c2-f51782399e10 service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:58.502808 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307c596-2356-464b-93c2-f51782399e10 service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:58.503136 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307c596-2356-464b-93c2-f51782399e10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:58.512834 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307c596-2356-464b-93c2-f51782399e10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:58.514691 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307c596-2356-464b-93c2-f51782399e10 service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:58.526022 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1430/2855] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 02:52:59.086858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa940a2a-fa3b-4fa4-b950-2cd514ba6ea9 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:59.087211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa940a2a-fa3b-4fa4-b950-2cd514ba6ea9 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:59.087513 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa940a2a-fa3b-4fa4-b950-2cd514ba6ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:59.116770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-fa940a2a-fa3b-4fa4-b950-2cd514ba6ea9 None None] MFA Rules not processed for user `226bdd73a20e4544bf888401cf2ec3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:52:59.118023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-fa940a2a-fa3b-4fa4-b950-2cd514ba6ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:59.186081 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1426/2856] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:52:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:52:59.197374 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307c596-2356-464b-93c2-f51782399e10 service nova] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:52:59.198820 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-6307c596-2356-464b-93c2-f51782399e10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:52:59.258944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307c596-2356-464b-93c2-f51782399e10 service nova] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:52:59.271173 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bfcb7-a2c8-4cec-977f-3f7e4c689894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba1305d4e5914f1182dc7436a2d53965', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:52:59.271819 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bfcb7-a2c8-4cec-977f-3f7e4c689894 service cinder] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:52:59.272101 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bfcb7-a2c8-4cec-977f-3f7e4c689894 service cinder] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:52:59.272416 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bfcb7-a2c8-4cec-977f-3f7e4c689894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:52:59.284329 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bfcb7-a2c8-4cec-977f-3f7e4c689894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:52:59.285612 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9bfcb7-a2c8-4cec-977f-3f7e4c689894 service cinder] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:52:59.296367 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1431/2857] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:52:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:53:00.673768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95eed-225c-49bc-9991-07332c74f968 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:00.674327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95eed-225c-49bc-9991-07332c74f968 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:00.674327 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf95eed-225c-49bc-9991-07332c74f968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:00.695464 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-cdf95eed-225c-49bc-9991-07332c74f968 None None] MFA Rules not processed for user `226bdd73a20e4544bf888401cf2ec3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:53:00.696689 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cdf95eed-225c-49bc-9991-07332c74f968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:00.706234 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1427/2858] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:53:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:53:01.462800 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e2087-0508-4aa6-8fd5-81feb573b12b None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:01.463323 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e2087-0508-4aa6-8fd5-81feb573b12b None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:01.463571 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e2087-0508-4aa6-8fd5-81feb573b12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:01.485207 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-b90e2087-0508-4aa6-8fd5-81feb573b12b None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:53:01.486525 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b90e2087-0508-4aa6-8fd5-81feb573b12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:01.495432 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1432/2859] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Jul 26 02:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:53:01.510127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf95eed-225c-49bc-9991-07332c74f968 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:01.511554 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-cdf95eed-225c-49bc-9991-07332c74f968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:01.529321 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf95eed-225c-49bc-9991-07332c74f968 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:01.535798 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da6469-94a9-4ea5-8704-35f86ebc4be3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:01.536493 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da6469-94a9-4ea5-8704-35f86ebc4be3 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:01.536815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da6469-94a9-4ea5-8704-35f86ebc4be3 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:01.537042 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da6469-94a9-4ea5-8704-35f86ebc4be3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:01.546316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da6469-94a9-4ea5-8704-35f86ebc4be3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:01.547753 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da6469-94a9-4ea5-8704-35f86ebc4be3 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:01.557726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1428/2860] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:53:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:53:04.635791 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5020-17b7-4c9d-82bf-6677169843af None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:04.636187 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5020-17b7-4c9d-82bf-6677169843af None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:04.636282 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d5020-17b7-4c9d-82bf-6677169843af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:04.656235 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-343d5020-17b7-4c9d-82bf-6677169843af None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:53:04.657491 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-343d5020-17b7-4c9d-82bf-6677169843af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:04.666084 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1433/2861] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Jul 26 02:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:53:04.681853 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da6469-94a9-4ea5-8704-35f86ebc4be3 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:04.693827 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da6469-94a9-4ea5-8704-35f86ebc4be3 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:04.701308 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78c608-f8a2-49a3-a5c0-515108cadae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:04.701955 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78c608-f8a2-49a3-a5c0-515108cadae8 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:04.702240 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78c608-f8a2-49a3-a5c0-515108cadae8 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:04.702514 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78c608-f8a2-49a3-a5c0-515108cadae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:04.715316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78c608-f8a2-49a3-a5c0-515108cadae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:04.717085 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78c608-f8a2-49a3-a5c0-515108cadae8 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:04.730658 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1429/2862] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:53:07.825844 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a5c9f-1254-4561-bf21-f2b5de2fbdf6 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:07.826341 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a5c9f-1254-4561-bf21-f2b5de2fbdf6 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:07.826454 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a5c9f-1254-4561-bf21-f2b5de2fbdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:07.847632 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-832a5c9f-1254-4561-bf21-f2b5de2fbdf6 None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:53:07.848821 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-832a5c9f-1254-4561-bf21-f2b5de2fbdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:07.860020 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1434/2863] 10.222.0.18 () {58 vars in 1016 bytes} [Tue Jul 26 02:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:53:07.874993 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78c608-f8a2-49a3-a5c0-515108cadae8 service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:07.887380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78c608-f8a2-49a3-a5c0-515108cadae8 service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:07.893830 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a2f9f-2712-491d-a3e6-41ed93c207d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:07.894439 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a2f9f-2712-491d-a3e6-41ed93c207d8 service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:07.894718 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a2f9f-2712-491d-a3e6-41ed93c207d8 service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:07.894988 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a2f9f-2712-491d-a3e6-41ed93c207d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:07.901115 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:53:07.903470 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a2f9f-2712-491d-a3e6-41ed93c207d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:07.905418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a2f9f-2712-491d-a3e6-41ed93c207d8 service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:07.916931 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1430/2864] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:53:17.842308 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=69 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:53:17.913276 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=2 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:53:18.885369 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a5c9f-1254-4561-bf21-f2b5de2fbdf6 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:18.886969 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-832a5c9f-1254-4561-bf21-f2b5de2fbdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:19.030538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a5c9f-1254-4561-bf21-f2b5de2fbdf6 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:19.036286 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b3950-eece-4564-bcb6-b67820e78e32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629b38364f6a414aa14123c0749ba164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:19.036885 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b3950-eece-4564-bcb6-b67820e78e32 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:19.037161 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b3950-eece-4564-bcb6-b67820e78e32 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:19.037466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b3950-eece-4564-bcb6-b67820e78e32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:19.039253 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1d1b3950-eece-4564-bcb6-b67820e78e32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:19.051455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b3950-eece-4564-bcb6-b67820e78e32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:19.053040 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b3950-eece-4564-bcb6-b67820e78e32 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:19.064233 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1435/2865] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:53:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:53:21.110347 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90cb29-7e1a-47d2-a074-28cd006c8094 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:21.110932 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90cb29-7e1a-47d2-a074-28cd006c8094 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:21.110932 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90cb29-7e1a-47d2-a074-28cd006c8094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:21.129919 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-ac90cb29-7e1a-47d2-a074-28cd006c8094 None None] MFA Rules not processed for user `226bdd73a20e4544bf888401cf2ec3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:53:21.131395 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ac90cb29-7e1a-47d2-a074-28cd006c8094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:21.139828 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1431/2866] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:53:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:53:29.060372 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=63 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:53:31.124911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:53:35.834195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4d9a-9672-4eab-a6e8-5318b0d252b2 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:35.834705 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4d9a-9672-4eab-a6e8-5318b0d252b2 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:35.834823 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac4d9a-9672-4eab-a6e8-5318b0d252b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:35.870326 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-f2ac4d9a-9672-4eab-a6e8-5318b0d252b2 None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:53:35.871564 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f2ac4d9a-9672-4eab-a6e8-5318b0d252b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:35.941148 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1436/2867] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 02:53:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:53:35.990428 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90cb29-7e1a-47d2-a074-28cd006c8094 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:35.992030 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-ac90cb29-7e1a-47d2-a074-28cd006c8094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:36.072909 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90cb29-7e1a-47d2-a074-28cd006c8094 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:36.078794 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d0580-9e4e-49a2-ac13-2d8a6c7c182b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:36.079380 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d0580-9e4e-49a2-ac13-2d8a6c7c182b service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:36.080284 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d0580-9e4e-49a2-ac13-2d8a6c7c182b service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:36.080284 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d0580-9e4e-49a2-ac13-2d8a6c7c182b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:36.088494 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d0580-9e4e-49a2-ac13-2d8a6c7c182b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:36.090122 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d0580-9e4e-49a2-ac13-2d8a6c7c182b service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:36.098289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1432/2868] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:53:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:53:37.399802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac4d9a-9672-4eab-a6e8-5318b0d252b2 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:37.401749 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-f2ac4d9a-9672-4eab-a6e8-5318b0d252b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:37.462606 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac4d9a-9672-4eab-a6e8-5318b0d252b2 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:37.469138 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afddd5-9f0f-4b55-b7e5-e4ea21f6c754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:37.469366 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afddd5-9f0f-4b55-b7e5-e4ea21f6c754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:37.469584 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afddd5-9f0f-4b55-b7e5-e4ea21f6c754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:37.469859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afddd5-9f0f-4b55-b7e5-e4ea21f6c754 admin admin] PATH_INFO: `/v3/users/8ec39c2bf1784b16b1fa357f763c2bdd` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:37.471159 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afddd5-9f0f-4b55-b7e5-e4ea21f6c754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec39c2bf1784b16b1fa357f763c2bdd)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:37.473132 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afddd5-9f0f-4b55-b7e5-e4ea21f6c754 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:37.529502 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-63afddd5-9f0f-4b55-b7e5-e4ea21f6c754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec39c2bf1784b16b1fa357f763c2bdd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:37.537452 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-63afddd5-9f0f-4b55-b7e5-e4ea21f6c754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec39c2bf1784b16b1fa357f763c2bdd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:37.547908 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-63afddd5-9f0f-4b55-b7e5-e4ea21f6c754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec39c2bf1784b16b1fa357f763c2bdd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:37.549763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-63afddd5-9f0f-4b55-b7e5-e4ea21f6c754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec39c2bf1784b16b1fa357f763c2bdd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:37.563390 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-63afddd5-9f0f-4b55-b7e5-e4ea21f6c754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec39c2bf1784b16b1fa357f763c2bdd'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:37.571232 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1437/2869] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:53:37 2022] DELETE /identity/v3/users/8ec39c2bf1784b16b1fa357f763c2bdd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:53:37.759251 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d0580-9e4e-49a2-ac13-2d8a6c7c182b service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:37.770620 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d0580-9e4e-49a2-ac13-2d8a6c7c182b service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:37.838455 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:37.839121 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:37.839567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:37.840027 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b admin admin] PATH_INFO: `/v3/projects/b8fb12a886544ec7b32aedd9fe43ee01` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:37.841504 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8fb12a886544ec7b32aedd9fe43ee01)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:37.843887 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:37.897928 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8fb12a886544ec7b32aedd9fe43ee01', 'request_id': 'req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:37.904885 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8fb12a886544ec7b32aedd9fe43ee01', 'request_id': 'req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:37.913446 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8fb12a886544ec7b32aedd9fe43ee01', 'request_id': 'req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:37.925124 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b admin admin] The token cache is being invalidate because project b8fb12a886544ec7b32aedd9fe43ee01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:53:37.925442 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:37.926174 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-b6a8c4e6-9faa-4d65-9ad7-fdee3ba1e85b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:37.931642 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1433/2870] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:53:37 2022] DELETE /identity/v3/projects/b8fb12a886544ec7b32aedd9fe43ee01 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:53:37.933271 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5b6bd-224e-429f-8c85-df0a273effdc None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:37.934264 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5b6bd-224e-429f-8c85-df0a273effdc None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:37.934546 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5b6bd-224e-429f-8c85-df0a273effdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:37.986719 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:53:37.999875 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-64e5b6bd-224e-429f-8c85-df0a273effdc None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:53:38.001126 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-64e5b6bd-224e-429f-8c85-df0a273effdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:38.073258 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1438/2871] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:53:38.083061 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d9f2e-7b3a-4ef5-a764-a71b7634b40a None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:38.083343 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d9f2e-7b3a-4ef5-a764-a71b7634b40a None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:38.083614 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d9f2e-7b3a-4ef5-a764-a71b7634b40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:38.104020 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-d71d9f2e-7b3a-4ef5-a764-a71b7634b40a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:53:38.105271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-d71d9f2e-7b3a-4ef5-a764-a71b7634b40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:38.113788 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1434/2872] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 02:53:38.118200 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5b6bd-224e-429f-8c85-df0a273effdc None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:38.131033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5b6bd-224e-429f-8c85-df0a273effdc None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:38.135960 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6a880-757b-4279-a809-744914bc87bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:38.137786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6a880-757b-4279-a809-744914bc87bd admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:38.137786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6a880-757b-4279-a809-744914bc87bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:38.137786 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6a880-757b-4279-a809-744914bc87bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:38.138394 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6a880-757b-4279-a809-744914bc87bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86830) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 02:53:38.138697 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6a880-757b-4279-a809-744914bc87bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:38.140520 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6a880-757b-4279-a809-744914bc87bd admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:38.155175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1439/2873] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 02:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 02:53:38.161376 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d9f2e-7b3a-4ef5-a764-a71b7634b40a None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:38.171533 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d9f2e-7b3a-4ef5-a764-a71b7634b40a None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:38.177103 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32918bff-2458-431f-a19f-2a266372eea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:38.177103 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32918bff-2458-431f-a19f-2a266372eea9 admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:38.177366 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32918bff-2458-431f-a19f-2a266372eea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:38.177702 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32918bff-2458-431f-a19f-2a266372eea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:38.178736 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32918bff-2458-431f-a19f-2a266372eea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:38.180813 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32918bff-2458-431f-a19f-2a266372eea9 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:38.193154 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:53:38.214674 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1435/2874] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:53:38 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:53:38.219063 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6a880-757b-4279-a809-744914bc87bd admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:38.233440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6a880-757b-4279-a809-744914bc87bd admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:38.312605 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1544-e5c0-4313-bcc8-ca95a5d7e6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:38.313588 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1544-e5c0-4313-bcc8-ca95a5d7e6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:38.314095 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1544-e5c0-4313-bcc8-ca95a5d7e6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:38.314734 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa1544-e5c0-4313-bcc8-ca95a5d7e6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:38.315882 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1544-e5c0-4313-bcc8-ca95a5d7e6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:38.318761 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa1544-e5c0-4313-bcc8-ca95a5d7e6c8 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:38.349458 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1440/2875] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:53:38 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 02:53:38.354307 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32918bff-2458-431f-a19f-2a266372eea9 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:38.368164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32918bff-2458-431f-a19f-2a266372eea9 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:38.374561 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2189c-842d-48b5-98b4-a62686b3075b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:38.375356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2189c-842d-48b5-98b4-a62686b3075b admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:38.375834 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2189c-842d-48b5-98b4-a62686b3075b admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:38.376153 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2189c-842d-48b5-98b4-a62686b3075b admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:38.377022 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2189c-842d-48b5-98b4-a62686b3075b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:38.379191 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2189c-842d-48b5-98b4-a62686b3075b admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:38.391768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1436/2876] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:53:38.396613 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1544-e5c0-4313-bcc8-ca95a5d7e6c8 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:38.410303 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa1544-e5c0-4313-bcc8-ca95a5d7e6c8 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:38.416268 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d60b2e-1584-4d60-82d3-c2df1ded7a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:38.417007 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d60b2e-1584-4d60-82d3-c2df1ded7a09 admin admin] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:38.417478 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d60b2e-1584-4d60-82d3-c2df1ded7a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:38.417903 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d60b2e-1584-4d60-82d3-c2df1ded7a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:38.418737 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d60b2e-1584-4d60-82d3-c2df1ded7a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:38.420789 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d60b2e-1584-4d60-82d3-c2df1ded7a09 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:38.438562 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1441/2877] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:53:38.441989 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2189c-842d-48b5-98b4-a62686b3075b admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:38.457941 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2189c-842d-48b5-98b4-a62686b3075b admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:38.464469 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba9847-b8ec-4c6a-872c-db9641c7e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:38.465155 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba9847-b8ec-4c6a-872c-db9641c7e768 admin admin] REQUEST_METHOD: `PUT` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:38.465480 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba9847-b8ec-4c6a-872c-db9641c7e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:38.465760 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba9847-b8ec-4c6a-872c-db9641c7e768 admin admin] PATH_INFO: `/v3/projects/ec1ab9f53dc846c5b250a18733d0accc/users/9f7f562fbdb4453aad3f70e040ecb361/roles/d93e06f63f2947f98ad9a668b80929dc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:38.490001 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba9847-b8ec-4c6a-872c-db9641c7e768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1ab9f53dc846c5b250a18733d0accc, user_id=9f7f562fbdb4453aad3f70e040ecb361, role_id=d93e06f63f2947f98ad9a668b80929dc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:38.494144 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba9847-b8ec-4c6a-872c-db9641c7e768 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:38.510516 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1437/2878] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:53:38 2022] PUT /identity/v3/projects/ec1ab9f53dc846c5b250a18733d0accc/users/9f7f562fbdb4453aad3f70e040ecb361/roles/d93e06f63f2947f98ad9a668b80929dc => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:53:38.516186 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baa8ac-58e3-4a1c-b31e-2cf02ee4b44a None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:38.516650 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baa8ac-58e3-4a1c-b31e-2cf02ee4b44a None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:38.516936 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baa8ac-58e3-4a1c-b31e-2cf02ee4b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:38.546797 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-48baa8ac-58e3-4a1c-b31e-2cf02ee4b44a None None] MFA Rules not processed for user `5c2fa740cfd643e6a29f9d9686eada23`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:53:38.548474 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-48baa8ac-58e3-4a1c-b31e-2cf02ee4b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:38.617865 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1442/2879] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:53:38.636596 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba9847-b8ec-4c6a-872c-db9641c7e768 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:38.638478 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-29ba9847-b8ec-4c6a-872c-db9641c7e768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:38.740202 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba9847-b8ec-4c6a-872c-db9641c7e768 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:38.745045 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c731a-93c3-42a7-977a-fb4b0fde0014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:38.745737 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c731a-93c3-42a7-977a-fb4b0fde0014 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:38.746022 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c731a-93c3-42a7-977a-fb4b0fde0014 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:38.746289 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c731a-93c3-42a7-977a-fb4b0fde0014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:38.756730 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c731a-93c3-42a7-977a-fb4b0fde0014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:38.758245 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c731a-93c3-42a7-977a-fb4b0fde0014 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:38.769640 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1438/2880] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:53:44.002133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273a00-9f01-480d-9b5a-34e48cf13a8f None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:44.002133 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273a00-9f01-480d-9b5a-34e48cf13a8f None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:44.002973 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273a00-9f01-480d-9b5a-34e48cf13a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:44.030526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:53:44.046651 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-15273a00-9f01-480d-9b5a-34e48cf13a8f None None] MFA Rules not processed for user `9f7f562fbdb4453aad3f70e040ecb361`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:53:44.054974 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-15273a00-9f01-480d-9b5a-34e48cf13a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:44.178080 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1443/2881] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:53:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:53:44.182900 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c731a-93c3-42a7-977a-fb4b0fde0014 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:44.198092 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c731a-93c3-42a7-977a-fb4b0fde0014 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:44.205382 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae962d-2d61-461d-bf13-c8a47e682f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:44.206237 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae962d-2d61-461d-bf13-c8a47e682f6c admin admin] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:44.206843 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae962d-2d61-461d-bf13-c8a47e682f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:44.207472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae962d-2d61-461d-bf13-c8a47e682f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:44.208342 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae962d-2d61-461d-bf13-c8a47e682f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:44.210752 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae962d-2d61-461d-bf13-c8a47e682f6c admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:44.270046 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1439/2882] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 02:53:44 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:53:44.272878 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15273a00-9f01-480d-9b5a-34e48cf13a8f None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:44.285855 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15273a00-9f01-480d-9b5a-34e48cf13a8f None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:44.403799 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235c6d3-adec-49d6-bd54-02a1ee922a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:44.404872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235c6d3-adec-49d6-bd54-02a1ee922a26 admin admin] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:44.405242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235c6d3-adec-49d6-bd54-02a1ee922a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:44.405674 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235c6d3-adec-49d6-bd54-02a1ee922a26 admin admin] PATH_INFO: `/v3/users` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:44.408441 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235c6d3-adec-49d6-bd54-02a1ee922a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:44.408441 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235c6d3-adec-49d6-bd54-02a1ee922a26 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:44.444934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1444/2883] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 02:53:44 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 02:53:44.450528 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae962d-2d61-461d-bf13-c8a47e682f6c admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:44.464694 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae962d-2d61-461d-bf13-c8a47e682f6c admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:44.470544 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2ae91-fbaf-41f1-b141-fe6f212c4535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:44.471284 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ae91-fbaf-41f1-b141-fe6f212c4535 admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:44.471660 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ae91-fbaf-41f1-b141-fe6f212c4535 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:44.472023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ae91-fbaf-41f1-b141-fe6f212c4535 admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:44.472822 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2ae91-fbaf-41f1-b141-fe6f212c4535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:44.474844 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2ae91-fbaf-41f1-b141-fe6f212c4535 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:44.488271 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1440/2884] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:53:44.492934 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235c6d3-adec-49d6-bd54-02a1ee922a26 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:44.504250 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235c6d3-adec-49d6-bd54-02a1ee922a26 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:44.510687 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff441a1-62d4-4609-856d-4d18671b1c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:44.511477 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff441a1-62d4-4609-856d-4d18671b1c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:44.511813 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff441a1-62d4-4609-856d-4d18671b1c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:44.512145 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff441a1-62d4-4609-856d-4d18671b1c51 admin admin] PATH_INFO: `/v3/projects/a463a8be606b4ed5941dd1dc8fecb2df/users/f189331aab3641a297029c658c1326fa/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:44.534704 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff441a1-62d4-4609-856d-4d18671b1c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a463a8be606b4ed5941dd1dc8fecb2df, user_id=f189331aab3641a297029c658c1326fa, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:44.538203 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff441a1-62d4-4609-856d-4d18671b1c51 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:44.559836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2ae91-fbaf-41f1-b141-fe6f212c4535 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:44.560411 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1445/2885] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:53:44 2022] PUT /identity/v3/projects/a463a8be606b4ed5941dd1dc8fecb2df/users/f189331aab3641a297029c658c1326fa/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:53:44.570920 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2ae91-fbaf-41f1-b141-fe6f212c4535 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:44.646562 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be29d4-e810-43b6-95f4-bc719b5252ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:44.647407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be29d4-e810-43b6-95f4-bc719b5252ff admin admin] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:44.647857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be29d4-e810-43b6-95f4-bc719b5252ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:44.657836 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be29d4-e810-43b6-95f4-bc719b5252ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:44.658705 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be29d4-e810-43b6-95f4-bc719b5252ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:44.660983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be29d4-e810-43b6-95f4-bc719b5252ff admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:44.676546 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1441/2886] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 02:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 02:53:44.680581 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff441a1-62d4-4609-856d-4d18671b1c51 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:44.691102 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff441a1-62d4-4609-856d-4d18671b1c51 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:44.696104 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19028b-97bc-4be0-807b-08a4c3e39053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:44.696857 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19028b-97bc-4be0-807b-08a4c3e39053 admin admin] REQUEST_METHOD: `PUT` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:44.697197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19028b-97bc-4be0-807b-08a4c3e39053 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:44.697584 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19028b-97bc-4be0-807b-08a4c3e39053 admin admin] PATH_INFO: `/v3/projects/a463a8be606b4ed5941dd1dc8fecb2df/users/f189331aab3641a297029c658c1326fa/roles/e87a5d13c5ba4f4eabc7a23803868dbf` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:44.701554 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19028b-97bc-4be0-807b-08a4c3e39053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a463a8be606b4ed5941dd1dc8fecb2df, user_id=f189331aab3641a297029c658c1326fa, role_id=e87a5d13c5ba4f4eabc7a23803868dbf)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:44.702490 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19028b-97bc-4be0-807b-08a4c3e39053 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:44.721176 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1446/2887] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 02:53:44 2022] PUT /identity/v3/projects/a463a8be606b4ed5941dd1dc8fecb2df/users/f189331aab3641a297029c658c1326fa/roles/e87a5d13c5ba4f4eabc7a23803868dbf => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:53:50.655531 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607cd42-c6bd-4e27-9ecd-55442a8467bd None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:50.657113 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607cd42-c6bd-4e27-9ecd-55442a8467bd None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:50.657626 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607cd42-c6bd-4e27-9ecd-55442a8467bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:50.670801 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:53:50.699567 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-f607cd42-c6bd-4e27-9ecd-55442a8467bd None None] MFA Rules not processed for user `f189331aab3641a297029c658c1326fa`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:53:50.701270 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-f607cd42-c6bd-4e27-9ecd-55442a8467bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:50.804306 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1442/2888] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:53:50 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:53:50.817242 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19028b-97bc-4be0-807b-08a4c3e39053 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:50.819125 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3c19028b-97bc-4be0-807b-08a4c3e39053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:50.908944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:53:50.985064 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19028b-97bc-4be0-807b-08a4c3e39053 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:50.992185 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e8e9c-e014-4f59-9e86-beb7466944bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:50.993048 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8e9c-e014-4f59-9e86-beb7466944bf service nova] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:50.993463 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8e9c-e014-4f59-9e86-beb7466944bf service nova] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:50.993952 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e8e9c-e014-4f59-9e86-beb7466944bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:51.073904 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e8e9c-e014-4f59-9e86-beb7466944bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:51.076377 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e8e9c-e014-4f59-9e86-beb7466944bf service nova] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:51.089812 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1447/2889] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:53:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:53:52.302037 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008aedb-071a-4816-a9d9-141cd3be5c88 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:52.302535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008aedb-071a-4816-a9d9-141cd3be5c88 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:52.302695 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008aedb-071a-4816-a9d9-141cd3be5c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:52.331898 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-8008aedb-071a-4816-a9d9-141cd3be5c88 None None] MFA Rules not processed for user `9f7f562fbdb4453aad3f70e040ecb361`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:53:52.335620 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8008aedb-071a-4816-a9d9-141cd3be5c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:52.345185 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1443/2890] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 02:53:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:53:57.463327 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda825ac-9770-4f4f-8c3a-d34f517564a1 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:57.463846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda825ac-9770-4f4f-8c3a-d34f517564a1 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:57.463846 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda825ac-9770-4f4f-8c3a-d34f517564a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:57.486667 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-bda825ac-9770-4f4f-8c3a-d34f517564a1 None None] MFA Rules not processed for user `1a3ecd4bf47a4842b522ccdb575203d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:53:57.488184 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bda825ac-9770-4f4f-8c3a-d34f517564a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:57.548756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1448/2891] 10.222.0.39 () {58 vars in 967 bytes} [Tue Jul 26 02:53:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:53:57.561296 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008aedb-071a-4816-a9d9-141cd3be5c88 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:57.562796 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8008aedb-071a-4816-a9d9-141cd3be5c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:57.642216 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008aedb-071a-4816-a9d9-141cd3be5c88 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:57.647407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f1bd5-7897-4300-b85d-d221df13c3d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2365526802146088fcaa4afc2e03a35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:57.648052 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f1bd5-7897-4300-b85d-d221df13c3d7 service swift] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:57.648331 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f1bd5-7897-4300-b85d-d221df13c3d7 service swift] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:57.648597 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f1bd5-7897-4300-b85d-d221df13c3d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:57.656671 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f1bd5-7897-4300-b85d-d221df13c3d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:57.658298 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f1bd5-7897-4300-b85d-d221df13c3d7 service swift] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:57.666420 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1444/2892] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 02:53:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 02:53:59.651397 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda825ac-9770-4f4f-8c3a-d34f517564a1 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:53:59.652929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bda825ac-9770-4f4f-8c3a-d34f517564a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:53:59.722871 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda825ac-9770-4f4f-8c3a-d34f517564a1 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:53:59.729195 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:53:59.729932 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:53:59.730254 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:53:59.730573 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] PATH_INFO: `/v3/users/226bdd73a20e4544bf888401cf2ec3c3` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:53:59.732197 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=226bdd73a20e4544bf888401cf2ec3c3)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:53:59.734550 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:53:59.750175 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:53:59.790816 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '226bdd73a20e4544bf888401cf2ec3c3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:59.798205 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '226bdd73a20e4544bf888401cf2ec3c3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:59.805940 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '226bdd73a20e4544bf888401cf2ec3c3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:59.806647 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '226bdd73a20e4544bf888401cf2ec3c3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:59.818771 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '226bdd73a20e4544bf888401cf2ec3c3'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:53:59.824714 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1449/2893] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:53:59 2022] DELETE /identity/v3/users/226bdd73a20e4544bf888401cf2ec3c3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:54:00.009882 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f1bd5-7897-4300-b85d-d221df13c3d7 service swift] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:54:00.020873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f1bd5-7897-4300-b85d-d221df13c3d7 service swift] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:54:00.079418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:54:00.080071 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:54:00.080356 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:54:00.080629 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] PATH_INFO: `/v3/projects/7f8c71fdbb604ca9a35e5bbe23cc6f08` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:54:00.081848 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f8c71fdbb604ca9a35e5bbe23cc6f08)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:54:00.083768 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:54:00.096358 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=100 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:54:00.137648 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8c71fdbb604ca9a35e5bbe23cc6f08', 'request_id': 'req-68e74ca3-4204-4182-a079-cd5e230ac644'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:54:00.146535 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8c71fdbb604ca9a35e5bbe23cc6f08', 'request_id': 'req-68e74ca3-4204-4182-a079-cd5e230ac644'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:54:00.158223 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8c71fdbb604ca9a35e5bbe23cc6f08', 'request_id': 'req-68e74ca3-4204-4182-a079-cd5e230ac644'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:54:00.179574 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] The token cache is being invalidate because project 7f8c71fdbb604ca9a35e5bbe23cc6f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:54:00.179954 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:54:00.180686 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:54:00.182407 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1445/2894] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:54:00 2022] DELETE /identity/v3/projects/7f8c71fdbb604ca9a35e5bbe23cc6f08 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:54:09.821181 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:54:10.175668 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:54:18.508912 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:54:18.510466 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:54:18.571014 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c21c9-312d-4b91-bb44-53bc05ea54bc admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:54:18.628274 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23f1d0-1189-441d-b7e3-a6cbbed4e795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:54:18.628900 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23f1d0-1189-441d-b7e3-a6cbbed4e795 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:54:18.629189 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23f1d0-1189-441d-b7e3-a6cbbed4e795 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:54:18.629497 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23f1d0-1189-441d-b7e3-a6cbbed4e795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:54:18.631535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-fd23f1d0-1189-441d-b7e3-a6cbbed4e795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:54:18.697783 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23f1d0-1189-441d-b7e3-a6cbbed4e795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:54:18.699138 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23f1d0-1189-441d-b7e3-a6cbbed4e795 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:54:18.709526 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1450/2895] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:54:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:54:28.705275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=70 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:56:14.982726 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:56:14.984325 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:56:14.998489 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e74ca3-4204-4182-a079-cd5e230ac644 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:56:15.003123 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a0ac3-b921-4102-8121-2162b7bd71ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:56:15.003756 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a0ac3-b921-4102-8121-2162b7bd71ab service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:56:15.004039 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a0ac3-b921-4102-8121-2162b7bd71ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:56:15.004311 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a0ac3-b921-4102-8121-2162b7bd71ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:56:15.006279 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-9c1a0ac3-b921-4102-8121-2162b7bd71ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:56:15.083210 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a0ac3-b921-4102-8121-2162b7bd71ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:56:15.084570 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a0ac3-b921-4102-8121-2162b7bd71ab service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:56:15.096139 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1446/2896] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:56:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:56:16.289332 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23f1d0-1189-441d-b7e3-a6cbbed4e795 service neutron] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:56:16.299768 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23f1d0-1189-441d-b7e3-a6cbbed4e795 service neutron] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:56:16.304167 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3596e6-b42c-43bf-b24b-4be59ab130c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:56:16.304802 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3596e6-b42c-43bf-b24b-4be59ab130c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:56:16.305079 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3596e6-b42c-43bf-b24b-4be59ab130c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:56:16.305362 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3596e6-b42c-43bf-b24b-4be59ab130c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:56:16.307304 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-2d3596e6-b42c-43bf-b24b-4be59ab130c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:56:16.322046 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3596e6-b42c-43bf-b24b-4be59ab130c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:56:16.323498 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3596e6-b42c-43bf-b24b-4be59ab130c1 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:56:16.336220 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1451/2897] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:56:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:56:23.782857 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a0ac3-b921-4102-8121-2162b7bd71ab service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:56:23.792309 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a0ac3-b921-4102-8121-2162b7bd71ab service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:56:23.796807 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de316a49-c323-4abd-afa6-8b1e0447a7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:56:23.797473 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de316a49-c323-4abd-afa6-8b1e0447a7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:56:23.797753 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de316a49-c323-4abd-afa6-8b1e0447a7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:56:23.798016 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de316a49-c323-4abd-afa6-8b1e0447a7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:56:23.800028 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-de316a49-c323-4abd-afa6-8b1e0447a7b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:56:23.811062 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de316a49-c323-4abd-afa6-8b1e0447a7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:56:23.812499 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de316a49-c323-4abd-afa6-8b1e0447a7b3 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:56:23.821319 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1447/2898] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:56:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:56:26.330664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=6 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:56:28.444097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63270e7-35bf-46e8-ab88-ce264f0b4939 None None] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:56:28.444859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63270e7-35bf-46e8-ab88-ce264f0b4939 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:56:28.444859 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63270e7-35bf-46e8-ab88-ce264f0b4939 None None] PATH_INFO: `/` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:56:28.446313 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1452/2899] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 02:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:56:28.452835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c0cba-5aa2-4a2d-996b-9b105c8ba6d2 None None] REQUEST_METHOD: `POST` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:56:28.453815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c0cba-5aa2-4a2d-996b-9b105c8ba6d2 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:56:28.453815 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c0cba-5aa2-4a2d-996b-9b105c8ba6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:56:28.493667 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.auth.core [None req-a61c0cba-5aa2-4a2d-996b-9b105c8ba6d2 None None] MFA Rules not processed for user `fe228871a7fd4a9bb15645955ff365c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86829) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:56:28.494967 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-a61c0cba-5aa2-4a2d-996b-9b105c8ba6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:56:28.502141 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1448/2900] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:56:28.516385 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63270e7-35bf-46e8-ab88-ce264f0b4939 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:56:28.518405 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-b63270e7-35bf-46e8-ab88-ce264f0b4939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:56:28.532902 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63270e7-35bf-46e8-ab88-ce264f0b4939 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:56:28.536455 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c611e-95ae-46be-a1f5-e61415cf75e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:56:28.537072 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c611e-95ae-46be-a1f5-e61415cf75e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:56:28.537383 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c611e-95ae-46be-a1f5-e61415cf75e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:56:28.537673 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c611e-95ae-46be-a1f5-e61415cf75e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:56:28.545664 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c611e-95ae-46be-a1f5-e61415cf75e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:56:28.547110 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c611e-95ae-46be-a1f5-e61415cf75e2 service neutron] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:56:28.558677 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1453/2901] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:56:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:56:28.646980 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493c90f-ad73-4031-a0b4-cc9148d8a019 None None] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:56:28.647238 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493c90f-ad73-4031-a0b4-cc9148d8a019 None None] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:56:28.647537 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493c90f-ad73-4031-a0b4-cc9148d8a019 None None] PATH_INFO: `/` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:56:28.648915 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1449/2902] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 02:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 02:56:28.654828 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a1c88-0eee-456a-acda-c422f7652548 None None] REQUEST_METHOD: `POST` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:56:28.655003 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a1c88-0eee-456a-acda-c422f7652548 None None] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:56:28.655309 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a1c88-0eee-456a-acda-c422f7652548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:56:28.695475 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.auth.core [None req-545a1c88-0eee-456a-acda-c422f7652548 None None] MFA Rules not processed for user `338b2744014940ca96c08d4e9262697b`. Rule list: `[]` (Enabled: `True`). {{(pid=86830) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 02:56:28.696733 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-545a1c88-0eee-456a-acda-c422f7652548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:56:28.709097 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1454/2903] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 02:56:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 02:56:28.720404 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493c90f-ad73-4031-a0b4-cc9148d8a019 None None] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:56:28.732488 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493c90f-ad73-4031-a0b4-cc9148d8a019 None None] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:56:28.737006 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1978dc-f8a5-47a6-8943-53ade74b3319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe228871a7fd4a9bb15645955ff365c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:56:28.737661 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1978dc-f8a5-47a6-8943-53ade74b3319 service neutron] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:56:28.737940 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1978dc-f8a5-47a6-8943-53ade74b3319 service neutron] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:56:28.738211 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1978dc-f8a5-47a6-8943-53ade74b3319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:56:28.749351 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1978dc-f8a5-47a6-8943-53ade74b3319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:56:28.750804 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1978dc-f8a5-47a6-8943-53ade74b3319 service neutron] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:56:28.761873 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1450/2904] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:56:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:56:28.828440 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a1c88-0eee-456a-acda-c422f7652548 None None] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:56:28.830319 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-545a1c88-0eee-456a-acda-c422f7652548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:56:28.909535 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a1c88-0eee-456a-acda-c422f7652548 None None] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:56:28.914756 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce72964-ebae-44bb-9423-07be81e87de5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629b38364f6a414aa14123c0749ba164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:56:28.915384 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce72964-ebae-44bb-9423-07be81e87de5 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:56:28.915662 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce72964-ebae-44bb-9423-07be81e87de5 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:56:28.915929 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce72964-ebae-44bb-9423-07be81e87de5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:56:28.918115 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-bce72964-ebae-44bb-9423-07be81e87de5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:56:28.931790 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce72964-ebae-44bb-9423-07be81e87de5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:56:28.933895 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce72964-ebae-44bb-9423-07be81e87de5 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:56:28.952191 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1455/2905] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:56:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:56:38.757029 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=55 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:56:38.947229 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=47 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:57:49.123349 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1978dc-f8a5-47a6-8943-53ade74b3319 service neutron] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:57:49.124983 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2a1978dc-f8a5-47a6-8943-53ade74b3319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:57:49.144806 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1978dc-f8a5-47a6-8943-53ade74b3319 service neutron] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:57:49.150022 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119cfd2-4c99-41ee-9a49-09fd293df98f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '338b2744014940ca96c08d4e9262697b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:57:49.152635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119cfd2-4c99-41ee-9a49-09fd293df98f service nova] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:57:49.152635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119cfd2-4c99-41ee-9a49-09fd293df98f service nova] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:57:49.152635 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119cfd2-4c99-41ee-9a49-09fd293df98f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:57:49.154164 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-8119cfd2-4c99-41ee-9a49-09fd293df98f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:57:49.168858 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119cfd2-4c99-41ee-9a49-09fd293df98f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:57:49.170536 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119cfd2-4c99-41ee-9a49-09fd293df98f service nova] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:57:49.184685 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1451/2906] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:57:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:57:57.269594 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce72964-ebae-44bb-9423-07be81e87de5 service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:57:57.286275 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce72964-ebae-44bb-9423-07be81e87de5 service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:57:57.293899 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d5a64-8729-46bf-a3e2-02fcb38aaaf5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629b38364f6a414aa14123c0749ba164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:57:57.294699 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d5a64-8729-46bf-a3e2-02fcb38aaaf5 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:57:57.295033 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d5a64-8729-46bf-a3e2-02fcb38aaaf5 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:57:57.295378 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d5a64-8729-46bf-a3e2-02fcb38aaaf5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:57:57.297893 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5b3d5a64-8729-46bf-a3e2-02fcb38aaaf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:57:57.315538 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d5a64-8729-46bf-a3e2-02fcb38aaaf5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:57:57.318325 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d5a64-8729-46bf-a3e2-02fcb38aaaf5 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:57:57.335099 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1456/2907] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:57:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:57:59.179255 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=6 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:58:00.692551 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119cfd2-4c99-41ee-9a49-09fd293df98f service nova] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:58:00.705911 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119cfd2-4c99-41ee-9a49-09fd293df98f service nova] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:58:00.713539 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051e333-9cd6-40cc-b3f3-0abfcd589034 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629b38364f6a414aa14123c0749ba164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:58:00.714472 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e333-9cd6-40cc-b3f3-0abfcd589034 service placement] REQUEST_METHOD: `GET` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:58:00.715218 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e333-9cd6-40cc-b3f3-0abfcd589034 service placement] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:58:00.715668 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e333-9cd6-40cc-b3f3-0abfcd589034 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:58:00.718136 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-2051e333-9cd6-40cc-b3f3-0abfcd589034 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:58:00.740569 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051e333-9cd6-40cc-b3f3-0abfcd589034 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:58:00.744137 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051e333-9cd6-40cc-b3f3-0abfcd589034 service placement] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:58:00.779866 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1452/2908] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:58:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:58:00.794513 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d5a64-8729-46bf-a3e2-02fcb38aaaf5 service placement] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:58:00.796256 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-5b3d5a64-8729-46bf-a3e2-02fcb38aaaf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:58:00.875763 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d5a64-8729-46bf-a3e2-02fcb38aaaf5 service placement] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:58:00.880593 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:58:00.881260 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:58:00.881729 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:58:00.881999 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] PATH_INFO: `/v3/users/9f7f562fbdb4453aad3f70e040ecb361` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:58:00.883206 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7f562fbdb4453aad3f70e040ecb361)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:58:00.885190 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:58:00.940826 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7f562fbdb4453aad3f70e040ecb361'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:00.947979 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7f562fbdb4453aad3f70e040ecb361'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:00.957822 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7f562fbdb4453aad3f70e040ecb361'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:00.958557 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7f562fbdb4453aad3f70e040ecb361'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:00.972269 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7f562fbdb4453aad3f70e040ecb361'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:00.979076 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1457/2909] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:58:00 2022] DELETE /identity/v3/users/9f7f562fbdb4453aad3f70e040ecb361 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 02:58:01.225906 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051e333-9cd6-40cc-b3f3-0abfcd589034 service placement] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:58:01.237933 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051e333-9cd6-40cc-b3f3-0abfcd589034 service placement] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:58:01.305053 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:58:01.305778 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:58:01.306063 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:58:01.306340 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] PATH_INFO: `/v3/projects/ec1ab9f53dc846c5b250a18733d0accc` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:58:01.307733 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1ab9f53dc846c5b250a18733d0accc)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:58:01.309835 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:58:01.368453 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1ab9f53dc846c5b250a18733d0accc', 'request_id': 'req-abd0b073-d610-4a10-8ab5-bc827b0f88f6'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.376852 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1ab9f53dc846c5b250a18733d0accc', 'request_id': 'req-abd0b073-d610-4a10-8ab5-bc827b0f88f6'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.387256 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1ab9f53dc846c5b250a18733d0accc', 'request_id': 'req-abd0b073-d610-4a10-8ab5-bc827b0f88f6'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.401098 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] The token cache is being invalidate because project ec1ab9f53dc846c5b250a18733d0accc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:58:01.401418 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.402224 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.404859 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1453/2910] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:58:01 2022] DELETE /identity/v3/projects/ec1ab9f53dc846c5b250a18733d0accc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:58:01.409649 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:58:01.411446 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:58:01.426670 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990c47-c658-41ca-83d9-a2d095d849bf admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:58:01.501872 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:58:01.502590 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:58:01.502870 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:58:01.503143 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] PATH_INFO: `/v3/users/f189331aab3641a297029c658c1326fa` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:58:01.504618 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f189331aab3641a297029c658c1326fa)` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:58:01.506706 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:58:01.514166 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:58:01.568034 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f189331aab3641a297029c658c1326fa'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.575403 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f189331aab3641a297029c658c1326fa'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.584188 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f189331aab3641a297029c658c1326fa'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.584944 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f189331aab3641a297029c658c1326fa'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.599183 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.notifications [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f189331aab3641a297029c658c1326fa'} {{(pid=86830) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.606316 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1458/2911] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 02:58:01 2022] DELETE /identity/v3/users/f189331aab3641a297029c658c1326fa => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:58:01.804316 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] Authenticating user token {{(pid=86829) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:58:01.806008 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.fernet_utils [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86829) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:58:01.829965 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0b073-d610-4a10-8ab5-bc827b0f88f6 admin admin] Validating token access rules against request {{(pid=86829) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:58:01.906781 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49a451-7755-4b40-8648-a971bc9aaf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c2fa740cfd643e6a29f9d9686eada23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcd69a7399884288be80cb2c7e9c442d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86829) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:58:01.907527 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49a451-7755-4b40-8648-a971bc9aaf7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:58:01.907893 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49a451-7755-4b40-8648-a971bc9aaf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:58:01.908217 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49a451-7755-4b40-8648-a971bc9aaf7e admin admin] PATH_INFO: `/v3/projects/a463a8be606b4ed5941dd1dc8fecb2df` {{(pid=86829) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:58:01.909770 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49a451-7755-4b40-8648-a971bc9aaf7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a463a8be606b4ed5941dd1dc8fecb2df)` {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:58:01.911961 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49a451-7755-4b40-8648-a971bc9aaf7e admin admin] RBAC: Authorization granted {{(pid=86829) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:58:01.937127 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:58:01.970023 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cb49a451-7755-4b40-8648-a971bc9aaf7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a463a8be606b4ed5941dd1dc8fecb2df', 'request_id': 'req-cb49a451-7755-4b40-8648-a971bc9aaf7e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.976891 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cb49a451-7755-4b40-8648-a971bc9aaf7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a463a8be606b4ed5941dd1dc8fecb2df', 'request_id': 'req-cb49a451-7755-4b40-8648-a971bc9aaf7e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.985999 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cb49a451-7755-4b40-8648-a971bc9aaf7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a463a8be606b4ed5941dd1dc8fecb2df', 'request_id': 'req-cb49a451-7755-4b40-8648-a971bc9aaf7e'} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.998885 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cb49a451-7755-4b40-8648-a971bc9aaf7e admin admin] The token cache is being invalidate because project a463a8be606b4ed5941dd1dc8fecb2df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86829) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 02:58:01.999257 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cb49a451-7755-4b40-8648-a971bc9aaf7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:01.999992 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG keystone.notifications [None req-cb49a451-7755-4b40-8648-a971bc9aaf7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86829) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 02:58:02.001707 dv-cinder-850840-2-smb devstack@keystone.service[86829]: [pid: 86829|app: 0|req: 1454/2912] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 02:58:01 2022] DELETE /identity/v3/projects/a463a8be606b4ed5941dd1dc8fecb2df => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 02:58:11.602142 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:58:11.995152 dv-cinder-850840-2-smb devstack@keystone.service[86829]: DEBUG dbcounter [-] [86829] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 02:58:27.938732 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] Authenticating user token {{(pid=86830) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 02:58:27.940365 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:58:28.020339 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70135d-f290-40ed-9f8c-9c4f6e5b6953 admin admin] Validating token access rules against request {{(pid=86830) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 02:58:28.082754 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ae1dc-3a97-47a5-8aef-203d795f9371 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '629b38364f6a414aa14123c0749ba164', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b017927d64b44db8a1611f20e6e3b6f5', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86830) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 02:58:28.083494 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ae1dc-3a97-47a5-8aef-203d795f9371 service placement] REQUEST_METHOD: `GET` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 02:58:28.083772 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ae1dc-3a97-47a5-8aef-203d795f9371 service placement] SCRIPT_NAME: `/identity` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 02:58:28.084041 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ae1dc-3a97-47a5-8aef-203d795f9371 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86830) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 02:58:28.085995 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.fernet_utils [None req-431ae1dc-3a97-47a5-8aef-203d795f9371 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86830) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 02:58:28.098443 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ae1dc-3a97-47a5-8aef-203d795f9371 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 02:58:28.100047 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ae1dc-3a97-47a5-8aef-203d795f9371 service placement] RBAC: Authorization granted {{(pid=86830) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 02:58:28.110608 dv-cinder-850840-2-smb devstack@keystone.service[86830]: [pid: 86830|app: 0|req: 1459/2913] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 02:58:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 02:58:38.106298 dv-cinder-850840-2-smb devstack@keystone.service[86830]: DEBUG dbcounter [-] [86830] Writing DB stats keystone:SELECT=58 {{(pid=86830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}